Sep 16 20:12:17 devstack cinder-volume[75171]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 16 20:12:17 devstack cinder-volume[75171]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 16 20:12:17 devstack cinder-volume[75171]: we strongly recommend against using it for new projects. Sep 16 20:12:17 devstack cinder-volume[75171]: If you are already using Eventlet, we recommend migrating to a different Sep 16 20:12:17 devstack cinder-volume[75171]: framework. For more detail see Sep 16 20:12:17 devstack cinder-volume[75171]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 16 20:12:17 devstack cinder-volume[75171]: import eventlet # noqa Sep 16 20:12:20 devstack cinder-volume[75171]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75171) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 16 20:12:20 devstack cinder-volume[75171]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75171) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 16 20:12:20 devstack cinder-volume[75171]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75171) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 16 20:12:21 devstack cinder-volume[75171]: INFO dbcounter [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] Registered counter for database cinder Sep 16 20:12:21 devstack cinder-volume[75171]: DEBUG oslo_db.sqlalchemy.engines [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75171) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 16 20:12:21 devstack cinder-volume[75171]: DEBUG dbcounter [-] [75171] Writer thread running {{(pid=75171) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 16 20:12:21 devstack cinder-volume[75171]: INFO cinder.rpc [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 16 20:12:21 devstack cinder-volume[75171]: INFO cinder.rpc [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 16 20:12:21 devstack cinder-volume[75171]: DEBUG oslo_db.sqlalchemy.engines [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75171) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 16 20:12:22 devstack cinder-volume[75171]: INFO cinder.volume.manager [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] Determined volume DB was empty at startup. Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG cinder.volume.manager [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75171) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 16 20:12:22 devstack cinder-volume[75171]: INFO cinder.volume.manager [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 16 20:12:22 devstack cinder-volume[75171]: WARNING stevedore.named [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 16 20:12:22 devstack cinder-volume[75171]: WARNING castellan.key_manager [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 16 20:12:22 devstack cinder-volume[75171]: WARNING cinder.keymgr.conf_key_mgr [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG cinder.volume.drivers.lvm [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75171) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_concurrency.processutils [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_concurrency.processutils [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] CMD "cinder-rtstool verify" returned: 0 in 0.406s {{(pid=75171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_db.sqlalchemy.engines [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75171) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 16 20:12:22 devstack cinder-volume[75171]: INFO cinder.rpc [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 16 20:12:22 devstack cinder-volume[75171]: INFO cinder.rpc [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 16 20:12:22 devstack cinder-volume[75171]: WARNING stevedore.named [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 16 20:12:22 devstack cinder-volume[75171]: WARNING castellan.key_manager [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 16 20:12:22 devstack cinder-volume[75171]: INFO cinder.volume.manager [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_db.sqlalchemy.engines [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75171) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 16 20:12:22 devstack cinder-volume[75171]: INFO oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] Starting 1 workers Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] Started child 75332 {{(pid=75171) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] Full set of CONF: {{(pid=75171) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] ******************************************************************************** {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] Configuration options gathered from: {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 16 20:12:22 devstack cinder-volume[75332]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] ================================================================================ {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] allow_availability_zone_fallback = False {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] allow_compression_on_image_upload = False {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] allowed_direct_url_schemes = [] {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] api_rate_limit = True {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] auth_strategy = keystone {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] az_cache_duration = 3600 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] backend_availability_zone = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] backend_host = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] backend_name = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] backend_stats_polling_interval = 60 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] backup_api_class = cinder.backup.api.API {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] backup_name_template = backup-%s {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] backup_use_same_host = False {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] backup_use_temp_snapshot = False {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] chap_password = **** {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] chap_username = {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] cinder_internal_tenant_project_id = 4afddf3d2b5740a1a757ca079835427b {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] cinder_internal_tenant_user_id = 5db57551a9c64cd0864f4f98caf06bbc {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] cloned_volume_same_az = True {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] cluster = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] compression_format = gzip {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] compute_api_class = cinder.compute.nova.API {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] config_dir = [] {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] config_source = [] {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] control_exchange = openstack {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] debug = True {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] default_availability_zone = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] default_group_type = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] default_volume_type = lvmdriver-1 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] disk_geometry = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] driver_client_cert = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] driver_client_cert_key = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] driver_data_namespace = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] driver_ssl_cert_path = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] driver_ssl_cert_verify = False {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] driver_use_ssl = False {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] enable_force_upload = False {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] enable_new_services = True {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] enable_unsupported_driver = False {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] enforce_multipath_for_image_xfer = False {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] filter_function = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] glance_api_insecure = False {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] glance_api_servers = ['http://192.168.122.248/image'] {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] glance_api_ssl_compression = False {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] glance_ca_certificates_file = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] glance_catalog_info = image:glance:publicURL {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] glance_certfile = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] glance_keyfile = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] glance_num_retries = 3 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] glance_request_timeout = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] goodness_function = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] graceful_shutdown_timeout = 5 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] group_api_class = cinder.group.api.API {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] host = devstack {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] image_compress_on_upload = True {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] image_conversion_address_space_limit = 1 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] image_conversion_cpu_limit = 60 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] image_conversion_disable = False {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] image_upload_use_cinder_backend = False {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75332]: INFO cinder.volume.manager [None req-1b13a341-a69e-4bad-9857-aecf60ef30fa None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] image_upload_use_internal_tenant = False {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-1b13a341-a69e-4bad-9857-aecf60ef30fa None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] image_volume_cache_enabled = False {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] image_volume_cache_max_count = 0 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] image_volume_cache_max_size_gb = 0 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] init_host_max_objects_retrieval = 0 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] instance_format = [instance: %(uuid)s] {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] iscsi_target_flags = {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] iscsi_write_cache = on {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] iser_helper = tgtadm {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] iser_ip_address = 192.168.122.248 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] iser_port = 3260 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] log_color = False {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] log_config_append = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] log_dir = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] log_file = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] log_options = True {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] log_rotate_interval = 1 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] log_rotate_interval_type = days {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] log_rotation_type = none {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] max_age = 0 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] max_logfile_count = 30 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] max_logfile_size_mb = 200 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] max_over_subscription_ratio = 20.0 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] message_reap_interval = 86400 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] message_ttl = 2592000 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] migration_create_volume_timeout_secs = 300 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] monkey_patch = False {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] monkey_patch_modules = [] {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] my_ip = 192.168.122.248 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-1b13a341-a69e-4bad-9857-aecf60ef30fa None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] no_snapshot_gb_quota = False {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] num_iser_scan_tries = 3 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-1b13a341-a69e-4bad-9857-aecf60ef30fa None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] num_shell_tries = 3 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] num_volume_device_scan_tries = 3 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] nvmeof_conn_info_version = 1 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] nvmet_ns_id = 10 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] nvmet_port_id = 1 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] osapi_max_limit = 1000 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] osapi_volume_ext_list = [] {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] osapi_volume_listen_port = 8776 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] osapi_volume_use_ssl = False {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] osapi_volume_workers = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] per_volume_size_limit = -1 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] periodic_fuzzy_delay = 60 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] periodic_interval = 60 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] public_endpoint = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] publish_errors = False {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] quota_backup_gigabytes = 1000 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] quota_backups = 10 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] quota_gigabytes = 1000 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] quota_groups = 10 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] quota_snapshots = 10 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-1b13a341-a69e-4bad-9857-aecf60ef30fa None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:12:22 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-1b13a341-a69e-4bad-9857-aecf60ef30fa None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] quota_volumes = 10 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] rate_limit_burst = 0 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] rate_limit_except_level = CRITICAL {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] rate_limit_interval = 0 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] reinit_driver_count = 3 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] replication_device = **** {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] report_discard_supported = False {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] report_interval = 120 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] reservation_clean_interval = 86400 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] reservation_expire = 86400 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] reserved_image_namespaces = [] {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] reserved_percentage = 0 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] rpc_response_timeout = 120 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] run_external_periodic_tasks = True {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] scst_target_driver = iscsi {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] scst_target_iqn_name = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] service_down_time = 720 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] shell_completion = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] snapshot_name_template = snapshot-%s {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] snapshot_same_host = True {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] split_loggers = False {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] state_path = /opt/stack/data/cinder {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] storage_availability_zone = nova {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] storage_protocol = iSCSI {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] syslog_log_facility = LOG_USER {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] target_helper = lioadm {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] target_ip_address = 192.168.122.248 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] target_port = 3260 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] target_protocol = iscsi {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] target_secondary_ip_addresses = [] {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] trace_flags = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] transport_url = **** {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] until_refresh = 0 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] use_chap_auth = False {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] use_default_quota_class = True {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] use_journal = False {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] use_json = False {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] use_multipath_for_image_xfer = False {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] use_stderr = False {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] use_syslog = False {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] verify_glance_signatures = enabled {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] volume_api_class = cinder.volume.api.API {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] volume_backend_name = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] volume_clear = zero {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] volume_clear_ionice = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-1b13a341-a69e-4bad-9857-aecf60ef30fa None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] volume_clear_size = 0 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-1b13a341-a69e-4bad-9857-aecf60ef30fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] volume_copy_bps_limit = 0 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] volume_dd_blocksize = 1M {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] volume_name_template = volume-%s {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] volume_service_inithost_offload = False {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] volume_usage_audit_period = month {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] zoning_mode = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] oslo_concurrency.disable_process_locking = False {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] keystone_authtoken.auth_section = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] keystone_authtoken.auth_type = password {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] keystone_authtoken.auth_version = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] keystone_authtoken.cache = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] keystone_authtoken.certfile = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] keystone_authtoken.include_service_catalog = True {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] keystone_authtoken.insecure = False {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] keystone_authtoken.interface = public {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] keystone_authtoken.keyfile = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] keystone_authtoken.memcache_password = **** {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] keystone_authtoken.memcache_username = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] keystone_authtoken.region_name = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack sudo[75336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] keystone_authtoken.service_type = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.248/identity {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] cache.backend = dogpile.cache.null {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack sudo[75336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] cache.backend_argument = **** {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] cache.backend_expiration_time = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] cache.config_prefix = cache.oslo {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] cache.debug_cache_backend = False {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] cache.enable_retry_client = False {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] cache.enable_socket_keepalive = False {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] cache.enabled = False {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] cache.expiration_time = 600 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] cache.hashclient_retry_attempts = 2 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] cache.memcache_dead_retry = 300 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] cache.memcache_pool_maxsize = 10 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] cache.memcache_sasl_enabled = False {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] cache.password = **** {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] cache.proxies = [] {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] cache.redis_db = 0 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] cache.redis_server = localhost:6379 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] cache.retry_attempts = 2 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] cache.retry_delay = 0.0 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] cache.socket_keepalive_count = 1 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] cache.socket_keepalive_idle = 1 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] cache.socket_keepalive_interval = 1 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] cache.socket_timeout = 1.0 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] cache.tls_allowed_ciphers = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] cache.tls_cafile = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] cache.tls_certfile = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] cache.tls_enabled = False {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] cache.tls_keyfile = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] cache.username = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] coordination.backend_url = **** {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] database.asyncio_connection = **** {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] database.asyncio_slave_connection = **** {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] database.backend = sqlalchemy {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] database.connection = **** {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] database.connection_debug = 0 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] database.connection_parameters = {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] database.connection_recycle_time = 3600 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] database.connection_trace = False {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] database.db_inc_retry_interval = True {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] database.db_max_retries = 20 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] database.db_max_retry_interval = 10 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] database.db_retry_interval = 1 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] database.max_overflow = 50 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] database.max_pool_size = 5 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] database.max_retries = 10 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] database.mysql_wsrep_sync_wait = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] database.pool_timeout = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] database.retry_interval = 10 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] database.slave_connection = **** {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] database.sqlite_synchronous = True {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] database.synchronous_reader = True {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] database.use_db_reconnect = False {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] oslo_messaging_tracing.insecure = False {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] profiler.connection_string = messaging:// {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] profiler.enabled = False {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] profiler.es_doc_type = notification {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] profiler.es_scroll_size = 10000 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] profiler.es_scroll_time = 2m {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] profiler.filter_error_trace = False {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] profiler.hmac_keys = **** {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] profiler.sentinel_service_name = mymaster {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] profiler.socket_timeout = 0.1 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] profiler.trace_requests = False {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] profiler.trace_sqlalchemy = False {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] profiler_jaeger.process_tags = {} {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] profiler_jaeger.service_name_prefix = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] profiler_otlp.service_name_prefix = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] oslo_policy.enforce_new_defaults = True {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] oslo_policy.policy_default_rule = default {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] oslo_policy.policy_file = policy.yaml {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] privsep_osbrick.group = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] privsep_osbrick.helper_command = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] privsep_osbrick.user = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] cinder_sys_admin.group = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] cinder_sys_admin.helper_command = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] cinder_sys_admin.user = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] service_user.auth_section = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] service_user.auth_type = password {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] service_user.cafile = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] service_user.certfile = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] service_user.collect_timing = False {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] service_user.insecure = False {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] service_user.keyfile = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] service_user.send_service_user_token = True {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] service_user.split_loggers = False {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] service_user.timeout = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] service_user.tls_ciphers = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] service_user.tls_min_version = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] glance.auth_section = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] glance.auth_type = password {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] glance.certfile = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] glance.collect_timing = False {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] glance.insecure = False {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] glance.keyfile = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] glance.region_name = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] glance.split_loggers = False {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] glance.timeout = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] glance.tls_ciphers = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] glance.tls_min_version = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] backend_defaults.backend_availability_zone = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] backend_defaults.chap_password = **** {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] backend_defaults.chap_username = {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] backend_defaults.disk_geometry = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] backend_defaults.driver_client_cert = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] backend_defaults.driver_client_cert_key = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] backend_defaults.driver_data_namespace = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] backend_defaults.driver_use_ssl = False {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] backend_defaults.extra_capabilities = {} {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] backend_defaults.filter_function = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] backend_defaults.goodness_function = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] backend_defaults.iscsi_target_flags = {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] backend_defaults.iscsi_write_cache = on {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] backend_defaults.iser_helper = tgtadm {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] backend_defaults.iser_ip_address = 192.168.122.248 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] backend_defaults.iser_port = 3260 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] backend_defaults.lvm_share_target = False {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] backend_defaults.lvm_type = auto {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] backend_defaults.num_shell_tries = 3 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] backend_defaults.replication_device = **** {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] backend_defaults.report_discard_supported = False {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] backend_defaults.reserved_percentage = 0 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] backend_defaults.target_helper = tgtadm {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] backend_defaults.target_ip_address = 192.168.122.248 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] backend_defaults.target_port = 3260 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] backend_defaults.target_protocol = iscsi {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] backend_defaults.trace_flags = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] backend_defaults.unique_fqdn_network = True {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] backend_defaults.use_chap_auth = False {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] backend_defaults.volume_backend_name = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] backend_defaults.volume_clear = zero {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] backend_defaults.volume_clear_ionice = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] backend_defaults.volume_clear_size = 0 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] oslo_reports.file_event_handler = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] oslo_reports.log_dir = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] lvmdriver-1.backend_host = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] lvmdriver-1.chap_password = **** {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] lvmdriver-1.chap_username = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] lvmdriver-1.disk_geometry = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] lvmdriver-1.driver_client_cert = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] lvmdriver-1.extra_capabilities = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] lvmdriver-1.filter_function = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] lvmdriver-1.goodness_function = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] lvmdriver-1.iser_helper = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] lvmdriver-1.iser_ip_address = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] lvmdriver-1.iser_port = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] lvmdriver-1.lvm_share_target = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] lvmdriver-1.lvm_type = auto {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] lvmdriver-1.num_shell_tries = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] lvmdriver-1.replication_device = **** {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] lvmdriver-1.report_discard_supported = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] lvmdriver-1.reserved_percentage = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] lvmdriver-1.scst_target_driver = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] lvmdriver-1.storage_protocol = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] lvmdriver-1.target_helper = lioadm {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] lvmdriver-1.target_ip_address = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] lvmdriver-1.target_port = 3260 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] lvmdriver-1.trace_flags = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] lvmdriver-1.use_chap_auth = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] lvmdriver-1.volume_clear = zero {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] lvmdriver-1.volume_clear_size = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] lvmdriver-1.volumes_dir = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] oslo_messaging_rabbit.ssl = False {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] oslo_messaging_notifications.driver = [] {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] oslo_messaging_notifications.retry = -1 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] key_manager.fixed_key = **** {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] barbican.barbican_api_version = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] barbican.barbican_endpoint = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] barbican.barbican_endpoint_type = public {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] barbican.barbican_region_name = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] barbican.cafile = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] barbican.certfile = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] barbican.collect_timing = False {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] barbican.insecure = False {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] barbican.keyfile = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] barbican.number_of_retries = 60 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] barbican.retry_delay = 1 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] barbican.send_service_user_token = False {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] barbican.split_loggers = False {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] barbican.timeout = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] barbican.tls_ciphers = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] barbican.tls_min_version = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] barbican.verify_ssl = True {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] barbican.verify_ssl_path = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] barbican_service_user.auth_section = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] barbican_service_user.auth_type = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] barbican_service_user.cafile = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] barbican_service_user.certfile = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] barbican_service_user.collect_timing = False {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] barbican_service_user.insecure = False {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] barbican_service_user.keyfile = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] barbican_service_user.split_loggers = False {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] barbican_service_user.timeout = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] barbican_service_user.tls_ciphers = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] barbican_service_user.tls_min_version = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] vault.approle_role_id = **** {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] vault.approle_secret_id = **** {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] vault.auth_method = approle {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] vault.auth_path = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] vault.kv_mountpoint = secret {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] vault.kv_path = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] vault.kv_version = 2 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] vault.namespace = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] vault.root_token_id = **** {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] vault.ssl_ca_crt_file = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] vault.timeout = 60.0 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] vault.token_file = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] vault.token_role = None {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] vault.use_ssl = False {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:12:22 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] ******************************************************************************** {{(pid=75171) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 16 20:12:23 devstack sudo[75336]: pam_unix(sudo:session): session closed for user root Sep 16 20:12:23 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-1b13a341-a69e-4bad-9857-aecf60ef30fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.313s {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:12:23 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-1b13a341-a69e-4bad-9857-aecf60ef30fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:12:23 devstack sudo[75491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 16 20:12:23 devstack sudo[75491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:12:23 devstack sudo[75491]: pam_unix(sudo:session): session closed for user root Sep 16 20:12:23 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-1b13a341-a69e-4bad-9857-aecf60ef30fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.256s {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:12:23 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-1b13a341-a69e-4bad-9857-aecf60ef30fa None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 16 20:12:23 devstack cinder-volume[75332]: INFO cinder.brick.local_dev.lvm [None req-1b13a341-a69e-4bad-9857-aecf60ef30fa None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 16 20:12:23 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-1b13a341-a69e-4bad-9857-aecf60ef30fa None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:12:23 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-1b13a341-a69e-4bad-9857-aecf60ef30fa None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:12:23 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-1b13a341-a69e-4bad-9857-aecf60ef30fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:12:23 devstack sudo[75577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 16 20:12:23 devstack sudo[75577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:12:23 devstack sudo[75577]: pam_unix(sudo:session): session closed for user root Sep 16 20:12:23 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-1b13a341-a69e-4bad-9857-aecf60ef30fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:12:23 devstack cinder-volume[75332]: DEBUG cinder.brick.local_dev.lvm [None req-1b13a341-a69e-4bad-9857-aecf60ef30fa None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75332) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 16 20:12:23 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-1b13a341-a69e-4bad-9857-aecf60ef30fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:12:23 devstack sudo[75665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 16 20:12:23 devstack sudo[75665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:12:24 devstack sudo[75665]: pam_unix(sudo:session): session closed for user root Sep 16 20:12:24 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-1b13a341-a69e-4bad-9857-aecf60ef30fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.531s {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:12:24 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-1b13a341-a69e-4bad-9857-aecf60ef30fa None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:12:24 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-1b13a341-a69e-4bad-9857-aecf60ef30fa None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:12:24 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-1b13a341-a69e-4bad-9857-aecf60ef30fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:12:24 devstack sudo[75851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 16 20:12:24 devstack sudo[75851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:12:24 devstack sudo[75851]: pam_unix(sudo:session): session closed for user root Sep 16 20:12:24 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-1b13a341-a69e-4bad-9857-aecf60ef30fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.353s {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:12:24 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-1b13a341-a69e-4bad-9857-aecf60ef30fa None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:12:24 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-1b13a341-a69e-4bad-9857-aecf60ef30fa None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:12:24 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-1b13a341-a69e-4bad-9857-aecf60ef30fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:12:24 devstack sudo[75940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 16 20:12:24 devstack sudo[75940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:12:24 devstack sudo[75940]: pam_unix(sudo:session): session closed for user root Sep 16 20:12:24 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-1b13a341-a69e-4bad-9857-aecf60ef30fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.252s {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:12:24 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-1b13a341-a69e-4bad-9857-aecf60ef30fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:12:24 devstack sudo[75944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 16 20:12:24 devstack sudo[75944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:12:25 devstack sudo[75944]: pam_unix(sudo:session): session closed for user root Sep 16 20:12:25 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-1b13a341-a69e-4bad-9857-aecf60ef30fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.319s {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:12:25 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-1b13a341-a69e-4bad-9857-aecf60ef30fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:12:25 devstack sudo[76026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 16 20:12:25 devstack sudo[76026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:12:25 devstack sudo[76026]: pam_unix(sudo:session): session closed for user root Sep 16 20:12:25 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-1b13a341-a69e-4bad-9857-aecf60ef30fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.245s {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:12:25 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-1b13a341-a69e-4bad-9857-aecf60ef30fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:12:25 devstack sudo[76029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 16 20:12:25 devstack sudo[76029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:12:25 devstack sudo[76029]: pam_unix(sudo:session): session closed for user root Sep 16 20:12:25 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-1b13a341-a69e-4bad-9857-aecf60ef30fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.319s {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:12:25 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-1b13a341-a69e-4bad-9857-aecf60ef30fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:12:25 devstack sudo[76117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 16 20:12:25 devstack sudo[76117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:12:26 devstack sudo[76117]: pam_unix(sudo:session): session closed for user root Sep 16 20:12:26 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-1b13a341-a69e-4bad-9857-aecf60ef30fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.318s {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:12:26 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-1b13a341-a69e-4bad-9857-aecf60ef30fa None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:12:26 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-1b13a341-a69e-4bad-9857-aecf60ef30fa None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:12:26 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-1b13a341-a69e-4bad-9857-aecf60ef30fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:12:26 devstack sudo[76122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 16 20:12:26 devstack sudo[76122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:12:26 devstack sudo[76122]: pam_unix(sudo:session): session closed for user root Sep 16 20:12:26 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-1b13a341-a69e-4bad-9857-aecf60ef30fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.257s {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:12:26 devstack cinder-volume[75332]: INFO cinder.volume.drivers.lvm [None req-1b13a341-a69e-4bad-9857-aecf60ef30fa None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 16 20:12:26 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-1b13a341-a69e-4bad-9857-aecf60ef30fa None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:12:26 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-1b13a341-a69e-4bad-9857-aecf60ef30fa None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:12:26 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-1b13a341-a69e-4bad-9857-aecf60ef30fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:12:26 devstack sudo[76126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 16 20:12:26 devstack sudo[76126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:12:26 devstack sudo[76126]: pam_unix(sudo:session): session closed for user root Sep 16 20:12:26 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-1b13a341-a69e-4bad-9857-aecf60ef30fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.277s {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:12:26 devstack cinder-volume[75332]: DEBUG cinder.volume.drivers.lvm [None req-1b13a341-a69e-4bad-9857-aecf60ef30fa None None] Updating volume stats {{(pid=75332) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 16 20:12:26 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-1b13a341-a69e-4bad-9857-aecf60ef30fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:12:26 devstack sudo[76129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 16 20:12:26 devstack sudo[76129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:12:26 devstack sudo[76129]: pam_unix(sudo:session): session closed for user root Sep 16 20:12:26 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-1b13a341-a69e-4bad-9857-aecf60ef30fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.246s {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:12:26 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-1b13a341-a69e-4bad-9857-aecf60ef30fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:12:26 devstack sudo[76138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 16 20:12:26 devstack sudo[76138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:12:27 devstack sudo[76138]: pam_unix(sudo:session): session closed for user root Sep 16 20:12:27 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-1b13a341-a69e-4bad-9857-aecf60ef30fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.279s {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:12:27 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-1b13a341-a69e-4bad-9857-aecf60ef30fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:12:27 devstack sudo[76141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 16 20:12:27 devstack sudo[76141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:12:27 devstack sudo[76141]: pam_unix(sudo:session): session closed for user root Sep 16 20:12:27 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-1b13a341-a69e-4bad-9857-aecf60ef30fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.278s {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:12:27 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-1b13a341-a69e-4bad-9857-aecf60ef30fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:12:27 devstack sudo[76145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 16 20:12:27 devstack sudo[76145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:12:27 devstack sudo[76145]: pam_unix(sudo:session): session closed for user root Sep 16 20:12:27 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-1b13a341-a69e-4bad-9857-aecf60ef30fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:12:27 devstack cinder-volume[75332]: INFO cinder.volume.driver [None req-1b13a341-a69e-4bad-9857-aecf60ef30fa None None] Driver hasn't implemented _init_vendor_properties() Sep 16 20:12:27 devstack cinder-volume[75332]: DEBUG cinder.volume.driver [None req-1b13a341-a69e-4bad-9857-aecf60ef30fa None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75332) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 16 20:12:27 devstack cinder-volume[75332]: DEBUG oslo_db.sqlalchemy.engines [None req-1b13a341-a69e-4bad-9857-aecf60ef30fa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75332) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 16 20:12:27 devstack cinder-volume[75332]: DEBUG dbcounter [-] [75332] Writer thread running {{(pid=75332) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 16 20:12:27 devstack cinder-volume[75332]: DEBUG cinder.db.api [None req-1b13a341-a69e-4bad-9857-aecf60ef30fa None None] Building query based on filter {{(pid=75332) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 16 20:12:27 devstack cinder-volume[75332]: DEBUG cinder.image.image_utils [None req-1b13a341-a69e-4bad-9857-aecf60ef30fa None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75332) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 16 20:12:27 devstack cinder-volume[75332]: INFO cinder.keymgr.migration [None req-80a3373d-6bb4-4b68-bfda-c33c8dad0d1d None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 16 20:12:27 devstack cinder-volume[75332]: DEBUG cinder.volume.drivers.lvm [None req-1b13a341-a69e-4bad-9857-aecf60ef30fa None None] Updating volume stats {{(pid=75332) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 16 20:12:27 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-1b13a341-a69e-4bad-9857-aecf60ef30fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:12:27 devstack sudo[76149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 16 20:12:27 devstack sudo[76149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:12:28 devstack sudo[76149]: pam_unix(sudo:session): session closed for user root Sep 16 20:12:28 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-1b13a341-a69e-4bad-9857-aecf60ef30fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:12:28 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-1b13a341-a69e-4bad-9857-aecf60ef30fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:12:28 devstack sudo[76153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 16 20:12:28 devstack sudo[76153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:12:28 devstack sudo[76153]: pam_unix(sudo:session): session closed for user root Sep 16 20:12:28 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-1b13a341-a69e-4bad-9857-aecf60ef30fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.245s {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:12:28 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-1b13a341-a69e-4bad-9857-aecf60ef30fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:12:28 devstack sudo[76157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 16 20:12:28 devstack sudo[76157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:12:28 devstack sudo[76157]: pam_unix(sudo:session): session closed for user root Sep 16 20:12:28 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-1b13a341-a69e-4bad-9857-aecf60ef30fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.243s {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:12:28 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-1b13a341-a69e-4bad-9857-aecf60ef30fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:12:28 devstack sudo[76160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 16 20:12:28 devstack sudo[76160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:12:28 devstack sudo[76160]: pam_unix(sudo:session): session closed for user root Sep 16 20:12:28 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-1b13a341-a69e-4bad-9857-aecf60ef30fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.248s {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:12:28 devstack cinder-volume[75332]: DEBUG cinder.manager [None req-1b13a341-a69e-4bad-9857-aecf60ef30fa None None] Notifying Schedulers of capabilities ... {{(pid=75332) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:12:28 devstack cinder-volume[75332]: INFO cinder.volume.manager [None req-1b13a341-a69e-4bad-9857-aecf60ef30fa None None] Driver initialization completed successfully. Sep 16 20:12:28 devstack cinder-volume[75332]: INFO cinder.manager [None req-1b13a341-a69e-4bad-9857-aecf60ef30fa None None] Initiating service 2 cleanup Sep 16 20:12:28 devstack cinder-volume[75332]: INFO cinder.manager [None req-1b13a341-a69e-4bad-9857-aecf60ef30fa None None] Service 2 cleanup completed. Sep 16 20:12:28 devstack cinder-volume[75332]: DEBUG cinder.service [None req-1b13a341-a69e-4bad-9857-aecf60ef30fa None None] Creating RPC server for service cinder-volume {{(pid=75332) start /opt/stack/cinder/cinder/service.py:231}} Sep 16 20:12:28 devstack cinder-volume[75332]: DEBUG cinder.service [None req-1b13a341-a69e-4bad-9857-aecf60ef30fa None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75332) start /opt/stack/cinder/cinder/service.py:237}} Sep 16 20:12:28 devstack cinder-volume[75332]: INFO cinder.volume.manager [None req-1b13a341-a69e-4bad-9857-aecf60ef30fa None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 16 20:12:28 devstack cinder-volume[75332]: DEBUG cinder.volume.drivers.lvm [None req-1b13a341-a69e-4bad-9857-aecf60ef30fa None None] Updating volume stats {{(pid=75332) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 16 20:12:28 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-1b13a341-a69e-4bad-9857-aecf60ef30fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:12:28 devstack sudo[76164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 16 20:12:28 devstack sudo[76164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:12:29 devstack sudo[76164]: pam_unix(sudo:session): session closed for user root Sep 16 20:12:29 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-1b13a341-a69e-4bad-9857-aecf60ef30fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.295s {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:12:29 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-1b13a341-a69e-4bad-9857-aecf60ef30fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:12:29 devstack sudo[76169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 16 20:12:29 devstack sudo[76169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:12:29 devstack sudo[76169]: pam_unix(sudo:session): session closed for user root Sep 16 20:12:29 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-1b13a341-a69e-4bad-9857-aecf60ef30fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:12:29 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-1b13a341-a69e-4bad-9857-aecf60ef30fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:12:29 devstack sudo[76172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 16 20:12:29 devstack sudo[76172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:12:29 devstack sudo[76172]: pam_unix(sudo:session): session closed for user root Sep 16 20:12:29 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-1b13a341-a69e-4bad-9857-aecf60ef30fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.275s {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:12:29 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-1b13a341-a69e-4bad-9857-aecf60ef30fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:12:29 devstack sudo[76175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 16 20:12:29 devstack sudo[76175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:12:30 devstack sudo[76175]: pam_unix(sudo:session): session closed for user root Sep 16 20:12:30 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-1b13a341-a69e-4bad-9857-aecf60ef30fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.248s {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:12:30 devstack cinder-volume[75332]: INFO cinder.volume.manager [None req-1b13a341-a69e-4bad-9857-aecf60ef30fa None None] Driver post RPC initialization completed successfully. Sep 16 20:12:32 devstack cinder-volume[75171]: DEBUG dbcounter [-] [75171] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75171) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 20:12:38 devstack cinder-volume[75332]: DEBUG dbcounter [-] [75332] Writing DB stats cinder:SELECT=2 {{(pid=75332) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 20:12:40 devstack cinder-volume[75332]: DEBUG dbcounter [-] [75332] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=75332) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 20:13:20 devstack cinder-volume[75332]: DEBUG oslo_service.periodic_task [None req-ed4a58f7-efa9-4f00-9718-0cbf683dcfda None None] Running periodic task VolumeManager._thread_info {{(pid=75332) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 20:13:20 devstack cinder-volume[75332]: DEBUG cinder.volume.manager [None req-ed4a58f7-efa9-4f00-9718-0cbf683dcfda None None] thread count: 6 {{(pid=75332) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 16 20:13:20 devstack cinder-volume[75332]: DEBUG cinder.volume.manager [None req-ed4a58f7-efa9-4f00-9718-0cbf683dcfda None None] thread info: [<_MainThread(MainThread, started 139998161444992)>, , , , , ] {{(pid=75332) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 16 20:14:20 devstack cinder-volume[75332]: DEBUG oslo_service.periodic_task [None req-ed4a58f7-efa9-4f00-9718-0cbf683dcfda None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75332) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 20:14:20 devstack cinder-volume[75332]: DEBUG cinder.volume.drivers.lvm [None req-ed4a58f7-efa9-4f00-9718-0cbf683dcfda None None] Updating volume stats {{(pid=75332) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 16 20:14:20 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-ed4a58f7-efa9-4f00-9718-0cbf683dcfda None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:14:20 devstack sudo[81407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 16 20:14:20 devstack sudo[81407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:14:20 devstack sudo[81407]: pam_unix(sudo:session): session closed for user root Sep 16 20:14:20 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-ed4a58f7-efa9-4f00-9718-0cbf683dcfda None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:14:20 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-ed4a58f7-efa9-4f00-9718-0cbf683dcfda None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:14:20 devstack sudo[81410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 16 20:14:20 devstack sudo[81410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:14:20 devstack sudo[81410]: pam_unix(sudo:session): session closed for user root Sep 16 20:14:20 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-ed4a58f7-efa9-4f00-9718-0cbf683dcfda None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:14:20 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-ed4a58f7-efa9-4f00-9718-0cbf683dcfda None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:14:20 devstack sudo[81413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 16 20:14:20 devstack sudo[81413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:14:20 devstack sudo[81413]: pam_unix(sudo:session): session closed for user root Sep 16 20:14:20 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-ed4a58f7-efa9-4f00-9718-0cbf683dcfda None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.269s {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:14:20 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-ed4a58f7-efa9-4f00-9718-0cbf683dcfda None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:14:20 devstack sudo[81416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 16 20:14:20 devstack sudo[81416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:14:21 devstack sudo[81416]: pam_unix(sudo:session): session closed for user root Sep 16 20:14:21 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-ed4a58f7-efa9-4f00-9718-0cbf683dcfda None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:14:21 devstack cinder-volume[75332]: DEBUG cinder.manager [None req-ed4a58f7-efa9-4f00-9718-0cbf683dcfda None None] Notifying Schedulers of capabilities ... {{(pid=75332) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:14:21 devstack cinder-volume[75332]: DEBUG oslo_service.periodic_task [None req-ed4a58f7-efa9-4f00-9718-0cbf683dcfda None None] Running periodic task VolumeManager._thread_info {{(pid=75332) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 20:14:21 devstack cinder-volume[75332]: DEBUG cinder.volume.manager [None req-ed4a58f7-efa9-4f00-9718-0cbf683dcfda None None] thread count: 6 {{(pid=75332) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 16 20:14:21 devstack cinder-volume[75332]: DEBUG cinder.volume.manager [None req-ed4a58f7-efa9-4f00-9718-0cbf683dcfda None None] thread info: [<_MainThread(MainThread, started 139998161444992)>, , , , , ] {{(pid=75332) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 16 20:14:40 devstack cinder-volume[75332]: DEBUG dbcounter [-] [75332] Writing DB stats cinder:SELECT=1 {{(pid=75332) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 20:14:40 devstack cinder-volume[75332]: DEBUG dbcounter [-] [75332] Writing DB stats cinder:UPDATE=1 {{(pid=75332) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 20:15:20 devstack cinder-volume[75332]: DEBUG oslo_service.periodic_task [None req-ed4a58f7-efa9-4f00-9718-0cbf683dcfda None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75332) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 20:15:20 devstack cinder-volume[75332]: DEBUG cinder.volume.drivers.lvm [None req-ed4a58f7-efa9-4f00-9718-0cbf683dcfda None None] Updating volume stats {{(pid=75332) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 16 20:15:20 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-ed4a58f7-efa9-4f00-9718-0cbf683dcfda None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:15:20 devstack sudo[83212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 16 20:15:20 devstack sudo[83212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:15:20 devstack sudo[83212]: pam_unix(sudo:session): session closed for user root Sep 16 20:15:20 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-ed4a58f7-efa9-4f00-9718-0cbf683dcfda None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.274s {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:15:20 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-ed4a58f7-efa9-4f00-9718-0cbf683dcfda None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:15:20 devstack sudo[83231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 16 20:15:20 devstack sudo[83231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:15:20 devstack sudo[83231]: pam_unix(sudo:session): session closed for user root Sep 16 20:15:20 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-ed4a58f7-efa9-4f00-9718-0cbf683dcfda None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:15:20 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-ed4a58f7-efa9-4f00-9718-0cbf683dcfda None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:15:20 devstack sudo[83239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 16 20:15:20 devstack sudo[83239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:15:20 devstack sudo[83239]: pam_unix(sudo:session): session closed for user root Sep 16 20:15:20 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-ed4a58f7-efa9-4f00-9718-0cbf683dcfda None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.281s {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:15:20 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-ed4a58f7-efa9-4f00-9718-0cbf683dcfda None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:15:20 devstack sudo[83248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 16 20:15:20 devstack sudo[83248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:15:21 devstack sudo[83248]: pam_unix(sudo:session): session closed for user root Sep 16 20:15:21 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-ed4a58f7-efa9-4f00-9718-0cbf683dcfda None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:15:21 devstack cinder-volume[75332]: DEBUG cinder.manager [None req-ed4a58f7-efa9-4f00-9718-0cbf683dcfda None None] Notifying Schedulers of capabilities ... {{(pid=75332) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:16:20 devstack cinder-volume[75332]: DEBUG oslo_service.periodic_task [None req-ed4a58f7-efa9-4f00-9718-0cbf683dcfda None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75332) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 20:16:20 devstack cinder-volume[75332]: DEBUG cinder.volume.drivers.lvm [None req-ed4a58f7-efa9-4f00-9718-0cbf683dcfda None None] Updating volume stats {{(pid=75332) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 16 20:16:20 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-ed4a58f7-efa9-4f00-9718-0cbf683dcfda None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:16:20 devstack sudo[84620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 16 20:16:20 devstack sudo[84620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:16:20 devstack sudo[84620]: pam_unix(sudo:session): session closed for user root Sep 16 20:16:20 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-ed4a58f7-efa9-4f00-9718-0cbf683dcfda None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.245s {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:16:20 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-ed4a58f7-efa9-4f00-9718-0cbf683dcfda None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:16:20 devstack sudo[84626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 16 20:16:20 devstack sudo[84626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:16:20 devstack sudo[84626]: pam_unix(sudo:session): session closed for user root Sep 16 20:16:20 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-ed4a58f7-efa9-4f00-9718-0cbf683dcfda None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:16:20 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-ed4a58f7-efa9-4f00-9718-0cbf683dcfda None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:16:20 devstack sudo[84647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 16 20:16:20 devstack sudo[84647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:16:20 devstack sudo[84647]: pam_unix(sudo:session): session closed for user root Sep 16 20:16:20 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-ed4a58f7-efa9-4f00-9718-0cbf683dcfda None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.245s {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:16:20 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-ed4a58f7-efa9-4f00-9718-0cbf683dcfda None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:16:20 devstack sudo[84652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 16 20:16:20 devstack sudo[84652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:16:21 devstack sudo[84652]: pam_unix(sudo:session): session closed for user root Sep 16 20:16:21 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-ed4a58f7-efa9-4f00-9718-0cbf683dcfda None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:16:21 devstack cinder-volume[75332]: DEBUG cinder.manager [None req-ed4a58f7-efa9-4f00-9718-0cbf683dcfda None None] Notifying Schedulers of capabilities ... {{(pid=75332) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:16:21 devstack cinder-volume[75332]: DEBUG oslo_service.periodic_task [None req-ed4a58f7-efa9-4f00-9718-0cbf683dcfda None None] Running periodic task VolumeManager._thread_info {{(pid=75332) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 20:16:21 devstack cinder-volume[75332]: DEBUG cinder.volume.manager [None req-ed4a58f7-efa9-4f00-9718-0cbf683dcfda None None] thread count: 6 {{(pid=75332) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 16 20:16:21 devstack cinder-volume[75332]: DEBUG cinder.volume.manager [None req-ed4a58f7-efa9-4f00-9718-0cbf683dcfda None None] thread info: [<_MainThread(MainThread, started 139998161444992)>, , , , , ] {{(pid=75332) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 16 20:16:40 devstack cinder-volume[75332]: DEBUG dbcounter [-] [75332] Writing DB stats cinder:SELECT=1 {{(pid=75332) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 20:16:40 devstack cinder-volume[75332]: DEBUG dbcounter [-] [75332] Writing DB stats cinder:UPDATE=1 {{(pid=75332) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 20:16:48 devstack cinder-volume[75171]: INFO oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] Caught SIGTERM, stopping children Sep 16 20:16:48 devstack cinder-volume[75171]: DEBUG oslo_concurrency.lockutils [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] Acquiring lock "singleton_lock" {{(pid=75171) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 16 20:16:48 devstack cinder-volume[75171]: DEBUG oslo_concurrency.lockutils [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] Acquired lock "singleton_lock" {{(pid=75171) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 16 20:16:48 devstack cinder-volume[75171]: DEBUG oslo_concurrency.lockutils [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] Releasing lock "singleton_lock" {{(pid=75171) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 16 20:16:48 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] Stop services. {{(pid=75171) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 16 20:16:48 devstack cinder-volume[75171]: DEBUG oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] Killing children. {{(pid=75171) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 16 20:16:48 devstack cinder-volume[75171]: INFO oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] Waiting on 1 children to exit Sep 16 20:16:48 devstack cinder-volume[75332]: DEBUG oslo_concurrency.lockutils [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] Acquiring lock "singleton_lock" {{(pid=75332) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 16 20:16:48 devstack cinder-volume[75332]: DEBUG oslo_concurrency.lockutils [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] Acquired lock "singleton_lock" {{(pid=75332) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 16 20:16:48 devstack cinder-volume[75332]: DEBUG oslo_concurrency.lockutils [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] Releasing lock "singleton_lock" {{(pid=75332) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 16 20:16:48 devstack cinder-volume[75332]: WARNING amqp [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 16 20:16:48 devstack cinder-volume[75332]: WARNING amqp [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 16 20:16:48 devstack cinder-volume[75171]: INFO oslo_service.backend._eventlet.service [None req-b8497fa4-6903-41dc-985b-88131a29c524 None None] Child 75332 exited with status 0 Sep 16 20:16:49 devstack cinder-volume[85347]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 16 20:16:49 devstack cinder-volume[85347]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 16 20:16:49 devstack cinder-volume[85347]: we strongly recommend against using it for new projects. Sep 16 20:16:49 devstack cinder-volume[85347]: If you are already using Eventlet, we recommend migrating to a different Sep 16 20:16:49 devstack cinder-volume[85347]: framework. For more detail see Sep 16 20:16:49 devstack cinder-volume[85347]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 16 20:16:49 devstack cinder-volume[85347]: import eventlet # noqa Sep 16 20:16:51 devstack cinder-volume[85347]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85347) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 16 20:16:51 devstack cinder-volume[85347]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85347) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 16 20:16:51 devstack cinder-volume[85347]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85347) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 16 20:16:51 devstack cinder-volume[85347]: INFO dbcounter [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] Registered counter for database cinder Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_db.sqlalchemy.engines [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85347) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG dbcounter [-] [85347] Writer thread running {{(pid=85347) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 16 20:16:52 devstack cinder-volume[85347]: INFO cinder.rpc [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 16 20:16:52 devstack cinder-volume[85347]: INFO cinder.rpc [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_db.sqlalchemy.engines [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85347) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 16 20:16:52 devstack cinder-volume[85347]: INFO cinder.volume.manager [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] Determined volume DB was empty at startup. Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG cinder.volume.manager [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85347) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 16 20:16:52 devstack cinder-volume[85347]: INFO cinder.volume.manager [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 16 20:16:52 devstack cinder-volume[85347]: WARNING stevedore.named [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 16 20:16:52 devstack cinder-volume[85347]: WARNING castellan.key_manager [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 16 20:16:52 devstack cinder-volume[85347]: WARNING cinder.keymgr.conf_key_mgr [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 16 20:16:52 devstack cinder-volume[85347]: INFO cinder.volume.manager [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_db.sqlalchemy.engines [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85347) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 16 20:16:52 devstack cinder-volume[85347]: INFO oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] Starting 1 workers Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] Started child 85561 {{(pid=85347) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] Full set of CONF: {{(pid=85347) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] ******************************************************************************** {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] Configuration options gathered from: {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] ================================================================================ {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] allow_availability_zone_fallback = False {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] allow_compression_on_image_upload = False {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] allowed_direct_url_schemes = [] {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] api_rate_limit = True {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] auth_strategy = keystone {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] backend_availability_zone = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] backend_host = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85561]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] backend_name = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] backend_stats_polling_interval = 60 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] backup_api_class = cinder.backup.api.API {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] backup_name_template = backup-%s {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] backup_use_same_host = False {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] backup_use_temp_snapshot = False {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] chap_password = **** {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] chap_username = {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] cinder_internal_tenant_project_id = 4afddf3d2b5740a1a757ca079835427b {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] cinder_internal_tenant_user_id = 5db57551a9c64cd0864f4f98caf06bbc {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] cluster = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] compression_format = gzip {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] compute_api_class = cinder.compute.nova.API {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] config_dir = [] {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] config_source = [] {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] control_exchange = openstack {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] debug = True {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] default_availability_zone = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] default_group_type = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] default_volume_type = QuobyteHD {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] disk_geometry = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] driver_client_cert = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] driver_client_cert_key = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] driver_data_namespace = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] driver_ssl_cert_path = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] driver_ssl_cert_verify = False {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] driver_use_ssl = False {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] enable_new_services = True {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] enable_unsupported_driver = False {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] enabled_backends = ['QuobyteHD'] {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] enforce_multipath_for_image_xfer = False {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] filter_function = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] glance_api_insecure = False {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] glance_api_servers = ['http://192.168.122.248/image'] {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] glance_api_ssl_compression = False {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] glance_ca_certificates_file = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] glance_catalog_info = image:glance:publicURL {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] glance_certfile = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] glance_keyfile = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] glance_num_retries = 3 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] glance_request_timeout = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] goodness_function = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] graceful_shutdown_timeout = 5 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] group_api_class = cinder.group.api.API {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] host = devstack {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85561]: INFO cinder.volume.manager [None req-bdf46a05-d79e-4103-8731-725153f2d6c4 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] image_compress_on_upload = True {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85561]: DEBUG cinder.volume.drivers.remotefs [None req-bdf46a05-d79e-4103-8731-725153f2d6c4 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=85561) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] image_conversion_address_space_limit = 1 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] image_conversion_cpu_limit = 60 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] image_conversion_disable = False {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] image_upload_use_cinder_backend = False {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] image_upload_use_internal_tenant = False {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] image_volume_cache_enabled = False {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] image_volume_cache_max_count = 0 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] image_volume_cache_max_size_gb = 0 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] init_host_max_objects_retrieval = 0 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] instance_format = [instance: %(uuid)s] {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] iscsi_target_flags = {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] iscsi_write_cache = on {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] iser_helper = tgtadm {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] iser_ip_address = 192.168.122.248 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] iser_port = 3260 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] log_color = False {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] log_config_append = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] log_dir = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] log_file = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] log_options = True {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] log_rotate_interval = 1 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] log_rotate_interval_type = days {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] log_rotation_type = none {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] max_age = 0 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] max_logfile_count = 30 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] max_logfile_size_mb = 200 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] max_over_subscription_ratio = 20.0 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] message_reap_interval = 86400 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] message_ttl = 2592000 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] migration_create_volume_timeout_secs = 300 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] monkey_patch = False {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] monkey_patch_modules = [] {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] my_ip = 192.168.122.248 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] no_snapshot_gb_quota = False {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] num_iser_scan_tries = 3 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] num_shell_tries = 3 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] num_volume_device_scan_tries = 3 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] nvmeof_conn_info_version = 1 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] nvmet_ns_id = 10 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] nvmet_port_id = 1 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] osapi_max_limit = 1000 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] osapi_volume_ext_list = [] {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] osapi_volume_listen = 0.0.0.0 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] osapi_volume_listen_port = 8776 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] osapi_volume_use_ssl = False {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] osapi_volume_workers = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] per_volume_size_limit = -1 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] periodic_fuzzy_delay = 60 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] periodic_interval = 60 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] project_id_regex = [0-9a-f\-]+ {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] public_endpoint = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] publish_errors = False {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] quota_backup_gigabytes = 1000 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] quota_backups = 10 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] quota_gigabytes = 1000 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] quota_groups = 10 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] quota_snapshots = 10 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] quota_volumes = 10 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] rate_limit_burst = 0 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] rate_limit_except_level = CRITICAL {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] rate_limit_interval = 0 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] reinit_driver_count = 3 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] replication_device = **** {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] report_discard_supported = False {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] report_interval = 120 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] reservation_clean_interval = 86400 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] reservation_expire = 86400 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] reserved_image_namespaces = [] {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] reserved_percentage = 0 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] rpc_response_timeout = 120 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] run_external_periodic_tasks = True {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] scst_target_driver = iscsi {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85561]: DEBUG cinder.volume.drivers.quobyte [None req-bdf46a05-d79e-4103-8731-725153f2d6c4 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=85561) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 16 20:16:52 devstack cinder-volume[85561]: WARNING cinder.volume.drivers.quobyte [None req-bdf46a05-d79e-4103-8731-725153f2d6c4 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 16 20:16:52 devstack cinder-volume[85561]: WARNING cinder.volume.drivers.quobyte [None req-bdf46a05-d79e-4103-8731-725153f2d6c4 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 16 20:16:52 devstack cinder-volume[85561]: DEBUG oslo_concurrency.processutils [None req-bdf46a05-d79e-4103-8731-725153f2d6c4 None None] Running cmd (subprocess): mount.quobyte {{(pid=85561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] scst_target_iqn_name = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] service_down_time = 720 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] shell_completion = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] snapshot_name_template = snapshot-%s {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] split_loggers = False {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] state_path = /opt/stack/data/cinder {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] storage_availability_zone = nova {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] storage_protocol = iSCSI {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] syslog_log_facility = LOG_USER {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] target_helper = lioadm {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] target_ip_address = 192.168.122.248 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] target_port = 3260 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] target_protocol = iscsi {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] target_secondary_ip_addresses = [] {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] trace_flags = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] transfer_api_class = cinder.transfer.api.API {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] transport_url = **** {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] until_refresh = 0 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] use_chap_auth = False {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] use_default_quota_class = True {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] use_journal = False {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] use_json = False {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] use_multipath_for_image_xfer = False {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] use_stderr = False {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] use_syslog = False {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] verify_glance_signatures = enabled {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] volume_api_class = cinder.volume.api.API {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] volume_backend_name = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] volume_clear = zero {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] volume_clear_ionice = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] volume_clear_size = 0 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] volume_copy_bps_limit = 0 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] volume_dd_blocksize = 1M {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] volume_name_template = volume-%s {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] volume_service_inithost_offload = False {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] volume_usage_audit_period = month {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] zoning_mode = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] oslo_concurrency.disable_process_locking = False {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] keystone_authtoken.auth_section = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] keystone_authtoken.auth_type = password {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] keystone_authtoken.auth_version = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] keystone_authtoken.cache = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] keystone_authtoken.certfile = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] keystone_authtoken.delay_auth_decision = False {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] keystone_authtoken.http_connect_timeout = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] keystone_authtoken.include_service_catalog = True {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] keystone_authtoken.insecure = False {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] keystone_authtoken.interface = public {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] keystone_authtoken.keyfile = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] keystone_authtoken.memcache_password = **** {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] keystone_authtoken.memcache_username = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] keystone_authtoken.region_name = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] keystone_authtoken.service_token_roles_required = True {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] keystone_authtoken.service_type = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] keystone_authtoken.token_cache_time = 300 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.248/identity {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] cache.backend = dogpile.cache.null {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] cache.backend_argument = **** {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] cache.backend_expiration_time = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] cache.config_prefix = cache.oslo {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] cache.debug_cache_backend = False {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] cache.enable_retry_client = False {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] cache.enable_socket_keepalive = False {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] cache.enabled = False {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] cache.expiration_time = 600 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] cache.hashclient_retry_attempts = 2 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] cache.memcache_dead_retry = 300 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] cache.memcache_pool_maxsize = 10 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] cache.memcache_sasl_enabled = False {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] cache.password = **** {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] cache.proxies = [] {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] cache.redis_db = 0 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] cache.redis_sentinel_service_name = mymaster {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] cache.redis_server = localhost:6379 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] cache.retry_attempts = 2 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] cache.retry_delay = 0.0 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] cache.socket_keepalive_count = 1 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] cache.socket_keepalive_idle = 1 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] cache.socket_keepalive_interval = 1 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] cache.socket_timeout = 1.0 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] cache.tls_allowed_ciphers = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] cache.tls_cafile = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] cache.tls_certfile = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] cache.tls_enabled = False {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] cache.tls_keyfile = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] cache.username = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] coordination.backend_url = **** {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] database.asyncio_connection = **** {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] database.asyncio_slave_connection = **** {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] database.backend = sqlalchemy {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] database.connection = **** {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] database.connection_debug = 0 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] database.connection_parameters = {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] database.connection_recycle_time = 3600 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] database.connection_trace = False {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] database.db_inc_retry_interval = True {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] database.db_max_retries = 20 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] database.db_max_retry_interval = 10 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] database.db_retry_interval = 1 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] database.max_overflow = 50 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] database.max_pool_size = 5 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] database.max_retries = 10 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] database.mysql_wsrep_sync_wait = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] database.pool_timeout = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] database.retry_interval = 10 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] database.slave_connection = **** {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] database.sqlite_synchronous = True {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] database.synchronous_reader = True {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] database.use_db_reconnect = False {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] oslo_messaging_tracing.insecure = False {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] profiler.connection_string = messaging:// {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] profiler.enabled = False {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] profiler.es_doc_type = notification {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] profiler.es_scroll_size = 10000 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] profiler.es_scroll_time = 2m {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] profiler.filter_error_trace = False {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] profiler.hmac_keys = **** {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] profiler.sentinel_service_name = mymaster {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] profiler.socket_timeout = 0.1 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] profiler.trace_requests = False {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] profiler.trace_sqlalchemy = False {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] profiler_jaeger.process_tags = {} {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] profiler_jaeger.service_name_prefix = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85561]: DEBUG oslo_concurrency.processutils [None req-bdf46a05-d79e-4103-8731-725153f2d6c4 None None] CMD "mount.quobyte" returned: 1 in 0.079s {{(pid=85561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] profiler_otlp.service_name_prefix = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] oslo_policy.enforce_new_defaults = True {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] oslo_policy.policy_default_rule = default {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85561]: DEBUG oslo_concurrency.lockutils [None req-bdf46a05-d79e-4103-8731-725153f2d6c4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:16:52 devstack sudo[85563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 -c /etc/quobyte/client-cinder.cfg Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack sudo[85563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:16:52 devstack cinder-volume[85561]: DEBUG oslo_concurrency.lockutils [None req-bdf46a05-d79e-4103-8731-725153f2d6c4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] oslo_policy.policy_file = policy.yaml {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85561]: DEBUG cinder.volume.drivers.quobyte [None req-bdf46a05-d79e-4103-8731-725153f2d6c4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=85561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85561]: INFO cinder.volume.drivers.quobyte [None req-bdf46a05-d79e-4103-8731-725153f2d6c4 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 ... Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] oslo_policy.remote_timeout = 60.0 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85561]: DEBUG oslo_concurrency.processutils [None req-bdf46a05-d79e-4103-8731-725153f2d6c4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 -c /etc/quobyte/client-cinder.cfg {{(pid=85561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] privsep_osbrick.group = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] privsep_osbrick.helper_command = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] privsep_osbrick.user = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] cinder_sys_admin.group = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] cinder_sys_admin.helper_command = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] cinder_sys_admin.user = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] service_user.auth_section = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] service_user.auth_type = password {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] service_user.cafile = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] service_user.certfile = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] service_user.collect_timing = False {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] service_user.insecure = False {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] service_user.keyfile = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] service_user.send_service_user_token = True {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] service_user.split_loggers = False {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] service_user.timeout = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] service_user.tls_ciphers = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] service_user.tls_min_version = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] glance.auth_section = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] glance.auth_type = password {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] glance.certfile = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] glance.collect_timing = False {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] glance.insecure = False {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] glance.keyfile = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] glance.region_name = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] glance.split_loggers = False {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] glance.timeout = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] glance.tls_ciphers = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] glance.tls_min_version = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] backend_defaults.backend_availability_zone = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] backend_defaults.chap_password = **** {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] backend_defaults.chap_username = {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] backend_defaults.disk_geometry = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] backend_defaults.driver_client_cert = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] backend_defaults.driver_client_cert_key = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] backend_defaults.driver_data_namespace = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] backend_defaults.driver_use_ssl = False {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] backend_defaults.enable_unsupported_driver = False {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] backend_defaults.extra_capabilities = {} {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] backend_defaults.filter_function = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] backend_defaults.goodness_function = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] backend_defaults.iscsi_target_flags = {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] backend_defaults.iscsi_write_cache = on {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] backend_defaults.iser_helper = tgtadm {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] backend_defaults.iser_ip_address = 192.168.122.248 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] backend_defaults.iser_port = 3260 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] backend_defaults.nas_host = {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] backend_defaults.nas_login = admin {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] backend_defaults.nas_mount_options = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] backend_defaults.nas_password = **** {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] backend_defaults.nas_private_key = {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] backend_defaults.nas_share_path = {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:52 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] backend_defaults.nas_ssh_port = 22 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] backend_defaults.num_shell_tries = 3 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] backend_defaults.nvmet_port_id = 1 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] backend_defaults.quobyte_client_cfg = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] backend_defaults.quobyte_volume_url = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] backend_defaults.replication_device = **** {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] backend_defaults.report_discard_supported = False {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] backend_defaults.reserved_percentage = 0 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] backend_defaults.scst_target_driver = iscsi {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] backend_defaults.scst_target_iqn_name = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] backend_defaults.storage_protocol = iSCSI {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] backend_defaults.target_helper = tgtadm {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] backend_defaults.target_ip_address = 192.168.122.248 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] backend_defaults.target_port = 3260 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] backend_defaults.target_protocol = iscsi {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] backend_defaults.trace_flags = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] backend_defaults.unique_fqdn_network = True {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] backend_defaults.use_chap_auth = False {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] backend_defaults.volume_backend_name = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] backend_defaults.volume_clear = zero {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] backend_defaults.volume_clear_ionice = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] backend_defaults.volume_clear_size = 0 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] oslo_reports.file_event_handler = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] oslo_reports.log_dir = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] QuobyteHD.backend_availability_zone = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] QuobyteHD.backend_host = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] QuobyteHD.chap_password = **** {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] QuobyteHD.chap_username = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] QuobyteHD.chiscsi_conf = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] QuobyteHD.disk_geometry = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] QuobyteHD.driver_client_cert = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] QuobyteHD.driver_client_cert_key = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] QuobyteHD.driver_data_namespace = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] QuobyteHD.driver_use_ssl = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] QuobyteHD.extra_capabilities = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] QuobyteHD.filter_function = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] QuobyteHD.goodness_function = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] QuobyteHD.iscsi_target_flags = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] QuobyteHD.iscsi_write_cache = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] QuobyteHD.iser_helper = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] QuobyteHD.iser_ip_address = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] QuobyteHD.iser_port = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] QuobyteHD.iser_target_prefix = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] QuobyteHD.nas_host = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] QuobyteHD.nas_login = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] QuobyteHD.nas_mount_options = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] QuobyteHD.nas_password = **** {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] QuobyteHD.nas_private_key = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] QuobyteHD.nas_share_path = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] QuobyteHD.nas_ssh_port = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] QuobyteHD.num_shell_tries = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] QuobyteHD.nvmet_ns_id = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] QuobyteHD.nvmet_port_id = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] QuobyteHD.replication_device = **** {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] QuobyteHD.report_discard_supported = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] QuobyteHD.reserved_percentage = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] QuobyteHD.scst_target_driver = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] QuobyteHD.storage_protocol = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] QuobyteHD.target_helper = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] QuobyteHD.target_ip_address = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] QuobyteHD.target_port = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] QuobyteHD.target_prefix = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] QuobyteHD.target_protocol = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] QuobyteHD.trace_flags = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] QuobyteHD.unique_fqdn_network = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] QuobyteHD.use_chap_auth = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] QuobyteHD.volume_clear = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] QuobyteHD.volume_clear_ionice = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] QuobyteHD.volume_clear_size = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] QuobyteHD.volumes_dir = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] oslo_messaging_rabbit.ssl = False {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] oslo_messaging_rabbit.ssl_version = {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] oslo_messaging_notifications.driver = [] {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] oslo_messaging_notifications.retry = -1 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] oslo_messaging_notifications.transport_url = **** {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] key_manager.fixed_key = **** {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] barbican.barbican_api_version = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] barbican.barbican_endpoint = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] barbican.barbican_endpoint_type = public {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] barbican.barbican_region_name = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] barbican.cafile = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] barbican.certfile = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] barbican.collect_timing = False {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] barbican.insecure = False {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] barbican.keyfile = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] barbican.number_of_retries = 60 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] barbican.retry_delay = 1 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] barbican.send_service_user_token = False {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] barbican.split_loggers = False {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] barbican.timeout = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] barbican.tls_ciphers = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] barbican.tls_min_version = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] barbican.verify_ssl = True {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] barbican.verify_ssl_path = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] barbican_service_user.auth_section = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] barbican_service_user.auth_type = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] barbican_service_user.cafile = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] barbican_service_user.certfile = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] barbican_service_user.collect_timing = False {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] barbican_service_user.insecure = False {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] barbican_service_user.keyfile = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] barbican_service_user.split_loggers = False {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] barbican_service_user.timeout = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] barbican_service_user.tls_ciphers = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] barbican_service_user.tls_min_version = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] vault.approle_role_id = **** {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] vault.approle_secret_id = **** {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] vault.auth_method = approle {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] vault.auth_path = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] vault.kv_mountpoint = secret {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] vault.kv_path = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] vault.kv_version = 2 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] vault.namespace = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] vault.root_token_id = **** {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] vault.ssl_ca_crt_file = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] vault.timeout = 60.0 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] vault.token_file = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] vault.token_role = None {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] vault.use_ssl = False {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:16:53 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] ******************************************************************************** {{(pid=85347) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 16 20:16:53 devstack sudo[85563]: pam_unix(sudo:session): session closed for user root Sep 16 20:16:53 devstack cinder-volume[85561]: DEBUG oslo_concurrency.processutils [None req-bdf46a05-d79e-4103-8731-725153f2d6c4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.437s {{(pid=85561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:16:53 devstack cinder-volume[85561]: INFO cinder.volume.drivers.quobyte [None req-bdf46a05-d79e-4103-8731-725153f2d6c4 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 succeeded Sep 16 20:16:53 devstack cinder-volume[85561]: DEBUG cinder.volume.drivers.quobyte [None req-bdf46a05-d79e-4103-8731-725153f2d6c4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=85561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:16:53 devstack cinder-volume[85561]: DEBUG oslo_concurrency.lockutils [None req-bdf46a05-d79e-4103-8731-725153f2d6c4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.469s {{(pid=85561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:16:53 devstack cinder-volume[85561]: DEBUG oslo_concurrency.processutils [None req-bdf46a05-d79e-4103-8731-725153f2d6c4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=85561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:16:53 devstack sudo[85666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:16:53 devstack sudo[85666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:16:53 devstack sudo[85666]: pam_unix(sudo:session): session closed for user root Sep 16 20:16:53 devstack cinder-volume[85561]: DEBUG oslo_concurrency.processutils [None req-bdf46a05-d79e-4103-8731-725153f2d6c4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.243s {{(pid=85561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:16:53 devstack cinder-volume[85561]: INFO cinder.volume.driver [None req-bdf46a05-d79e-4103-8731-725153f2d6c4 None None] Driver hasn't implemented _init_vendor_properties() Sep 16 20:16:53 devstack cinder-volume[85561]: DEBUG cinder.volume.driver [None req-bdf46a05-d79e-4103-8731-725153f2d6c4 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.861484527588, 'free_capacity_gb': 1775.861484527588, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85561) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 16 20:16:53 devstack cinder-volume[85561]: DEBUG oslo_db.sqlalchemy.engines [None req-bdf46a05-d79e-4103-8731-725153f2d6c4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85561) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 16 20:16:53 devstack cinder-volume[85561]: DEBUG dbcounter [-] [85561] Writer thread running {{(pid=85561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 16 20:16:53 devstack cinder-volume[85561]: DEBUG cinder.db.api [None req-bdf46a05-d79e-4103-8731-725153f2d6c4 None None] Building query based on filter {{(pid=85561) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 16 20:16:53 devstack cinder-volume[85561]: DEBUG cinder.image.image_utils [None req-bdf46a05-d79e-4103-8731-725153f2d6c4 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=85561) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 16 20:16:53 devstack cinder-volume[85561]: INFO cinder.keymgr.migration [None req-5fe99843-485a-4a64-926f-80c0c33b8f13 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 16 20:16:53 devstack cinder-volume[85561]: DEBUG oslo_concurrency.lockutils [None req-bdf46a05-d79e-4103-8731-725153f2d6c4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:16:53 devstack cinder-volume[85561]: DEBUG oslo_concurrency.lockutils [None req-bdf46a05-d79e-4103-8731-725153f2d6c4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:16:53 devstack cinder-volume[85561]: DEBUG cinder.volume.drivers.quobyte [None req-bdf46a05-d79e-4103-8731-725153f2d6c4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=85561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:16:53 devstack cinder-volume[85561]: DEBUG cinder.volume.drivers.quobyte [None req-bdf46a05-d79e-4103-8731-725153f2d6c4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=85561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:16:53 devstack cinder-volume[85561]: DEBUG oslo_concurrency.lockutils [None req-bdf46a05-d79e-4103-8731-725153f2d6c4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:16:53 devstack cinder-volume[85561]: DEBUG oslo_concurrency.processutils [None req-bdf46a05-d79e-4103-8731-725153f2d6c4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=85561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:16:53 devstack sudo[85670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:16:53 devstack sudo[85670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:16:53 devstack sudo[85670]: pam_unix(sudo:session): session closed for user root Sep 16 20:16:53 devstack cinder-volume[85561]: DEBUG oslo_concurrency.processutils [None req-bdf46a05-d79e-4103-8731-725153f2d6c4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.235s {{(pid=85561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:16:53 devstack cinder-volume[85561]: DEBUG cinder.manager [None req-bdf46a05-d79e-4103-8731-725153f2d6c4 None None] Notifying Schedulers of capabilities ... {{(pid=85561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:16:54 devstack cinder-volume[85561]: INFO cinder.volume.manager [None req-bdf46a05-d79e-4103-8731-725153f2d6c4 None None] Driver initialization completed successfully. Sep 16 20:16:54 devstack cinder-volume[85561]: INFO cinder.manager [None req-bdf46a05-d79e-4103-8731-725153f2d6c4 None None] Initiating service 3 cleanup Sep 16 20:16:54 devstack cinder-volume[85561]: INFO cinder.manager [None req-bdf46a05-d79e-4103-8731-725153f2d6c4 None None] Service 3 cleanup completed. Sep 16 20:16:54 devstack cinder-volume[85561]: DEBUG cinder.service [None req-bdf46a05-d79e-4103-8731-725153f2d6c4 None None] Creating RPC server for service cinder-volume {{(pid=85561) start /opt/stack/cinder/cinder/service.py:231}} Sep 16 20:16:54 devstack cinder-volume[85561]: DEBUG cinder.service [None req-bdf46a05-d79e-4103-8731-725153f2d6c4 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=85561) start /opt/stack/cinder/cinder/service.py:237}} Sep 16 20:16:54 devstack cinder-volume[85561]: INFO cinder.volume.manager [None req-bdf46a05-d79e-4103-8731-725153f2d6c4 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 16 20:16:54 devstack cinder-volume[85561]: DEBUG oslo_concurrency.lockutils [None req-bdf46a05-d79e-4103-8731-725153f2d6c4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:16:54 devstack cinder-volume[85561]: DEBUG oslo_concurrency.lockutils [None req-bdf46a05-d79e-4103-8731-725153f2d6c4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:16:54 devstack cinder-volume[85561]: DEBUG cinder.volume.drivers.quobyte [None req-bdf46a05-d79e-4103-8731-725153f2d6c4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=85561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:16:54 devstack cinder-volume[85561]: DEBUG cinder.volume.drivers.quobyte [None req-bdf46a05-d79e-4103-8731-725153f2d6c4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=85561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:16:54 devstack cinder-volume[85561]: DEBUG oslo_concurrency.lockutils [None req-bdf46a05-d79e-4103-8731-725153f2d6c4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:16:54 devstack cinder-volume[85561]: DEBUG oslo_concurrency.processutils [None req-bdf46a05-d79e-4103-8731-725153f2d6c4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=85561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:16:54 devstack sudo[85673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:16:54 devstack sudo[85673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:16:54 devstack sudo[85673]: pam_unix(sudo:session): session closed for user root Sep 16 20:16:54 devstack cinder-volume[85561]: DEBUG oslo_concurrency.processutils [None req-bdf46a05-d79e-4103-8731-725153f2d6c4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.258s {{(pid=85561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:16:54 devstack cinder-volume[85561]: INFO cinder.volume.manager [None req-bdf46a05-d79e-4103-8731-725153f2d6c4 None None] Driver post RPC initialization completed successfully. Sep 16 20:16:58 devstack cinder-volume[85347]: INFO oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] Caught SIGTERM, stopping children Sep 16 20:16:58 devstack cinder-volume[85347]: DEBUG oslo_concurrency.lockutils [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] Acquiring lock "singleton_lock" {{(pid=85347) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 16 20:16:58 devstack cinder-volume[85347]: DEBUG oslo_concurrency.lockutils [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] Acquired lock "singleton_lock" {{(pid=85347) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 16 20:16:58 devstack cinder-volume[85347]: DEBUG oslo_concurrency.lockutils [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] Releasing lock "singleton_lock" {{(pid=85347) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 16 20:16:58 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] Stop services. {{(pid=85347) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 16 20:16:58 devstack cinder-volume[85347]: DEBUG oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] Killing children. {{(pid=85347) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 16 20:16:58 devstack cinder-volume[85347]: INFO oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] Waiting on 1 children to exit Sep 16 20:17:02 devstack cinder-volume[85561]: DEBUG oslo_concurrency.lockutils [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] Acquiring lock "singleton_lock" {{(pid=85561) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 16 20:17:02 devstack cinder-volume[85561]: DEBUG oslo_concurrency.lockutils [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] Acquired lock "singleton_lock" {{(pid=85561) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 16 20:17:02 devstack cinder-volume[85561]: DEBUG oslo_concurrency.lockutils [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] Releasing lock "singleton_lock" {{(pid=85561) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 16 20:17:02 devstack cinder-volume[85561]: WARNING amqp [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 16 20:17:02 devstack cinder-volume[85561]: WARNING amqp [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 16 20:17:02 devstack cinder-volume[85347]: INFO oslo_service.backend._eventlet.service [None req-46a899b5-cb0e-4efe-b43f-6f7c0226bce8 None None] Child 85561 exited with status 0 Sep 16 20:17:03 devstack cinder-volume[85878]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 16 20:17:03 devstack cinder-volume[85878]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 16 20:17:03 devstack cinder-volume[85878]: we strongly recommend against using it for new projects. Sep 16 20:17:03 devstack cinder-volume[85878]: If you are already using Eventlet, we recommend migrating to a different Sep 16 20:17:03 devstack cinder-volume[85878]: framework. For more detail see Sep 16 20:17:03 devstack cinder-volume[85878]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 16 20:17:03 devstack cinder-volume[85878]: import eventlet # noqa Sep 16 20:17:05 devstack cinder-volume[85878]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85878) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 16 20:17:05 devstack cinder-volume[85878]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85878) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 16 20:17:05 devstack cinder-volume[85878]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85878) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 16 20:17:06 devstack cinder-volume[85878]: INFO dbcounter [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] Registered counter for database cinder Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_db.sqlalchemy.engines [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85878) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG dbcounter [-] [85878] Writer thread running {{(pid=85878) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 16 20:17:06 devstack cinder-volume[85878]: INFO cinder.rpc [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 16 20:17:06 devstack cinder-volume[85878]: INFO cinder.rpc [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_db.sqlalchemy.engines [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85878) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 16 20:17:06 devstack cinder-volume[85878]: INFO cinder.volume.manager [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] Determined volume DB was empty at startup. Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG cinder.volume.manager [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85878) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 16 20:17:06 devstack cinder-volume[85878]: WARNING stevedore.named [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 16 20:17:06 devstack cinder-volume[85878]: WARNING castellan.key_manager [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 16 20:17:06 devstack cinder-volume[85878]: WARNING cinder.keymgr.conf_key_mgr [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 16 20:17:06 devstack cinder-volume[85878]: INFO cinder.volume.manager [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_db.sqlalchemy.engines [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85878) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 16 20:17:06 devstack cinder-volume[85878]: INFO oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] Starting 1 workers Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] Started child 86188 {{(pid=85878) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] Full set of CONF: {{(pid=85878) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] ******************************************************************************** {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] Configuration options gathered from: {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] ================================================================================ {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] allow_availability_zone_fallback = False {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] allow_compression_on_image_upload = False {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] allowed_direct_url_schemes = [] {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] api_rate_limit = True {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] auth_strategy = keystone {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] backend_availability_zone = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] backend_host = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] backend_name = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] backend_stats_polling_interval = 60 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] backup_api_class = cinder.backup.api.API {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] backup_name_template = backup-%s {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] backup_use_same_host = False {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] backup_use_temp_snapshot = False {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] chap_password = **** {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] chap_username = {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] cinder_internal_tenant_project_id = 4afddf3d2b5740a1a757ca079835427b {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] cinder_internal_tenant_user_id = 5db57551a9c64cd0864f4f98caf06bbc {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] cluster = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] compression_format = gzip {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[86188]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] compute_api_class = cinder.compute.nova.API {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] config_dir = [] {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] config_source = [] {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] control_exchange = openstack {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] debug = True {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] default_availability_zone = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] default_group_type = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] default_volume_type = QuobyteHD {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] disk_geometry = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] driver_client_cert = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] driver_client_cert_key = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] driver_data_namespace = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] driver_ssl_cert_path = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] driver_ssl_cert_verify = False {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] driver_use_ssl = False {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] enable_new_services = True {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] enable_unsupported_driver = False {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] enabled_backends = ['QuobyteHD'] {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] enforce_multipath_for_image_xfer = False {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] filter_function = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] glance_api_insecure = False {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] glance_api_servers = ['http://192.168.122.248/image'] {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] glance_api_ssl_compression = False {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] glance_ca_certificates_file = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] glance_catalog_info = image:glance:publicURL {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] glance_certfile = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] glance_keyfile = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] glance_num_retries = 3 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] glance_request_timeout = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] goodness_function = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] graceful_shutdown_timeout = 5 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] group_api_class = cinder.group.api.API {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] host = devstack {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] image_compress_on_upload = True {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] image_conversion_address_space_limit = 1 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] image_conversion_cpu_limit = 60 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] image_conversion_disable = False {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] image_upload_use_cinder_backend = False {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] image_upload_use_internal_tenant = False {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] image_volume_cache_enabled = False {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] image_volume_cache_max_count = 0 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] image_volume_cache_max_size_gb = 0 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] init_host_max_objects_retrieval = 0 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] instance_format = [instance: %(uuid)s] {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] iscsi_target_flags = {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] iscsi_write_cache = on {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] iser_helper = tgtadm {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] iser_ip_address = 192.168.122.248 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] iser_port = 3260 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] log_color = False {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] log_config_append = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] log_dir = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] log_file = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] log_options = True {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] log_rotate_interval = 1 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] log_rotate_interval_type = days {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] log_rotation_type = none {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] max_age = 0 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] max_logfile_count = 30 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] max_logfile_size_mb = 200 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] max_over_subscription_ratio = 20.0 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] message_reap_interval = 86400 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] message_ttl = 2592000 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] migration_create_volume_timeout_secs = 300 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] monkey_patch = False {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] monkey_patch_modules = [] {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] my_ip = 192.168.122.248 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] no_snapshot_gb_quota = False {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] num_iser_scan_tries = 3 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] num_shell_tries = 3 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] num_volume_device_scan_tries = 3 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] nvmeof_conn_info_version = 1 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] nvmet_ns_id = 10 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] nvmet_port_id = 1 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] osapi_max_limit = 1000 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] osapi_volume_ext_list = [] {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] osapi_volume_listen = 0.0.0.0 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] osapi_volume_listen_port = 8776 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] osapi_volume_use_ssl = False {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] osapi_volume_workers = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] per_volume_size_limit = -1 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] periodic_fuzzy_delay = 60 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] periodic_interval = 60 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] project_id_regex = [0-9a-f\-]+ {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] public_endpoint = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] publish_errors = False {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] quota_backup_gigabytes = 1000 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] quota_backups = 10 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] quota_gigabytes = 1000 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] quota_groups = 10 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] quota_snapshots = 10 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] quota_volumes = 10 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] rate_limit_burst = 0 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] rate_limit_except_level = CRITICAL {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] rate_limit_interval = 0 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-0739e864-2778-42db-aa0c-4e027d66efa2 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] reinit_driver_count = 3 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-0739e864-2778-42db-aa0c-4e027d66efa2 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86188) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] replication_device = **** {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] report_discard_supported = False {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] report_interval = 120 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] reservation_clean_interval = 86400 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] reservation_expire = 86400 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] reserved_image_namespaces = [] {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] reserved_percentage = 0 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] rpc_response_timeout = 120 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] run_external_periodic_tasks = True {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] scst_target_driver = iscsi {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] scst_target_iqn_name = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] service_down_time = 720 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] shell_completion = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] snapshot_name_template = snapshot-%s {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] split_loggers = False {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] state_path = /opt/stack/data/cinder {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] storage_availability_zone = nova {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] storage_protocol = iSCSI {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] syslog_log_facility = LOG_USER {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] target_helper = lioadm {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] target_ip_address = 192.168.122.248 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] target_port = 3260 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] target_protocol = iscsi {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] target_secondary_ip_addresses = [] {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] trace_flags = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] transfer_api_class = cinder.transfer.api.API {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] transport_url = **** {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] until_refresh = 0 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] use_chap_auth = False {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] use_default_quota_class = True {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] use_journal = False {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] use_json = False {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] use_multipath_for_image_xfer = False {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] use_stderr = False {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] use_syslog = False {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] verify_glance_signatures = enabled {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] volume_api_class = cinder.volume.api.API {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] volume_backend_name = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] volume_clear = zero {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] volume_clear_ionice = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] volume_clear_size = 0 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] volume_copy_bps_limit = 0 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] volume_dd_blocksize = 1M {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] volume_name_template = volume-%s {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] volume_service_inithost_offload = False {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] volume_usage_audit_period = month {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] zoning_mode = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] oslo_concurrency.disable_process_locking = False {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] keystone_authtoken.auth_section = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] keystone_authtoken.auth_type = password {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] keystone_authtoken.auth_version = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] keystone_authtoken.cache = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] keystone_authtoken.certfile = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] keystone_authtoken.delay_auth_decision = False {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] keystone_authtoken.http_connect_timeout = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] keystone_authtoken.include_service_catalog = True {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] keystone_authtoken.insecure = False {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] keystone_authtoken.interface = public {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] keystone_authtoken.keyfile = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] keystone_authtoken.memcache_password = **** {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] keystone_authtoken.memcache_username = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] keystone_authtoken.region_name = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] keystone_authtoken.service_token_roles_required = True {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] keystone_authtoken.service_type = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] keystone_authtoken.token_cache_time = 300 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.248/identity {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] cache.backend = dogpile.cache.null {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] cache.backend_argument = **** {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] cache.backend_expiration_time = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] cache.config_prefix = cache.oslo {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] cache.debug_cache_backend = False {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] cache.enable_retry_client = False {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] cache.enable_socket_keepalive = False {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] cache.enabled = False {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] cache.expiration_time = 600 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] cache.hashclient_retry_attempts = 2 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] cache.memcache_dead_retry = 300 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] cache.memcache_pool_maxsize = 10 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] cache.memcache_sasl_enabled = False {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] cache.password = **** {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] cache.proxies = [] {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] cache.redis_db = 0 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] cache.redis_sentinel_service_name = mymaster {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] cache.redis_server = localhost:6379 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] cache.retry_attempts = 2 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] cache.retry_delay = 0.0 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] cache.socket_keepalive_count = 1 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] cache.socket_keepalive_idle = 1 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] cache.socket_keepalive_interval = 1 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-0739e864-2778-42db-aa0c-4e027d66efa2 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86188) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] cache.socket_timeout = 1.0 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[86188]: WARNING cinder.volume.drivers.quobyte [None req-0739e864-2778-42db-aa0c-4e027d66efa2 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] cache.tls_allowed_ciphers = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] cache.tls_cafile = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[86188]: WARNING cinder.volume.drivers.quobyte [None req-0739e864-2778-42db-aa0c-4e027d66efa2 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] cache.tls_certfile = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] cache.tls_enabled = False {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] cache.tls_keyfile = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] cache.username = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] coordination.backend_url = **** {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-0739e864-2778-42db-aa0c-4e027d66efa2 None None] Running cmd (subprocess): mount.quobyte {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] database.asyncio_connection = **** {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] database.asyncio_slave_connection = **** {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] database.backend = sqlalchemy {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] database.connection = **** {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] database.connection_debug = 0 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] database.connection_parameters = {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] database.connection_recycle_time = 3600 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] database.connection_trace = False {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] database.db_inc_retry_interval = True {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] database.db_max_retries = 20 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] database.db_max_retry_interval = 10 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] database.db_retry_interval = 1 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] database.max_overflow = 50 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] database.max_pool_size = 5 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] database.max_retries = 10 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] database.mysql_wsrep_sync_wait = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] database.pool_timeout = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] database.retry_interval = 10 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] database.slave_connection = **** {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] database.sqlite_synchronous = True {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] database.synchronous_reader = True {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] database.use_db_reconnect = False {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] oslo_messaging_tracing.insecure = False {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] profiler.connection_string = messaging:// {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] profiler.enabled = False {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] profiler.es_doc_type = notification {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] profiler.es_scroll_size = 10000 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] profiler.es_scroll_time = 2m {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] profiler.filter_error_trace = False {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] profiler.hmac_keys = **** {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] profiler.sentinel_service_name = mymaster {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] profiler.socket_timeout = 0.1 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] profiler.trace_requests = False {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] profiler.trace_sqlalchemy = False {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] profiler_jaeger.process_tags = {} {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] profiler_jaeger.service_name_prefix = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] profiler_otlp.service_name_prefix = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] oslo_policy.enforce_new_defaults = True {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] oslo_policy.policy_default_rule = default {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] oslo_policy.policy_file = policy.yaml {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] oslo_policy.remote_timeout = 60.0 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] privsep_osbrick.group = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] privsep_osbrick.helper_command = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] privsep_osbrick.user = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] cinder_sys_admin.group = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] cinder_sys_admin.helper_command = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] cinder_sys_admin.user = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] service_user.auth_section = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] service_user.auth_type = password {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] service_user.cafile = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] service_user.certfile = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] service_user.collect_timing = False {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] service_user.insecure = False {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] service_user.keyfile = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] service_user.send_service_user_token = True {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] service_user.split_loggers = False {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] service_user.timeout = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] service_user.tls_ciphers = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] service_user.tls_min_version = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] glance.auth_section = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] glance.auth_type = password {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] glance.certfile = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] glance.collect_timing = False {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] glance.insecure = False {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] glance.keyfile = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] glance.region_name = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] glance.split_loggers = False {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] glance.timeout = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] glance.tls_ciphers = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] glance.tls_min_version = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] backend_defaults.backend_availability_zone = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] backend_defaults.chap_password = **** {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] backend_defaults.chap_username = {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] backend_defaults.disk_geometry = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] backend_defaults.driver_client_cert = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] backend_defaults.driver_client_cert_key = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] backend_defaults.driver_data_namespace = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] backend_defaults.driver_use_ssl = False {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] backend_defaults.enable_unsupported_driver = False {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] backend_defaults.extra_capabilities = {} {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] backend_defaults.filter_function = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] backend_defaults.goodness_function = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] backend_defaults.iscsi_target_flags = {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] backend_defaults.iscsi_write_cache = on {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] backend_defaults.iser_helper = tgtadm {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] backend_defaults.iser_ip_address = 192.168.122.248 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] backend_defaults.iser_port = 3260 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] backend_defaults.nas_host = {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] backend_defaults.nas_login = admin {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] backend_defaults.nas_mount_options = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] backend_defaults.nas_password = **** {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] backend_defaults.nas_private_key = {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] backend_defaults.nas_share_path = {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] backend_defaults.nas_ssh_port = 22 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] backend_defaults.num_shell_tries = 3 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] backend_defaults.nvmet_port_id = 1 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] backend_defaults.quobyte_client_cfg = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] backend_defaults.quobyte_volume_url = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] backend_defaults.replication_device = **** {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] backend_defaults.report_discard_supported = False {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] backend_defaults.reserved_percentage = 0 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] backend_defaults.scst_target_driver = iscsi {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] backend_defaults.scst_target_iqn_name = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] backend_defaults.storage_protocol = iSCSI {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] backend_defaults.target_helper = tgtadm {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] backend_defaults.target_ip_address = 192.168.122.248 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] backend_defaults.target_port = 3260 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] backend_defaults.target_protocol = iscsi {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] backend_defaults.trace_flags = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] backend_defaults.unique_fqdn_network = True {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] backend_defaults.use_chap_auth = False {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] backend_defaults.volume_backend_name = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] backend_defaults.volume_clear = zero {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] backend_defaults.volume_clear_ionice = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] backend_defaults.volume_clear_size = 0 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] oslo_reports.file_event_handler = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] oslo_reports.log_dir = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] QuobyteHD.backend_availability_zone = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] QuobyteHD.backend_host = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] QuobyteHD.chap_password = **** {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] QuobyteHD.chap_username = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] QuobyteHD.chiscsi_conf = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] QuobyteHD.disk_geometry = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] QuobyteHD.driver_client_cert = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] QuobyteHD.driver_client_cert_key = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] QuobyteHD.driver_data_namespace = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] QuobyteHD.driver_use_ssl = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] QuobyteHD.extra_capabilities = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] QuobyteHD.filter_function = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] QuobyteHD.goodness_function = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack quobyte-client[86192]: Reading configuration file: /etc/quobyte/client.cfg Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] QuobyteHD.iscsi_target_flags = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] QuobyteHD.iscsi_write_cache = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] QuobyteHD.iser_helper = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] QuobyteHD.iser_ip_address = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] QuobyteHD.iser_port = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack quobyte-client[86192]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] QuobyteHD.iser_target_prefix = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] QuobyteHD.nas_host = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] QuobyteHD.nas_login = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] QuobyteHD.nas_mount_options = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] QuobyteHD.nas_password = **** {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] QuobyteHD.nas_private_key = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] QuobyteHD.nas_share_path = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] QuobyteHD.nas_ssh_port = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] QuobyteHD.num_shell_tries = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] QuobyteHD.nvmet_ns_id = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] QuobyteHD.nvmet_port_id = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] QuobyteHD.replication_device = **** {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] QuobyteHD.report_discard_supported = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] QuobyteHD.reserved_percentage = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] QuobyteHD.scst_target_driver = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-0739e864-2778-42db-aa0c-4e027d66efa2 None None] CMD "mount.quobyte" returned: 1 in 0.094s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] QuobyteHD.storage_protocol = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-0739e864-2778-42db-aa0c-4e027d66efa2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-0739e864-2778-42db-aa0c-4e027d66efa2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] QuobyteHD.target_helper = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-0739e864-2778-42db-aa0c-4e027d66efa2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] QuobyteHD.target_ip_address = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] QuobyteHD.target_port = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] QuobyteHD.target_prefix = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] QuobyteHD.target_protocol = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] QuobyteHD.trace_flags = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] QuobyteHD.unique_fqdn_network = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] QuobyteHD.use_chap_auth = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] QuobyteHD.volume_clear = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] QuobyteHD.volume_clear_ionice = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] QuobyteHD.volume_clear_size = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] QuobyteHD.volumes_dir = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-0739e864-2778-42db-aa0c-4e027d66efa2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:17:06 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-0739e864-2778-42db-aa0c-4e027d66efa2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-0739e864-2778-42db-aa0c-4e027d66efa2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] oslo_messaging_rabbit.ssl = False {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] oslo_messaging_rabbit.ssl_version = {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] oslo_messaging_notifications.driver = [] {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] oslo_messaging_notifications.retry = -1 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] oslo_messaging_notifications.transport_url = **** {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] key_manager.fixed_key = **** {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] barbican.barbican_api_version = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] barbican.barbican_endpoint = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] barbican.barbican_endpoint_type = public {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] barbican.barbican_region_name = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] barbican.cafile = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] barbican.certfile = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] barbican.collect_timing = False {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] barbican.insecure = False {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] barbican.keyfile = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] barbican.number_of_retries = 60 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] barbican.retry_delay = 1 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] barbican.send_service_user_token = False {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] barbican.split_loggers = False {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] barbican.timeout = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] barbican.tls_ciphers = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] barbican.tls_min_version = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] barbican.verify_ssl = True {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] barbican.verify_ssl_path = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] barbican_service_user.auth_section = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] barbican_service_user.auth_type = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] barbican_service_user.cafile = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] barbican_service_user.certfile = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] barbican_service_user.collect_timing = False {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] barbican_service_user.insecure = False {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] barbican_service_user.keyfile = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] barbican_service_user.split_loggers = False {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:06 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] barbican_service_user.timeout = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:07 devstack sudo[86195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:17:07 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] barbican_service_user.tls_ciphers = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:07 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] barbican_service_user.tls_min_version = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:07 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] vault.approle_role_id = **** {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:07 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] vault.approle_secret_id = **** {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:07 devstack sudo[86195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:17:07 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] vault.auth_method = approle {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:07 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] vault.auth_path = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:07 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] vault.kv_mountpoint = secret {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:07 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] vault.kv_path = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:07 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] vault.kv_version = 2 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:07 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] vault.namespace = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:07 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] vault.root_token_id = **** {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:07 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] vault.ssl_ca_crt_file = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:07 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] vault.timeout = 60.0 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:07 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] vault.token_file = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:07 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] vault.token_role = None {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:07 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] vault.use_ssl = False {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:07 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 20:17:07 devstack cinder-volume[85878]: DEBUG oslo_service.backend._eventlet.service [None req-cf2d1ca8-60d7-44d7-89dd-b8af46416ac8 None None] ******************************************************************************** {{(pid=85878) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 16 20:17:07 devstack sudo[86195]: pam_unix(sudo:session): session closed for user root Sep 16 20:17:07 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-0739e864-2778-42db-aa0c-4e027d66efa2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.258s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:17:07 devstack cinder-volume[86188]: INFO cinder.volume.driver [None req-0739e864-2778-42db-aa0c-4e027d66efa2 None None] Driver hasn't implemented _init_vendor_properties() Sep 16 20:17:07 devstack cinder-volume[86188]: DEBUG cinder.volume.driver [None req-0739e864-2778-42db-aa0c-4e027d66efa2 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.861484527588, 'free_capacity_gb': 1775.861484527588, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86188) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 16 20:17:07 devstack cinder-volume[86188]: DEBUG oslo_db.sqlalchemy.engines [None req-0739e864-2778-42db-aa0c-4e027d66efa2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86188) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 16 20:17:07 devstack cinder-volume[86188]: DEBUG dbcounter [-] [86188] Writer thread running {{(pid=86188) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 16 20:17:07 devstack cinder-volume[86188]: DEBUG cinder.db.api [None req-0739e864-2778-42db-aa0c-4e027d66efa2 None None] Building query based on filter {{(pid=86188) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 16 20:17:07 devstack cinder-volume[86188]: DEBUG cinder.image.image_utils [None req-0739e864-2778-42db-aa0c-4e027d66efa2 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86188) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 16 20:17:07 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-0739e864-2778-42db-aa0c-4e027d66efa2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:17:07 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-0739e864-2778-42db-aa0c-4e027d66efa2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:17:07 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-0739e864-2778-42db-aa0c-4e027d66efa2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:17:07 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-0739e864-2778-42db-aa0c-4e027d66efa2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:17:07 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-0739e864-2778-42db-aa0c-4e027d66efa2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:17:07 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-0739e864-2778-42db-aa0c-4e027d66efa2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:17:07 devstack cinder-volume[86188]: INFO cinder.keymgr.migration [None req-38e344fb-77a6-40a0-91c6-f6a556526d6c None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 16 20:17:07 devstack sudo[86208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:17:07 devstack sudo[86208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:17:07 devstack sudo[86208]: pam_unix(sudo:session): session closed for user root Sep 16 20:17:07 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-0739e864-2778-42db-aa0c-4e027d66efa2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.230s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:17:07 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-0739e864-2778-42db-aa0c-4e027d66efa2 None None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:17:07 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-0739e864-2778-42db-aa0c-4e027d66efa2 None None] Driver initialization completed successfully. Sep 16 20:17:07 devstack cinder-volume[86188]: INFO cinder.manager [None req-0739e864-2778-42db-aa0c-4e027d66efa2 None None] Initiating service 3 cleanup Sep 16 20:17:07 devstack cinder-volume[86188]: INFO cinder.manager [None req-0739e864-2778-42db-aa0c-4e027d66efa2 None None] Service 3 cleanup completed. Sep 16 20:17:07 devstack cinder-volume[86188]: DEBUG cinder.service [None req-0739e864-2778-42db-aa0c-4e027d66efa2 None None] Creating RPC server for service cinder-volume {{(pid=86188) start /opt/stack/cinder/cinder/service.py:231}} Sep 16 20:17:07 devstack cinder-volume[86188]: DEBUG cinder.service [None req-0739e864-2778-42db-aa0c-4e027d66efa2 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86188) start /opt/stack/cinder/cinder/service.py:237}} Sep 16 20:17:07 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-0739e864-2778-42db-aa0c-4e027d66efa2 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 16 20:17:07 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-0739e864-2778-42db-aa0c-4e027d66efa2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:17:07 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-0739e864-2778-42db-aa0c-4e027d66efa2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:17:07 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-0739e864-2778-42db-aa0c-4e027d66efa2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:17:07 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-0739e864-2778-42db-aa0c-4e027d66efa2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:17:07 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-0739e864-2778-42db-aa0c-4e027d66efa2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:17:07 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-0739e864-2778-42db-aa0c-4e027d66efa2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:17:07 devstack sudo[86217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:17:07 devstack sudo[86217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:17:07 devstack sudo[86217]: pam_unix(sudo:session): session closed for user root Sep 16 20:17:07 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-0739e864-2778-42db-aa0c-4e027d66efa2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.252s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:17:07 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-0739e864-2778-42db-aa0c-4e027d66efa2 None None] Driver post RPC initialization completed successfully. Sep 16 20:17:16 devstack cinder-volume[85878]: DEBUG dbcounter [-] [85878] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=85878) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 20:17:17 devstack cinder-volume[86188]: DEBUG dbcounter [-] [86188] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=86188) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 20:17:17 devstack cinder-volume[86188]: DEBUG dbcounter [-] [86188] Writing DB stats cinder:SELECT=3 {{(pid=86188) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 20:17:52 devstack cinder-volume[86188]: DEBUG oslo_service.periodic_task [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Running periodic task VolumeManager._thread_info {{(pid=86188) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 20:17:52 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] thread count: 6 {{(pid=86188) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 16 20:17:52 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] thread info: [<_MainThread(MainThread, started 139858124406912)>, , , , , ] {{(pid=86188) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 16 20:18:04 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9fa4127-cd22-4824-a907-9e1f52b3ab67 tempest-TaggedAttachmentsTest-1650878344 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:18:04 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f9fa4127-cd22-4824-a907-9e1f52b3ab67 tempest-TaggedAttachmentsTest-1650878344 None] Flow 'volume_create_manager' (ff78e171-ce7e-48ca-be2c-7c76f99b3d9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:18:04 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f9fa4127-cd22-4824-a907-9e1f52b3ab67 tempest-TaggedAttachmentsTest-1650878344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2a060ce-7d0c-4eaf-b8ce-354ffe4eda6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:18:04 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f9fa4127-cd22-4824-a907-9e1f52b3ab67 tempest-TaggedAttachmentsTest-1650878344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2a060ce-7d0c-4eaf-b8ce-354ffe4eda6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:17:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-307904811',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9aa136e-3435-4e93-aee5-111e831733e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b9a714765b342c8827e24e83df4009f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:18:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:18:05Z,use_quota=True,user_id='0f479677d0e84e0681064373fdf5a55a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:18:04 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f9fa4127-cd22-4824-a907-9e1f52b3ab67 tempest-TaggedAttachmentsTest-1650878344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dab521ac-948e-4b61-9be8-4ec22fafb793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:18:04 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f9fa4127-cd22-4824-a907-9e1f52b3ab67 tempest-TaggedAttachmentsTest-1650878344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dab521ac-948e-4b61-9be8-4ec22fafb793) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:18:04 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f9fa4127-cd22-4824-a907-9e1f52b3ab67 tempest-TaggedAttachmentsTest-1650878344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58aa15c6-9692-4ed1-b0c5-5d1076a9a7bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:18:04 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f9fa4127-cd22-4824-a907-9e1f52b3ab67 tempest-TaggedAttachmentsTest-1650878344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58aa15c6-9692-4ed1-b0c5-5d1076a9a7bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9aa136e-3435-4e93-aee5-111e831733e1', 'volume_name': 'volume-e9aa136e-3435-4e93-aee5-111e831733e1', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:18:04 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f9fa4127-cd22-4824-a907-9e1f52b3ab67 tempest-TaggedAttachmentsTest-1650878344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (495d9879-632a-4041-8da4-fc06d1c24c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:18:04 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f9fa4127-cd22-4824-a907-9e1f52b3ab67 tempest-TaggedAttachmentsTest-1650878344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (495d9879-632a-4041-8da4-fc06d1c24c79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:18:04 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f9fa4127-cd22-4824-a907-9e1f52b3ab67 tempest-TaggedAttachmentsTest-1650878344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d0f4293-f622-49f9-b067-ab6d666c739b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:18:04 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-f9fa4127-cd22-4824-a907-9e1f52b3ab67 tempest-TaggedAttachmentsTest-1650878344 None] Volume e9aa136e-3435-4e93-aee5-111e831733e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9aa136e-3435-4e93-aee5-111e831733e1', 'volume_size': 1} Sep 16 20:18:04 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-f9fa4127-cd22-4824-a907-9e1f52b3ab67 tempest-TaggedAttachmentsTest-1650878344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:18:04 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-f9fa4127-cd22-4824-a907-9e1f52b3ab67 tempest-TaggedAttachmentsTest-1650878344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:18:04 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-f9fa4127-cd22-4824-a907-9e1f52b3ab67 tempest-TaggedAttachmentsTest-1650878344 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:17:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-307904811',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9aa136e-3435-4e93-aee5-111e831733e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b9a714765b342c8827e24e83df4009f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:18:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:18:05Z,use_quota=True,user_id='0f479677d0e84e0681064373fdf5a55a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:18:04 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-f9fa4127-cd22-4824-a907-9e1f52b3ab67 tempest-TaggedAttachmentsTest-1650878344 None] Creating volume e9aa136e-3435-4e93-aee5-111e831733e1 {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:18:04 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-f9fa4127-cd22-4824-a907-9e1f52b3ab67 tempest-TaggedAttachmentsTest-1650878344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:18:04 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-f9fa4127-cd22-4824-a907-9e1f52b3ab67 tempest-TaggedAttachmentsTest-1650878344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:18:04 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-f9fa4127-cd22-4824-a907-9e1f52b3ab67 tempest-TaggedAttachmentsTest-1650878344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:18:04 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-f9fa4127-cd22-4824-a907-9e1f52b3ab67 tempest-TaggedAttachmentsTest-1650878344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:18:04 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-f9fa4127-cd22-4824-a907-9e1f52b3ab67 tempest-TaggedAttachmentsTest-1650878344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:18:04 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-f9fa4127-cd22-4824-a907-9e1f52b3ab67 tempest-TaggedAttachmentsTest-1650878344 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:18:04 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-f9fa4127-cd22-4824-a907-9e1f52b3ab67 tempest-TaggedAttachmentsTest-1650878344 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:18:04 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f9fa4127-cd22-4824-a907-9e1f52b3ab67 tempest-TaggedAttachmentsTest-1650878344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e9aa136e-3435-4e93-aee5-111e831733e1 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:18:04 devstack sudo[86594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e9aa136e-3435-4e93-aee5-111e831733e1 1073741824 Sep 16 20:18:04 devstack sudo[86594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:18:05 devstack sudo[86594]: pam_unix(sudo:session): session closed for user root Sep 16 20:18:05 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f9fa4127-cd22-4824-a907-9e1f52b3ab67 tempest-TaggedAttachmentsTest-1650878344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e9aa136e-3435-4e93-aee5-111e831733e1 1073741824" returned: 0 in 0.590s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:18:05 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f9fa4127-cd22-4824-a907-9e1f52b3ab67 tempest-TaggedAttachmentsTest-1650878344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e9aa136e-3435-4e93-aee5-111e831733e1 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:18:05 devstack sudo[86912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e9aa136e-3435-4e93-aee5-111e831733e1 Sep 16 20:18:05 devstack sudo[86912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:18:05 devstack sudo[86912]: pam_unix(sudo:session): session closed for user root Sep 16 20:18:05 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f9fa4127-cd22-4824-a907-9e1f52b3ab67 tempest-TaggedAttachmentsTest-1650878344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e9aa136e-3435-4e93-aee5-111e831733e1" returned: 0 in 0.280s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:18:05 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-f9fa4127-cd22-4824-a907-9e1f52b3ab67 tempest-TaggedAttachmentsTest-1650878344 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:18:05 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-f9fa4127-cd22-4824-a907-9e1f52b3ab67 tempest-TaggedAttachmentsTest-1650878344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:18:05 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f9fa4127-cd22-4824-a907-9e1f52b3ab67 tempest-TaggedAttachmentsTest-1650878344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d0f4293-f622-49f9-b067-ab6d666c739b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9aa136e-3435-4e93-aee5-111e831733e1', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:18:05 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f9fa4127-cd22-4824-a907-9e1f52b3ab67 tempest-TaggedAttachmentsTest-1650878344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6474a8e-59c8-41bb-be46-14d529be3acb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:18:05 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-f9fa4127-cd22-4824-a907-9e1f52b3ab67 tempest-TaggedAttachmentsTest-1650878344 None] Volume volume-e9aa136e-3435-4e93-aee5-111e831733e1 (e9aa136e-3435-4e93-aee5-111e831733e1): created successfully Sep 16 20:18:05 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f9fa4127-cd22-4824-a907-9e1f52b3ab67 tempest-TaggedAttachmentsTest-1650878344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6474a8e-59c8-41bb-be46-14d529be3acb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:18:05 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f9fa4127-cd22-4824-a907-9e1f52b3ab67 tempest-TaggedAttachmentsTest-1650878344 None] Flow 'volume_create_manager' (ff78e171-ce7e-48ca-be2c-7c76f99b3d9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:18:05 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-f9fa4127-cd22-4824-a907-9e1f52b3ab67 tempest-TaggedAttachmentsTest-1650878344 None] Created volume successfully. Sep 16 20:18:15 devstack cinder-volume[86188]: DEBUG dbcounter [-] [86188] Writing DB stats cinder:UPDATE=5,cinder:SELECT=1 {{(pid=86188) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 20:18:15 devstack cinder-volume[86188]: DEBUG dbcounter [-] [86188] Writing DB stats cinder:SELECT=3,cinder:INSERT=1,cinder:UPDATE=1,cinder:DELETE=1 {{(pid=86188) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 20:18:18 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-91dc76b7-1037-449e-a94a-bb479ad0fb52 tempest-DeleteServersTestJSON-917437637 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:18:18 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-91dc76b7-1037-449e-a94a-bb479ad0fb52 tempest-DeleteServersTestJSON-917437637 None] Flow 'volume_create_manager' (e0cc6d18-9240-4657-a307-dfcccf847f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:18:18 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-91dc76b7-1037-449e-a94a-bb479ad0fb52 tempest-DeleteServersTestJSON-917437637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7d59b83-448d-4682-a588-02821b84f001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:18:18 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-91dc76b7-1037-449e-a94a-bb479ad0fb52 tempest-DeleteServersTestJSON-917437637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7d59b83-448d-4682-a588-02821b84f001) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:18:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-694416074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d700bf72-d725-43ee-8a47-3e3ecfe9650d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0333fa54083e49a3936c8a7ae3e9b652',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:18:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:18:19Z,use_quota=True,user_id='99f6fbac161e4e9e9da2bc58d31c61d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:18:18 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-91dc76b7-1037-449e-a94a-bb479ad0fb52 tempest-DeleteServersTestJSON-917437637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b261e4c5-28c1-434b-bf1d-1de7a293f714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:18:18 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-91dc76b7-1037-449e-a94a-bb479ad0fb52 tempest-DeleteServersTestJSON-917437637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b261e4c5-28c1-434b-bf1d-1de7a293f714) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:18:18 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-91dc76b7-1037-449e-a94a-bb479ad0fb52 tempest-DeleteServersTestJSON-917437637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6f259de-da5f-4e41-9f4f-4665c0a93e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:18:18 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-91dc76b7-1037-449e-a94a-bb479ad0fb52 tempest-DeleteServersTestJSON-917437637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6f259de-da5f-4e41-9f4f-4665c0a93e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd700bf72-d725-43ee-8a47-3e3ecfe9650d', 'volume_name': 'volume-d700bf72-d725-43ee-8a47-3e3ecfe9650d', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:18:18 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-91dc76b7-1037-449e-a94a-bb479ad0fb52 tempest-DeleteServersTestJSON-917437637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d33f59be-6f2f-42f0-adab-c37cf454e15c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:18:18 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-91dc76b7-1037-449e-a94a-bb479ad0fb52 tempest-DeleteServersTestJSON-917437637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d33f59be-6f2f-42f0-adab-c37cf454e15c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:18:18 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-91dc76b7-1037-449e-a94a-bb479ad0fb52 tempest-DeleteServersTestJSON-917437637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b12705d-bf64-485f-86b1-5e61ca68261b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:18:18 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-91dc76b7-1037-449e-a94a-bb479ad0fb52 tempest-DeleteServersTestJSON-917437637 None] Volume d700bf72-d725-43ee-8a47-3e3ecfe9650d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d700bf72-d725-43ee-8a47-3e3ecfe9650d', 'volume_size': 1} Sep 16 20:18:18 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-91dc76b7-1037-449e-a94a-bb479ad0fb52 tempest-DeleteServersTestJSON-917437637 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:18:18 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-91dc76b7-1037-449e-a94a-bb479ad0fb52 tempest-DeleteServersTestJSON-917437637 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:18:18 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-91dc76b7-1037-449e-a94a-bb479ad0fb52 tempest-DeleteServersTestJSON-917437637 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:18:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-694416074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d700bf72-d725-43ee-8a47-3e3ecfe9650d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0333fa54083e49a3936c8a7ae3e9b652',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:18:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:18:19Z,use_quota=True,user_id='99f6fbac161e4e9e9da2bc58d31c61d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:18:18 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-91dc76b7-1037-449e-a94a-bb479ad0fb52 tempest-DeleteServersTestJSON-917437637 None] Creating volume d700bf72-d725-43ee-8a47-3e3ecfe9650d {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:18:18 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-91dc76b7-1037-449e-a94a-bb479ad0fb52 tempest-DeleteServersTestJSON-917437637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:18:18 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-91dc76b7-1037-449e-a94a-bb479ad0fb52 tempest-DeleteServersTestJSON-917437637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:18:18 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-91dc76b7-1037-449e-a94a-bb479ad0fb52 tempest-DeleteServersTestJSON-917437637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:18:18 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-91dc76b7-1037-449e-a94a-bb479ad0fb52 tempest-DeleteServersTestJSON-917437637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:18:18 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-91dc76b7-1037-449e-a94a-bb479ad0fb52 tempest-DeleteServersTestJSON-917437637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:18:18 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-91dc76b7-1037-449e-a94a-bb479ad0fb52 tempest-DeleteServersTestJSON-917437637 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:18:18 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-91dc76b7-1037-449e-a94a-bb479ad0fb52 tempest-DeleteServersTestJSON-917437637 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:18:18 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-91dc76b7-1037-449e-a94a-bb479ad0fb52 tempest-DeleteServersTestJSON-917437637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d700bf72-d725-43ee-8a47-3e3ecfe9650d 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:18:18 devstack sudo[87049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d700bf72-d725-43ee-8a47-3e3ecfe9650d 1073741824 Sep 16 20:18:18 devstack sudo[87049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:18:19 devstack sudo[87049]: pam_unix(sudo:session): session closed for user root Sep 16 20:18:19 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-91dc76b7-1037-449e-a94a-bb479ad0fb52 tempest-DeleteServersTestJSON-917437637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d700bf72-d725-43ee-8a47-3e3ecfe9650d 1073741824" returned: 0 in 0.794s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:18:19 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-91dc76b7-1037-449e-a94a-bb479ad0fb52 tempest-DeleteServersTestJSON-917437637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d700bf72-d725-43ee-8a47-3e3ecfe9650d {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:18:19 devstack sudo[87054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d700bf72-d725-43ee-8a47-3e3ecfe9650d Sep 16 20:18:19 devstack sudo[87054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:18:20 devstack sudo[87054]: pam_unix(sudo:session): session closed for user root Sep 16 20:18:20 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-91dc76b7-1037-449e-a94a-bb479ad0fb52 tempest-DeleteServersTestJSON-917437637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d700bf72-d725-43ee-8a47-3e3ecfe9650d" returned: 0 in 0.387s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:18:20 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-91dc76b7-1037-449e-a94a-bb479ad0fb52 tempest-DeleteServersTestJSON-917437637 None] <== create_volume: return (1272ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:18:20 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-91dc76b7-1037-449e-a94a-bb479ad0fb52 tempest-DeleteServersTestJSON-917437637 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.277s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:18:20 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-91dc76b7-1037-449e-a94a-bb479ad0fb52 tempest-DeleteServersTestJSON-917437637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b12705d-bf64-485f-86b1-5e61ca68261b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d700bf72-d725-43ee-8a47-3e3ecfe9650d', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:18:20 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-91dc76b7-1037-449e-a94a-bb479ad0fb52 tempest-DeleteServersTestJSON-917437637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0529ec78-3cd1-4d39-8b06-9cd4f477a01b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:18:20 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-91dc76b7-1037-449e-a94a-bb479ad0fb52 tempest-DeleteServersTestJSON-917437637 None] Volume volume-d700bf72-d725-43ee-8a47-3e3ecfe9650d (d700bf72-d725-43ee-8a47-3e3ecfe9650d): created successfully Sep 16 20:18:20 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-91dc76b7-1037-449e-a94a-bb479ad0fb52 tempest-DeleteServersTestJSON-917437637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0529ec78-3cd1-4d39-8b06-9cd4f477a01b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:18:20 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-91dc76b7-1037-449e-a94a-bb479ad0fb52 tempest-DeleteServersTestJSON-917437637 None] Flow 'volume_create_manager' (e0cc6d18-9240-4657-a307-dfcccf847f1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:18:20 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-91dc76b7-1037-449e-a94a-bb479ad0fb52 tempest-DeleteServersTestJSON-917437637 None] Created volume successfully. Sep 16 20:18:26 devstack cinder-volume[86188]: WARNING py.warnings [req-2dd625f5-afb8-49d6-89ed-dedd8c3a6977 req-4cccfee6-5e54-4805-aa21-a32ac79ed5cc tempest-DeleteServersTestJSON-917437637 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Sep 16 20:18:26 devstack cinder-volume[86188]: .first() Sep 16 20:18:26 devstack cinder-volume[86188]: Sep 16 20:18:26 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [req-2dd625f5-afb8-49d6-89ed-dedd8c3a6977 req-4cccfee6-5e54-4805-aa21-a32ac79ed5cc tempest-DeleteServersTestJSON-917437637 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:18:26 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [req-2dd625f5-afb8-49d6-89ed-dedd8c3a6977 req-4cccfee6-5e54-4805-aa21-a32ac79ed5cc tempest-DeleteServersTestJSON-917437637 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:18:26 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [req-2dd625f5-afb8-49d6-89ed-dedd8c3a6977 req-4cccfee6-5e54-4805-aa21-a32ac79ed5cc tempest-DeleteServersTestJSON-917437637 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:18:26 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [req-2dd625f5-afb8-49d6-89ed-dedd8c3a6977 req-4cccfee6-5e54-4805-aa21-a32ac79ed5cc tempest-DeleteServersTestJSON-917437637 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81', 'name': 'volume-d700bf72-d725-43ee-8a47-3e3ecfe9650d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cba666d8-f656-4845-ad01-ba7d987d20a1', 'enforce_multipath': True} {{(pid=86188) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 16 20:18:26 devstack cinder-volume[86188]: INFO cinder.volume.manager [req-2dd625f5-afb8-49d6-89ed-dedd8c3a6977 req-4cccfee6-5e54-4805-aa21-a32ac79ed5cc tempest-DeleteServersTestJSON-917437637 None] attachment_update completed successfully. Sep 16 20:18:31 devstack cinder-volume[86188]: INFO cinder.volume.manager [req-cac48dc1-3660-41d8-97dd-d58cb0a194f2 req-296a114a-3ad4-4bb1-bfc1-d2a4309d4910 tempest-DeleteServersTestJSON-917437637 None] Terminate volume connection completed successfully. Sep 16 20:18:31 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [req-cac48dc1-3660-41d8-97dd-d58cb0a194f2 req-296a114a-3ad4-4bb1-bfc1-d2a4309d4910 tempest-DeleteServersTestJSON-917437637 None] Deleting attachment cba666d8-f656-4845-ad01-ba7d987d20a1. {{(pid=86188) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 16 20:18:35 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-80bd8dbe-61c8-4c43-adc4-0de2395864ec tempest-VolumesAdminNegativeTest-1807932185 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:18:35 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-80bd8dbe-61c8-4c43-adc4-0de2395864ec tempest-VolumesAdminNegativeTest-1807932185 None] Flow 'volume_create_manager' (dadbb6f2-bf30-49fe-8849-e603dd59e156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:18:36 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-80bd8dbe-61c8-4c43-adc4-0de2395864ec tempest-VolumesAdminNegativeTest-1807932185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (959d122e-6687-4b3c-aa1d-335e2f967e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:18:36 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-80bd8dbe-61c8-4c43-adc4-0de2395864ec tempest-VolumesAdminNegativeTest-1807932185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (959d122e-6687-4b3c-aa1d-335e2f967e2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:18:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-3823481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80a34065-7e79-45c2-96c5-85be886bdab9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c1a7f3613c747a68d6eed424ed21c46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:18:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:18:36Z,use_quota=True,user_id='bcd0f75b564c4efc83dd59f30dd8f2ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:18:36 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-80bd8dbe-61c8-4c43-adc4-0de2395864ec tempest-VolumesAdminNegativeTest-1807932185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cef58f8-304c-4326-b6a6-88f85dad3915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:18:36 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-80bd8dbe-61c8-4c43-adc4-0de2395864ec tempest-VolumesAdminNegativeTest-1807932185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cef58f8-304c-4326-b6a6-88f85dad3915) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:18:36 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-80bd8dbe-61c8-4c43-adc4-0de2395864ec tempest-VolumesAdminNegativeTest-1807932185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4103eab6-79a6-4b19-9ecc-982053c3d2ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:18:36 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-80bd8dbe-61c8-4c43-adc4-0de2395864ec tempest-VolumesAdminNegativeTest-1807932185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4103eab6-79a6-4b19-9ecc-982053c3d2ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80a34065-7e79-45c2-96c5-85be886bdab9', 'volume_name': 'volume-80a34065-7e79-45c2-96c5-85be886bdab9', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:18:36 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-80bd8dbe-61c8-4c43-adc4-0de2395864ec tempest-VolumesAdminNegativeTest-1807932185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f320da9f-4372-4a09-abc0-821033520f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:18:36 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-80bd8dbe-61c8-4c43-adc4-0de2395864ec tempest-VolumesAdminNegativeTest-1807932185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f320da9f-4372-4a09-abc0-821033520f8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:18:36 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-80bd8dbe-61c8-4c43-adc4-0de2395864ec tempest-VolumesAdminNegativeTest-1807932185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7060f08a-3063-45d0-8ec2-907596854af9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:18:36 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-80bd8dbe-61c8-4c43-adc4-0de2395864ec tempest-VolumesAdminNegativeTest-1807932185 None] Volume 80a34065-7e79-45c2-96c5-85be886bdab9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80a34065-7e79-45c2-96c5-85be886bdab9', 'volume_size': 1} Sep 16 20:18:36 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-80bd8dbe-61c8-4c43-adc4-0de2395864ec tempest-VolumesAdminNegativeTest-1807932185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:18:36 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-80bd8dbe-61c8-4c43-adc4-0de2395864ec tempest-VolumesAdminNegativeTest-1807932185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:18:36 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-80bd8dbe-61c8-4c43-adc4-0de2395864ec tempest-VolumesAdminNegativeTest-1807932185 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:18:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-3823481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80a34065-7e79-45c2-96c5-85be886bdab9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c1a7f3613c747a68d6eed424ed21c46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:18:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:18:36Z,use_quota=True,user_id='bcd0f75b564c4efc83dd59f30dd8f2ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:18:36 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-80bd8dbe-61c8-4c43-adc4-0de2395864ec tempest-VolumesAdminNegativeTest-1807932185 None] Creating volume 80a34065-7e79-45c2-96c5-85be886bdab9 {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:18:36 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-80bd8dbe-61c8-4c43-adc4-0de2395864ec tempest-VolumesAdminNegativeTest-1807932185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:18:36 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-80bd8dbe-61c8-4c43-adc4-0de2395864ec tempest-VolumesAdminNegativeTest-1807932185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:18:36 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-80bd8dbe-61c8-4c43-adc4-0de2395864ec tempest-VolumesAdminNegativeTest-1807932185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:18:36 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-80bd8dbe-61c8-4c43-adc4-0de2395864ec tempest-VolumesAdminNegativeTest-1807932185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:18:36 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-80bd8dbe-61c8-4c43-adc4-0de2395864ec tempest-VolumesAdminNegativeTest-1807932185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:18:36 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-80bd8dbe-61c8-4c43-adc4-0de2395864ec tempest-VolumesAdminNegativeTest-1807932185 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:18:36 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-80bd8dbe-61c8-4c43-adc4-0de2395864ec tempest-VolumesAdminNegativeTest-1807932185 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:18:36 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-80bd8dbe-61c8-4c43-adc4-0de2395864ec tempest-VolumesAdminNegativeTest-1807932185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-80a34065-7e79-45c2-96c5-85be886bdab9 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:18:36 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-61451e0a-ab81-4e2c-96ff-126f8e2acb5a tempest-DeleteServersTestJSON-917437637 None] Acquiring lock "cinder-d700bf72-d725-43ee-8a47-3e3ecfe9650d-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:18:36 devstack sudo[87836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-80a34065-7e79-45c2-96c5-85be886bdab9 1073741824 Sep 16 20:18:36 devstack sudo[87836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:18:36 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-61451e0a-ab81-4e2c-96ff-126f8e2acb5a tempest-DeleteServersTestJSON-917437637 None] Lock "cinder-d700bf72-d725-43ee-8a47-3e3ecfe9650d-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:18:36 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-61451e0a-ab81-4e2c-96ff-126f8e2acb5a tempest-DeleteServersTestJSON-917437637 None] Acquiring lock "cinder-quobyte-d700bf72-d725-43ee-8a47-3e3ecfe9650d" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:18:36 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-61451e0a-ab81-4e2c-96ff-126f8e2acb5a tempest-DeleteServersTestJSON-917437637 None] Lock "cinder-quobyte-d700bf72-d725-43ee-8a47-3e3ecfe9650d" acquired by "delete_volume" :: waited 0.022s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:18:36 devstack cinder-volume[86188]: INFO oslo.privsep.daemon [None req-61451e0a-ab81-4e2c-96ff-126f8e2acb5a tempest-DeleteServersTestJSON-917437637 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp9wkaxiqf/privsep.sock'] Sep 16 20:18:36 devstack sudo[87838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp9wkaxiqf/privsep.sock Sep 16 20:18:36 devstack sudo[87838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:18:37 devstack sudo[87836]: pam_unix(sudo:session): session closed for user root Sep 16 20:18:37 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-80bd8dbe-61c8-4c43-adc4-0de2395864ec tempest-VolumesAdminNegativeTest-1807932185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-80a34065-7e79-45c2-96c5-85be886bdab9 1073741824" returned: 0 in 0.838s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:18:37 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-80bd8dbe-61c8-4c43-adc4-0de2395864ec tempest-VolumesAdminNegativeTest-1807932185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-80a34065-7e79-45c2-96c5-85be886bdab9 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:18:37 devstack sudo[87845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-80a34065-7e79-45c2-96c5-85be886bdab9 Sep 16 20:18:37 devstack sudo[87845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:18:37 devstack sudo[87845]: pam_unix(sudo:session): session closed for user root Sep 16 20:18:37 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-80bd8dbe-61c8-4c43-adc4-0de2395864ec tempest-VolumesAdminNegativeTest-1807932185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-80a34065-7e79-45c2-96c5-85be886bdab9" returned: 0 in 0.600s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:18:37 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-80bd8dbe-61c8-4c43-adc4-0de2395864ec tempest-VolumesAdminNegativeTest-1807932185 None] <== create_volume: return (1512ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:18:37 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-80bd8dbe-61c8-4c43-adc4-0de2395864ec tempest-VolumesAdminNegativeTest-1807932185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.516s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:18:37 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-80bd8dbe-61c8-4c43-adc4-0de2395864ec tempest-VolumesAdminNegativeTest-1807932185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7060f08a-3063-45d0-8ec2-907596854af9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80a34065-7e79-45c2-96c5-85be886bdab9', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:18:37 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-80bd8dbe-61c8-4c43-adc4-0de2395864ec tempest-VolumesAdminNegativeTest-1807932185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b64a2c8d-b990-446d-a025-8ae5c1ae240c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:18:37 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-80bd8dbe-61c8-4c43-adc4-0de2395864ec tempest-VolumesAdminNegativeTest-1807932185 None] Volume volume-80a34065-7e79-45c2-96c5-85be886bdab9 (80a34065-7e79-45c2-96c5-85be886bdab9): created successfully Sep 16 20:18:37 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-80bd8dbe-61c8-4c43-adc4-0de2395864ec tempest-VolumesAdminNegativeTest-1807932185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b64a2c8d-b990-446d-a025-8ae5c1ae240c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:18:37 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-80bd8dbe-61c8-4c43-adc4-0de2395864ec tempest-VolumesAdminNegativeTest-1807932185 None] Flow 'volume_create_manager' (dadbb6f2-bf30-49fe-8849-e603dd59e156) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:18:37 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-80bd8dbe-61c8-4c43-adc4-0de2395864ec tempest-VolumesAdminNegativeTest-1807932185 None] Created volume successfully. Sep 16 20:18:38 devstack cinder-volume[86188]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 16 20:18:38 devstack cinder-volume[86188]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 16 20:18:38 devstack cinder-volume[86188]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 16 20:18:38 devstack cinder-volume[86188]: WARNING oslo.privsep.daemon [-] privsep log: Sep 16 20:18:38 devstack cinder-volume[86188]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 16 20:18:38 devstack cinder-volume[86188]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 16 20:18:38 devstack cinder-volume[86188]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 16 20:18:38 devstack cinder-volume[86188]: WARNING oslo.privsep.daemon [-] privsep log: Sep 16 20:18:38 devstack cinder-volume[86188]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 16 20:18:38 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-28c8a2d1-da1b-4f56-b058-5d045aa31236 tempest-VolumesAdminNegativeTest-1807932185 None] Acquiring lock "cinder-80a34065-7e79-45c2-96c5-85be886bdab9-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:18:38 devstack sudo[87838]: pam_unix(sudo:session): session closed for user root Sep 16 20:18:38 devstack cinder-volume[86188]: INFO oslo.privsep.daemon [None req-61451e0a-ab81-4e2c-96ff-126f8e2acb5a tempest-DeleteServersTestJSON-917437637 None] Spawned new privsep daemon via rootwrap Sep 16 20:18:38 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [None req-61451e0a-ab81-4e2c-96ff-126f8e2acb5a tempest-DeleteServersTestJSON-917437637 None] Accepted privsep connection to /tmp/tmp9wkaxiqf/privsep.sock {{(pid=86188) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 16 20:18:38 devstack cinder-volume[86188]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 16 20:18:38 devstack cinder-volume[86188]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 16 20:18:38 devstack cinder-volume[86188]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 16 20:18:38 devstack cinder-volume[86188]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 87849 Sep 16 20:18:38 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[30495a13-1fd2-46ae-b5c7-57fc17a3524e]: (2,) {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:18:38 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-28c8a2d1-da1b-4f56-b058-5d045aa31236 tempest-VolumesAdminNegativeTest-1807932185 None] Lock "cinder-80a34065-7e79-45c2-96c5-85be886bdab9-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:18:38 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae430935-390e-4e2b-a0bd-86cfa50b9132]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:18:38 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-61451e0a-ab81-4e2c-96ff-126f8e2acb5a tempest-DeleteServersTestJSON-917437637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d700bf72-d725-43ee-8a47-3e3ecfe9650d {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:18:38 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-28c8a2d1-da1b-4f56-b058-5d045aa31236 tempest-VolumesAdminNegativeTest-1807932185 None] Acquiring lock "cinder-quobyte-80a34065-7e79-45c2-96c5-85be886bdab9" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:18:39 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-28c8a2d1-da1b-4f56-b058-5d045aa31236 tempest-VolumesAdminNegativeTest-1807932185 None] Lock "cinder-quobyte-80a34065-7e79-45c2-96c5-85be886bdab9" acquired by "delete_volume" :: waited 0.067s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:18:39 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ce60dea-5d39-4cec-a25d-7671b7a261df]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:18:39 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-28c8a2d1-da1b-4f56-b058-5d045aa31236 tempest-VolumesAdminNegativeTest-1807932185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-80a34065-7e79-45c2-96c5-85be886bdab9 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:18:39 devstack sudo[87852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d700bf72-d725-43ee-8a47-3e3ecfe9650d Sep 16 20:18:39 devstack sudo[87852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:18:39 devstack sudo[87853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-80a34065-7e79-45c2-96c5-85be886bdab9 Sep 16 20:18:39 devstack sudo[87853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:18:39 devstack sudo[87852]: pam_unix(sudo:session): session closed for user root Sep 16 20:18:39 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-61451e0a-ab81-4e2c-96ff-126f8e2acb5a tempest-DeleteServersTestJSON-917437637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d700bf72-d725-43ee-8a47-3e3ecfe9650d" returned: 0 in 0.854s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:18:39 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-61451e0a-ab81-4e2c-96ff-126f8e2acb5a tempest-DeleteServersTestJSON-917437637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d700bf72-d725-43ee-8a47-3e3ecfe9650d {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:18:39 devstack sudo[87862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d700bf72-d725-43ee-8a47-3e3ecfe9650d Sep 16 20:18:39 devstack sudo[87862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:18:39 devstack sudo[87853]: pam_unix(sudo:session): session closed for user root Sep 16 20:18:39 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-28c8a2d1-da1b-4f56-b058-5d045aa31236 tempest-VolumesAdminNegativeTest-1807932185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-80a34065-7e79-45c2-96c5-85be886bdab9" returned: 0 in 0.791s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:18:39 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-28c8a2d1-da1b-4f56-b058-5d045aa31236 tempest-VolumesAdminNegativeTest-1807932185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-80a34065-7e79-45c2-96c5-85be886bdab9 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:18:39 devstack sudo[87865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-80a34065-7e79-45c2-96c5-85be886bdab9 Sep 16 20:18:39 devstack sudo[87865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:18:40 devstack sudo[87865]: pam_unix(sudo:session): session closed for user root Sep 16 20:18:40 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-28c8a2d1-da1b-4f56-b058-5d045aa31236 tempest-VolumesAdminNegativeTest-1807932185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-80a34065-7e79-45c2-96c5-85be886bdab9" returned: 0 in 0.490s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:18:40 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-28c8a2d1-da1b-4f56-b058-5d045aa31236 tempest-VolumesAdminNegativeTest-1807932185 None] Lock "cinder-quobyte-80a34065-7e79-45c2-96c5-85be886bdab9" released by "delete_volume" :: held 1.373s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:18:40 devstack sudo[87862]: pam_unix(sudo:session): session closed for user root Sep 16 20:18:40 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-61451e0a-ab81-4e2c-96ff-126f8e2acb5a tempest-DeleteServersTestJSON-917437637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d700bf72-d725-43ee-8a47-3e3ecfe9650d" returned: 0 in 0.711s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:18:40 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-61451e0a-ab81-4e2c-96ff-126f8e2acb5a tempest-DeleteServersTestJSON-917437637 None] Lock "cinder-quobyte-d700bf72-d725-43ee-8a47-3e3ecfe9650d" released by "delete_volume" :: held 4.092s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:18:40 devstack cinder-volume[86188]: WARNING cinder.quota [None req-28c8a2d1-da1b-4f56-b058-5d045aa31236 tempest-VolumesAdminNegativeTest-1807932185 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 16 20:18:40 devstack cinder-volume[86188]: WARNING cinder.quota [None req-28c8a2d1-da1b-4f56-b058-5d045aa31236 tempest-VolumesAdminNegativeTest-1807932185 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 16 20:18:40 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-28c8a2d1-da1b-4f56-b058-5d045aa31236 tempest-VolumesAdminNegativeTest-1807932185 None] Created reservations ['73aa7158-a7b6-4ea7-99c4-a776446f97fa', '55e9ad45-1b05-4f30-97f7-e98845f4338d', '6e080cfc-933c-4e21-808d-a5cb1ee6a74d', 'dd0b33bf-21c4-4f49-9744-1636a8934ad8'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:18:40 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-61451e0a-ab81-4e2c-96ff-126f8e2acb5a tempest-DeleteServersTestJSON-917437637 None] Created reservations ['78ad1ecf-91e4-4ea4-9f8f-7b28b7a35fa3', '05cdedd3-c215-4076-bfeb-7370ee37ad40', '6648a408-6275-4ea9-a103-e47e7f4896dc', '423ea828-f1d2-4590-a624-f551a596ad90'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:18:40 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-28c8a2d1-da1b-4f56-b058-5d045aa31236 tempest-VolumesAdminNegativeTest-1807932185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:18:40 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-28c8a2d1-da1b-4f56-b058-5d045aa31236 tempest-VolumesAdminNegativeTest-1807932185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:18:40 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-28c8a2d1-da1b-4f56-b058-5d045aa31236 tempest-VolumesAdminNegativeTest-1807932185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:18:40 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-28c8a2d1-da1b-4f56-b058-5d045aa31236 tempest-VolumesAdminNegativeTest-1807932185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:18:40 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-28c8a2d1-da1b-4f56-b058-5d045aa31236 tempest-VolumesAdminNegativeTest-1807932185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:18:40 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-28c8a2d1-da1b-4f56-b058-5d045aa31236 tempest-VolumesAdminNegativeTest-1807932185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:18:40 devstack sudo[87871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:18:40 devstack sudo[87871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:18:40 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-61451e0a-ab81-4e2c-96ff-126f8e2acb5a tempest-DeleteServersTestJSON-917437637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:18:40 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-61451e0a-ab81-4e2c-96ff-126f8e2acb5a tempest-DeleteServersTestJSON-917437637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:18:40 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-61451e0a-ab81-4e2c-96ff-126f8e2acb5a tempest-DeleteServersTestJSON-917437637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:18:40 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-61451e0a-ab81-4e2c-96ff-126f8e2acb5a tempest-DeleteServersTestJSON-917437637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:18:40 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-61451e0a-ab81-4e2c-96ff-126f8e2acb5a tempest-DeleteServersTestJSON-917437637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:18:40 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-61451e0a-ab81-4e2c-96ff-126f8e2acb5a tempest-DeleteServersTestJSON-917437637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:18:41 devstack sudo[87874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:18:41 devstack sudo[87874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:18:41 devstack sudo[87874]: pam_unix(sudo:session): session closed for user root Sep 16 20:18:41 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-61451e0a-ab81-4e2c-96ff-126f8e2acb5a tempest-DeleteServersTestJSON-917437637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.506s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:18:41 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-61451e0a-ab81-4e2c-96ff-126f8e2acb5a tempest-DeleteServersTestJSON-917437637 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:18:41 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-61451e0a-ab81-4e2c-96ff-126f8e2acb5a tempest-DeleteServersTestJSON-917437637 None] Deleted volume successfully. Sep 16 20:18:41 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-61451e0a-ab81-4e2c-96ff-126f8e2acb5a tempest-DeleteServersTestJSON-917437637 None] Lock "cinder-d700bf72-d725-43ee-8a47-3e3ecfe9650d-delete_volume" released by "delete_volume" :: held 5.208s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:18:41 devstack sudo[87871]: pam_unix(sudo:session): session closed for user root Sep 16 20:18:41 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-28c8a2d1-da1b-4f56-b058-5d045aa31236 tempest-VolumesAdminNegativeTest-1807932185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.829s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:18:41 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-28c8a2d1-da1b-4f56-b058-5d045aa31236 tempest-VolumesAdminNegativeTest-1807932185 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:18:41 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-28c8a2d1-da1b-4f56-b058-5d045aa31236 tempest-VolumesAdminNegativeTest-1807932185 None] Deleted volume successfully. Sep 16 20:18:41 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-28c8a2d1-da1b-4f56-b058-5d045aa31236 tempest-VolumesAdminNegativeTest-1807932185 None] Lock "cinder-80a34065-7e79-45c2-96c5-85be886bdab9-delete_volume" released by "delete_volume" :: held 2.888s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:18:48 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-a69ddc85-d40d-4ed2-bb12-48e446bbafb6 tempest-GroupSnapshotsTest-343869671 None] Group tempest-GroupSnapshotsTest-Group-1759051521: creating Sep 16 20:18:48 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-a69ddc85-d40d-4ed2-bb12-48e446bbafb6 tempest-GroupSnapshotsTest-343869671 None] Group tempest-GroupSnapshotsTest-Group-1759051521: created successfully Sep 16 20:18:48 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-a69ddc85-d40d-4ed2-bb12-48e446bbafb6 tempest-GroupSnapshotsTest-343869671 None] Create group completed successfully. Sep 16 20:18:50 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecd9308f-3581-44cc-94cd-4384c924747f tempest-GroupSnapshotsTest-343869671 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:18:50 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ecd9308f-3581-44cc-94cd-4384c924747f tempest-GroupSnapshotsTest-343869671 None] Flow 'volume_create_manager' (2a195207-7b9c-4277-9167-a5b23a47ba50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:18:50 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ecd9308f-3581-44cc-94cd-4384c924747f tempest-GroupSnapshotsTest-343869671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd5194bc-7ba0-44e5-8dcb-a71f8e499de9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:18:50 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ecd9308f-3581-44cc-94cd-4384c924747f tempest-GroupSnapshotsTest-343869671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd5194bc-7ba0-44e5-8dcb-a71f8e499de9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:18:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1872962394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=999a3bdb-9463-406c-b0c2-72bbc944aa72,host='devstack@QuobyteHD#QuobyteHD',id=b7c53e27-c3ed-44ff-9ed9-f9ee9bd66b7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='534482648c0a44eca02903f01ab2a59f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:18:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:18:51Z,use_quota=True,user_id='737c8364b2ac4d61aa1565d88d58cf84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15c7aa9f-ef2f-4b3f-9679-528273e447ab),volume_type_id=15c7aa9f-ef2f-4b3f-9679-528273e447ab)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:18:50 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ecd9308f-3581-44cc-94cd-4384c924747f tempest-GroupSnapshotsTest-343869671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc0b42ad-6fbf-46ad-b74c-a29637ea0915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:18:50 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ecd9308f-3581-44cc-94cd-4384c924747f tempest-GroupSnapshotsTest-343869671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc0b42ad-6fbf-46ad-b74c-a29637ea0915) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:18:50 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ecd9308f-3581-44cc-94cd-4384c924747f tempest-GroupSnapshotsTest-343869671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ba79a04-b8de-4a54-b597-caf04f11a663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:18:50 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ecd9308f-3581-44cc-94cd-4384c924747f tempest-GroupSnapshotsTest-343869671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ba79a04-b8de-4a54-b597-caf04f11a663) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7c53e27-c3ed-44ff-9ed9-f9ee9bd66b7e', 'volume_name': 'volume-b7c53e27-c3ed-44ff-9ed9-f9ee9bd66b7e', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:18:50 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ecd9308f-3581-44cc-94cd-4384c924747f tempest-GroupSnapshotsTest-343869671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2807e14b-18bd-4a01-ad29-aaa5d1b8d2d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:18:50 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ecd9308f-3581-44cc-94cd-4384c924747f tempest-GroupSnapshotsTest-343869671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2807e14b-18bd-4a01-ad29-aaa5d1b8d2d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:18:50 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ecd9308f-3581-44cc-94cd-4384c924747f tempest-GroupSnapshotsTest-343869671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99f2381f-0464-4384-b0e7-e0dd0a45783b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:18:50 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-ecd9308f-3581-44cc-94cd-4384c924747f tempest-GroupSnapshotsTest-343869671 None] Volume b7c53e27-c3ed-44ff-9ed9-f9ee9bd66b7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7c53e27-c3ed-44ff-9ed9-f9ee9bd66b7e', 'volume_size': 1} Sep 16 20:18:50 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-ecd9308f-3581-44cc-94cd-4384c924747f tempest-GroupSnapshotsTest-343869671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:18:50 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-ecd9308f-3581-44cc-94cd-4384c924747f tempest-GroupSnapshotsTest-343869671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:18:50 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-ecd9308f-3581-44cc-94cd-4384c924747f tempest-GroupSnapshotsTest-343869671 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=999a3bdb-9463-406c-b0c2-72bbc944aa72,created_at=2026-09-16T18:18:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1872962394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=999a3bdb-9463-406c-b0c2-72bbc944aa72,host='devstack@QuobyteHD#QuobyteHD',id=b7c53e27-c3ed-44ff-9ed9-f9ee9bd66b7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='534482648c0a44eca02903f01ab2a59f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:18:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:18:51Z,use_quota=True,user_id='737c8364b2ac4d61aa1565d88d58cf84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15c7aa9f-ef2f-4b3f-9679-528273e447ab),volume_type_id=15c7aa9f-ef2f-4b3f-9679-528273e447ab)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:18:50 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-ecd9308f-3581-44cc-94cd-4384c924747f tempest-GroupSnapshotsTest-343869671 None] Creating volume b7c53e27-c3ed-44ff-9ed9-f9ee9bd66b7e {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:18:50 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-ecd9308f-3581-44cc-94cd-4384c924747f tempest-GroupSnapshotsTest-343869671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:18:50 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-ecd9308f-3581-44cc-94cd-4384c924747f tempest-GroupSnapshotsTest-343869671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:18:50 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-ecd9308f-3581-44cc-94cd-4384c924747f tempest-GroupSnapshotsTest-343869671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:18:50 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-ecd9308f-3581-44cc-94cd-4384c924747f tempest-GroupSnapshotsTest-343869671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:18:50 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-ecd9308f-3581-44cc-94cd-4384c924747f tempest-GroupSnapshotsTest-343869671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:18:50 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-ecd9308f-3581-44cc-94cd-4384c924747f tempest-GroupSnapshotsTest-343869671 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:18:50 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-ecd9308f-3581-44cc-94cd-4384c924747f tempest-GroupSnapshotsTest-343869671 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:18:50 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ecd9308f-3581-44cc-94cd-4384c924747f tempest-GroupSnapshotsTest-343869671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b7c53e27-c3ed-44ff-9ed9-f9ee9bd66b7e 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:18:50 devstack sudo[87948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b7c53e27-c3ed-44ff-9ed9-f9ee9bd66b7e 1073741824 Sep 16 20:18:50 devstack sudo[87948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:18:51 devstack sudo[87948]: pam_unix(sudo:session): session closed for user root Sep 16 20:18:51 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ecd9308f-3581-44cc-94cd-4384c924747f tempest-GroupSnapshotsTest-343869671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b7c53e27-c3ed-44ff-9ed9-f9ee9bd66b7e 1073741824" returned: 0 in 0.608s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:18:51 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ecd9308f-3581-44cc-94cd-4384c924747f tempest-GroupSnapshotsTest-343869671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b7c53e27-c3ed-44ff-9ed9-f9ee9bd66b7e {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:18:51 devstack sudo[87957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b7c53e27-c3ed-44ff-9ed9-f9ee9bd66b7e Sep 16 20:18:51 devstack sudo[87957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:18:51 devstack sudo[87957]: pam_unix(sudo:session): session closed for user root Sep 16 20:18:51 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ecd9308f-3581-44cc-94cd-4384c924747f tempest-GroupSnapshotsTest-343869671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b7c53e27-c3ed-44ff-9ed9-f9ee9bd66b7e" returned: 0 in 0.321s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:18:51 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-ecd9308f-3581-44cc-94cd-4384c924747f tempest-GroupSnapshotsTest-343869671 None] <== create_volume: return (992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:18:51 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-ecd9308f-3581-44cc-94cd-4384c924747f tempest-GroupSnapshotsTest-343869671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.997s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:18:51 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ecd9308f-3581-44cc-94cd-4384c924747f tempest-GroupSnapshotsTest-343869671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99f2381f-0464-4384-b0e7-e0dd0a45783b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7c53e27-c3ed-44ff-9ed9-f9ee9bd66b7e', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:18:51 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ecd9308f-3581-44cc-94cd-4384c924747f tempest-GroupSnapshotsTest-343869671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6a2fd2f-9f9b-495e-ac7a-f7d6155b7f49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:18:51 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-ecd9308f-3581-44cc-94cd-4384c924747f tempest-GroupSnapshotsTest-343869671 None] Volume volume-b7c53e27-c3ed-44ff-9ed9-f9ee9bd66b7e (b7c53e27-c3ed-44ff-9ed9-f9ee9bd66b7e): created successfully Sep 16 20:18:51 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ecd9308f-3581-44cc-94cd-4384c924747f tempest-GroupSnapshotsTest-343869671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6a2fd2f-9f9b-495e-ac7a-f7d6155b7f49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:18:51 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ecd9308f-3581-44cc-94cd-4384c924747f tempest-GroupSnapshotsTest-343869671 None] Flow 'volume_create_manager' (2a195207-7b9c-4277-9167-a5b23a47ba50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:18:51 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-ecd9308f-3581-44cc-94cd-4384c924747f tempest-GroupSnapshotsTest-343869671 None] Created volume successfully. Sep 16 20:18:52 devstack cinder-volume[86188]: DEBUG oslo_service.periodic_task [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86188) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 20:18:52 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:18:52 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:18:52 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:18:52 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:18:52 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:18:52 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:18:53 devstack sudo[87986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:18:53 devstack sudo[87986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:18:53 devstack sudo[87986]: pam_unix(sudo:session): session closed for user root Sep 16 20:18:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.288s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:18:53 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:18:53 devstack cinder-volume[86188]: DEBUG oslo_service.periodic_task [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Running periodic task VolumeManager._thread_info {{(pid=86188) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 20:18:53 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] thread count: 8 {{(pid=86188) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 16 20:18:53 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] thread info: [<_MainThread(MainThread, started 139858124406912)>, , , , , , , ] {{(pid=86188) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 16 20:18:53 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-7beb9661-5c2d-4983-b969-da169cc2980a tempest-GroupSnapshotsTest-343869671 None] GroupSnapshot c44f5059-dee7-43ae-b638-868658ea9b2d: creating. Sep 16 20:18:53 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-7beb9661-5c2d-4983-b969-da169cc2980a tempest-GroupSnapshotsTest-343869671 None] Group snapshot c44f5059-dee7-43ae-b638-868658ea9b2d: creating. {{(pid=86188) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 16 20:18:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-7beb9661-5c2d-4983-b969-da169cc2980a tempest-GroupSnapshotsTest-343869671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:18:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-7beb9661-5c2d-4983-b969-da169cc2980a tempest-GroupSnapshotsTest-343869671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:18:53 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-7beb9661-5c2d-4983-b969-da169cc2980a tempest-GroupSnapshotsTest-343869671 None] Creating offline snapshot c6442f51-e636-430d-8483-eaa60bd0af7f of volume b7c53e27-c3ed-44ff-9ed9-f9ee9bd66b7e {{(pid=86188) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 20:18:53 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8ec5002-6ae3-40ed-9967-da8728b6ad3a]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:18:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-7beb9661-5c2d-4983-b969-da169cc2980a tempest-GroupSnapshotsTest-343869671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b7c53e27-c3ed-44ff-9ed9-f9ee9bd66b7e {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:18:53 devstack sudo[87990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b7c53e27-c3ed-44ff-9ed9-f9ee9bd66b7e Sep 16 20:18:53 devstack sudo[87990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:18:54 devstack sudo[87990]: pam_unix(sudo:session): session closed for user root Sep 16 20:18:54 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-7beb9661-5c2d-4983-b969-da169cc2980a tempest-GroupSnapshotsTest-343869671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b7c53e27-c3ed-44ff-9ed9-f9ee9bd66b7e" returned: 0 in 0.456s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:18:54 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-7beb9661-5c2d-4983-b969-da169cc2980a tempest-GroupSnapshotsTest-343869671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b7c53e27-c3ed-44ff-9ed9-f9ee9bd66b7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b7c53e27-c3ed-44ff-9ed9-f9ee9bd66b7e.c6442f51-e636-430d-8483-eaa60bd0af7f 1G {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:18:54 devstack sudo[87995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b7c53e27-c3ed-44ff-9ed9-f9ee9bd66b7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b7c53e27-c3ed-44ff-9ed9-f9ee9bd66b7e.c6442f51-e636-430d-8483-eaa60bd0af7f 1G Sep 16 20:18:54 devstack sudo[87995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:18:54 devstack sudo[87995]: pam_unix(sudo:session): session closed for user root Sep 16 20:18:54 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-7beb9661-5c2d-4983-b969-da169cc2980a tempest-GroupSnapshotsTest-343869671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b7c53e27-c3ed-44ff-9ed9-f9ee9bd66b7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b7c53e27-c3ed-44ff-9ed9-f9ee9bd66b7e.c6442f51-e636-430d-8483-eaa60bd0af7f 1G" returned: 0 in 0.484s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:18:54 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-7beb9661-5c2d-4983-b969-da169cc2980a tempest-GroupSnapshotsTest-343869671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7c53e27-c3ed-44ff-9ed9-f9ee9bd66b7e -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b7c53e27-c3ed-44ff-9ed9-f9ee9bd66b7e.c6442f51-e636-430d-8483-eaa60bd0af7f {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:18:54 devstack sudo[88001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7c53e27-c3ed-44ff-9ed9-f9ee9bd66b7e -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b7c53e27-c3ed-44ff-9ed9-f9ee9bd66b7e.c6442f51-e636-430d-8483-eaa60bd0af7f Sep 16 20:18:54 devstack sudo[88001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:18:55 devstack sudo[88001]: pam_unix(sudo:session): session closed for user root Sep 16 20:18:55 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-7beb9661-5c2d-4983-b969-da169cc2980a tempest-GroupSnapshotsTest-343869671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7c53e27-c3ed-44ff-9ed9-f9ee9bd66b7e -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b7c53e27-c3ed-44ff-9ed9-f9ee9bd66b7e.c6442f51-e636-430d-8483-eaa60bd0af7f" returned: 0 in 0.296s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:18:55 devstack cinder-volume[86188]: WARNING cinder.volume.drivers.remotefs [None req-7beb9661-5c2d-4983-b969-da169cc2980a tempest-GroupSnapshotsTest-343869671 None] /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b7c53e27-c3ed-44ff-9ed9-f9ee9bd66b7e.c6442f51-e636-430d-8483-eaa60bd0af7f is being set with open permissions: ugo+rw: NotImplementedError Sep 16 20:18:55 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-7beb9661-5c2d-4983-b969-da169cc2980a tempest-GroupSnapshotsTest-343869671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b7c53e27-c3ed-44ff-9ed9-f9ee9bd66b7e.c6442f51-e636-430d-8483-eaa60bd0af7f {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:18:55 devstack sudo[88006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b7c53e27-c3ed-44ff-9ed9-f9ee9bd66b7e.c6442f51-e636-430d-8483-eaa60bd0af7f Sep 16 20:18:55 devstack sudo[88006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:18:55 devstack sudo[88006]: pam_unix(sudo:session): session closed for user root Sep 16 20:18:55 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-7beb9661-5c2d-4983-b969-da169cc2980a tempest-GroupSnapshotsTest-343869671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b7c53e27-c3ed-44ff-9ed9-f9ee9bd66b7e.c6442f51-e636-430d-8483-eaa60bd0af7f" returned: 0 in 0.259s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:18:55 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-7beb9661-5c2d-4983-b969-da169cc2980a tempest-GroupSnapshotsTest-343869671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b7c53e27-c3ed-44ff-9ed9-f9ee9bd66b7e.info {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:18:55 devstack sudo[88009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b7c53e27-c3ed-44ff-9ed9-f9ee9bd66b7e.info Sep 16 20:18:55 devstack sudo[88009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:18:55 devstack sudo[88009]: pam_unix(sudo:session): session closed for user root Sep 16 20:18:55 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-7beb9661-5c2d-4983-b969-da169cc2980a tempest-GroupSnapshotsTest-343869671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b7c53e27-c3ed-44ff-9ed9-f9ee9bd66b7e.info" returned: 0 in 0.316s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:18:55 devstack cinder-volume[86188]: WARNING cinder.volume.drivers.remotefs [None req-7beb9661-5c2d-4983-b969-da169cc2980a tempest-GroupSnapshotsTest-343869671 None] /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b7c53e27-c3ed-44ff-9ed9-f9ee9bd66b7e.info is being set with open permissions: ugo+rw: NotImplementedError Sep 16 20:18:55 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-7beb9661-5c2d-4983-b969-da169cc2980a tempest-GroupSnapshotsTest-343869671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b7c53e27-c3ed-44ff-9ed9-f9ee9bd66b7e.info {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:18:55 devstack sudo[88012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b7c53e27-c3ed-44ff-9ed9-f9ee9bd66b7e.info Sep 16 20:18:55 devstack sudo[88012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:18:56 devstack sudo[88012]: pam_unix(sudo:session): session closed for user root Sep 16 20:18:56 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-7beb9661-5c2d-4983-b969-da169cc2980a tempest-GroupSnapshotsTest-343869671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b7c53e27-c3ed-44ff-9ed9-f9ee9bd66b7e.info" returned: 0 in 0.274s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:18:56 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-7beb9661-5c2d-4983-b969-da169cc2980a tempest-GroupSnapshotsTest-343869671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.177s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:18:56 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-7beb9661-5c2d-4983-b969-da169cc2980a tempest-GroupSnapshotsTest-343869671 None] group_snapshot c44f5059-dee7-43ae-b638-868658ea9b2d: created successfully Sep 16 20:18:58 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-ced8f166-d89a-4036-bb98-6be1be375252 tempest-GroupSnapshotsTest-343869671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:18:58 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-ced8f166-d89a-4036-bb98-6be1be375252 tempest-GroupSnapshotsTest-343869671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:18:58 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-ced8f166-d89a-4036-bb98-6be1be375252 tempest-GroupSnapshotsTest-343869671 None] Acquiring lock "cinder-quobyte-c6442f51-e636-430d-8483-eaa60bd0af7f-4a6cb0be-0825-4200-a68d-d6dfb6f656f6" by "_create_volume_from_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:18:58 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-ced8f166-d89a-4036-bb98-6be1be375252 tempest-GroupSnapshotsTest-343869671 None] Lock "cinder-quobyte-c6442f51-e636-430d-8483-eaa60bd0af7f-4a6cb0be-0825-4200-a68d-d6dfb6f656f6" acquired by "_create_volume_from_snapshot" :: waited 0.030s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:18:58 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-ced8f166-d89a-4036-bb98-6be1be375252 tempest-GroupSnapshotsTest-343869671 None] Creating volume 4a6cb0be-0825-4200-a68d-d6dfb6f656f6 from snapshot c6442f51-e636-430d-8483-eaa60bd0af7f {{(pid=86188) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 16 20:18:58 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-ced8f166-d89a-4036-bb98-6be1be375252 tempest-GroupSnapshotsTest-343869671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:18:58 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-ced8f166-d89a-4036-bb98-6be1be375252 tempest-GroupSnapshotsTest-343869671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:18:58 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-ced8f166-d89a-4036-bb98-6be1be375252 tempest-GroupSnapshotsTest-343869671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:18:58 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-ced8f166-d89a-4036-bb98-6be1be375252 tempest-GroupSnapshotsTest-343869671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:18:58 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-ced8f166-d89a-4036-bb98-6be1be375252 tempest-GroupSnapshotsTest-343869671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:18:58 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-ced8f166-d89a-4036-bb98-6be1be375252 tempest-GroupSnapshotsTest-343869671 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:18:58 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-ced8f166-d89a-4036-bb98-6be1be375252 tempest-GroupSnapshotsTest-343869671 None] Acquiring lock "cinder-quobyte-4a6cb0be-0825-4200-a68d-d6dfb6f656f6" by "_copy_volume_from_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:18:58 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-ced8f166-d89a-4036-bb98-6be1be375252 tempest-GroupSnapshotsTest-343869671 None] Lock "cinder-quobyte-4a6cb0be-0825-4200-a68d-d6dfb6f656f6" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:18:58 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-ced8f166-d89a-4036-bb98-6be1be375252 tempest-GroupSnapshotsTest-343869671 None] snapshot: c6442f51-e636-430d-8483-eaa60bd0af7f, volume: 4a6cb0be-0825-4200-a68d-d6dfb6f656f6, {{(pid=86188) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 16 20:18:58 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-ced8f166-d89a-4036-bb98-6be1be375252 tempest-GroupSnapshotsTest-343869671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:18:58 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-ced8f166-d89a-4036-bb98-6be1be375252 tempest-GroupSnapshotsTest-343869671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:18:58 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-ced8f166-d89a-4036-bb98-6be1be375252 tempest-GroupSnapshotsTest-343869671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:18:58 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-ced8f166-d89a-4036-bb98-6be1be375252 tempest-GroupSnapshotsTest-343869671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:18:58 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-ced8f166-d89a-4036-bb98-6be1be375252 tempest-GroupSnapshotsTest-343869671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:18:58 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[773a826f-28bd-4e29-9542-96cd1db14a5e]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:18:58 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ced8f166-d89a-4036-bb98-6be1be375252 tempest-GroupSnapshotsTest-343869671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b7c53e27-c3ed-44ff-9ed9-f9ee9bd66b7e.c6442f51-e636-430d-8483-eaa60bd0af7f {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:18:58 devstack sudo[88018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b7c53e27-c3ed-44ff-9ed9-f9ee9bd66b7e.c6442f51-e636-430d-8483-eaa60bd0af7f Sep 16 20:18:58 devstack sudo[88018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:18:58 devstack sudo[88018]: pam_unix(sudo:session): session closed for user root Sep 16 20:18:58 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ced8f166-d89a-4036-bb98-6be1be375252 tempest-GroupSnapshotsTest-343869671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b7c53e27-c3ed-44ff-9ed9-f9ee9bd66b7e.c6442f51-e636-430d-8483-eaa60bd0af7f" returned: 0 in 0.510s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:18:58 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-ced8f166-d89a-4036-bb98-6be1be375252 tempest-GroupSnapshotsTest-343869671 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b7c53e27-c3ed-44ff-9ed9-f9ee9bd66b7e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86188) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 20:18:58 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e0af1dd-6db3-447d-86bd-89174f9b53e4]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:18:58 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ced8f166-d89a-4036-bb98-6be1be375252 tempest-GroupSnapshotsTest-343869671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b7c53e27-c3ed-44ff-9ed9-f9ee9bd66b7e {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:18:59 devstack sudo[88025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b7c53e27-c3ed-44ff-9ed9-f9ee9bd66b7e Sep 16 20:18:59 devstack sudo[88025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:18:59 devstack sudo[88025]: pam_unix(sudo:session): session closed for user root Sep 16 20:18:59 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ced8f166-d89a-4036-bb98-6be1be375252 tempest-GroupSnapshotsTest-343869671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b7c53e27-c3ed-44ff-9ed9-f9ee9bd66b7e" returned: 0 in 0.487s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:18:59 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-ced8f166-d89a-4036-bb98-6be1be375252 tempest-GroupSnapshotsTest-343869671 None] will copy from snapshot at /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b7c53e27-c3ed-44ff-9ed9-f9ee9bd66b7e {{(pid=86188) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 16 20:18:59 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-ced8f166-d89a-4036-bb98-6be1be375252 tempest-GroupSnapshotsTest-343869671 None] Creating direct copy from snapshot {{(pid=86188) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 16 20:18:59 devstack cinder-volume[86188]: DEBUG cinder.utils [None req-ced8f166-d89a-4036-bb98-6be1be375252 tempest-GroupSnapshotsTest-343869671 None] Path /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-4a6cb0be-0825-4200-a68d-d6dfb6f656f6 not found in is_blk_device check {{(pid=86188) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 16 20:18:59 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ced8f166-d89a-4036-bb98-6be1be375252 tempest-GroupSnapshotsTest-343869671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b7c53e27-c3ed-44ff-9ed9-f9ee9bd66b7e /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-4a6cb0be-0825-4200-a68d-d6dfb6f656f6 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:18:59 devstack sudo[88030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b7c53e27-c3ed-44ff-9ed9-f9ee9bd66b7e /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-4a6cb0be-0825-4200-a68d-d6dfb6f656f6 Sep 16 20:18:59 devstack sudo[88030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:19:08 devstack sudo[88030]: pam_unix(sudo:session): session closed for user root Sep 16 20:19:08 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ced8f166-d89a-4036-bb98-6be1be375252 tempest-GroupSnapshotsTest-343869671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b7c53e27-c3ed-44ff-9ed9-f9ee9bd66b7e /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-4a6cb0be-0825-4200-a68d-d6dfb6f656f6" returned: 0 in 9.275s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:19:08 devstack cinder-volume[86188]: DEBUG cinder.image.image_utils [None req-ced8f166-d89a-4036-bb98-6be1be375252 tempest-GroupSnapshotsTest-343869671 None] Image conversion details: src /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b7c53e27-c3ed-44ff-9ed9-f9ee9bd66b7e, size 1024.00 MB, duration 9.28 sec, destination /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-4a6cb0be-0825-4200-a68d-d6dfb6f656f6 {{(pid=86188) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 16 20:19:08 devstack cinder-volume[86188]: INFO cinder.image.image_utils [None req-ced8f166-d89a-4036-bb98-6be1be375252 tempest-GroupSnapshotsTest-343869671 None] Converted 1024.00 MB image at 110.39 MB/s Sep 16 20:19:08 devstack cinder-volume[86188]: WARNING cinder.volume.drivers.remotefs [None req-ced8f166-d89a-4036-bb98-6be1be375252 tempest-GroupSnapshotsTest-343869671 None] /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-4a6cb0be-0825-4200-a68d-d6dfb6f656f6 is being set with open permissions: ugo+rw: NotImplementedError Sep 16 20:19:08 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ced8f166-d89a-4036-bb98-6be1be375252 tempest-GroupSnapshotsTest-343869671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-4a6cb0be-0825-4200-a68d-d6dfb6f656f6 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:19:08 devstack sudo[88085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-4a6cb0be-0825-4200-a68d-d6dfb6f656f6 Sep 16 20:19:08 devstack sudo[88085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:19:08 devstack sudo[88085]: pam_unix(sudo:session): session closed for user root Sep 16 20:19:08 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ced8f166-d89a-4036-bb98-6be1be375252 tempest-GroupSnapshotsTest-343869671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-4a6cb0be-0825-4200-a68d-d6dfb6f656f6" returned: 0 in 0.354s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:19:09 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-ced8f166-d89a-4036-bb98-6be1be375252 tempest-GroupSnapshotsTest-343869671 None] Lock "cinder-quobyte-4a6cb0be-0825-4200-a68d-d6dfb6f656f6" released by "_copy_volume_from_snapshot" :: held 10.772s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:19:09 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-ced8f166-d89a-4036-bb98-6be1be375252 tempest-GroupSnapshotsTest-343869671 None] Lock "cinder-quobyte-c6442f51-e636-430d-8483-eaa60bd0af7f-4a6cb0be-0825-4200-a68d-d6dfb6f656f6" released by "_create_volume_from_snapshot" :: held 10.878s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:19:09 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-ced8f166-d89a-4036-bb98-6be1be375252 tempest-GroupSnapshotsTest-343869671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.910s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:19:09 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-ced8f166-d89a-4036-bb98-6be1be375252 tempest-GroupSnapshotsTest-343869671 None] Create group from source-snapshot-c44f5059-dee7-43ae-b638-868658ea9b2d completed successfully. Sep 16 20:19:10 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-04090dbb-0a06-4931-8c23-58439a490e5b tempest-GroupSnapshotsTest-343869671 None] Acquiring lock "cinder-quobyte-4a6cb0be-0825-4200-a68d-d6dfb6f656f6" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:19:10 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-04090dbb-0a06-4931-8c23-58439a490e5b tempest-GroupSnapshotsTest-343869671 None] Lock "cinder-quobyte-4a6cb0be-0825-4200-a68d-d6dfb6f656f6" acquired by "delete_volume" :: waited 0.024s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:19:10 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[f60283c6-eb92-407d-8df2-e8ed4c22aa4e]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:19:10 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-04090dbb-0a06-4931-8c23-58439a490e5b tempest-GroupSnapshotsTest-343869671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-4a6cb0be-0825-4200-a68d-d6dfb6f656f6 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:19:11 devstack sudo[88140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-4a6cb0be-0825-4200-a68d-d6dfb6f656f6 Sep 16 20:19:11 devstack sudo[88140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:19:11 devstack sudo[88140]: pam_unix(sudo:session): session closed for user root Sep 16 20:19:11 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-04090dbb-0a06-4931-8c23-58439a490e5b tempest-GroupSnapshotsTest-343869671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-4a6cb0be-0825-4200-a68d-d6dfb6f656f6" returned: 0 in 0.503s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:19:11 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-04090dbb-0a06-4931-8c23-58439a490e5b tempest-GroupSnapshotsTest-343869671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-4a6cb0be-0825-4200-a68d-d6dfb6f656f6 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:19:11 devstack sudo[88155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-4a6cb0be-0825-4200-a68d-d6dfb6f656f6 Sep 16 20:19:11 devstack sudo[88155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:19:11 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [req-0f76879a-46e8-4a91-8ecb-9b11a99878d4 req-11074559-d260-4367-b5bf-f39de238830c tempest-TaggedAttachmentsTest-1650878344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:19:11 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [req-0f76879a-46e8-4a91-8ecb-9b11a99878d4 req-11074559-d260-4367-b5bf-f39de238830c tempest-TaggedAttachmentsTest-1650878344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:19:11 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [req-0f76879a-46e8-4a91-8ecb-9b11a99878d4 req-11074559-d260-4367-b5bf-f39de238830c tempest-TaggedAttachmentsTest-1650878344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:19:11 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [req-0f76879a-46e8-4a91-8ecb-9b11a99878d4 req-11074559-d260-4367-b5bf-f39de238830c tempest-TaggedAttachmentsTest-1650878344 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81', 'name': 'volume-e9aa136e-3435-4e93-aee5-111e831733e1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'feb7f50f-875f-457c-8145-7d0deda3b919', 'enforce_multipath': True} {{(pid=86188) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 16 20:19:11 devstack sudo[88155]: pam_unix(sudo:session): session closed for user root Sep 16 20:19:11 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-04090dbb-0a06-4931-8c23-58439a490e5b tempest-GroupSnapshotsTest-343869671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-4a6cb0be-0825-4200-a68d-d6dfb6f656f6" returned: 0 in 0.342s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:19:11 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-04090dbb-0a06-4931-8c23-58439a490e5b tempest-GroupSnapshotsTest-343869671 None] Lock "cinder-quobyte-4a6cb0be-0825-4200-a68d-d6dfb6f656f6" released by "delete_volume" :: held 0.927s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:19:11 devstack cinder-volume[86188]: INFO cinder.volume.manager [req-0f76879a-46e8-4a91-8ecb-9b11a99878d4 req-11074559-d260-4367-b5bf-f39de238830c tempest-TaggedAttachmentsTest-1650878344 None] attachment_update completed successfully. Sep 16 20:19:11 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-04090dbb-0a06-4931-8c23-58439a490e5b tempest-GroupSnapshotsTest-343869671 None] Created reservations ['5c393a72-712b-4d7e-abab-731b3c099d28'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:19:11 devstack cinder-volume[86188]: WARNING cinder.quota [None req-04090dbb-0a06-4931-8c23-58439a490e5b tempest-GroupSnapshotsTest-343869671 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1042026460 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1042026460, it is now deprecated. Please use the default quota class for default quota. Sep 16 20:19:11 devstack cinder-volume[86188]: WARNING cinder.quota [None req-04090dbb-0a06-4931-8c23-58439a490e5b tempest-GroupSnapshotsTest-343869671 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1042026460 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1042026460, it is now deprecated. Please use the default quota class for default quota. Sep 16 20:19:12 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-04090dbb-0a06-4931-8c23-58439a490e5b tempest-GroupSnapshotsTest-343869671 None] Created reservations ['e91d2339-d196-4ed6-803c-a4d2e364613e', '7a2249ad-d449-4f01-8e70-7584e44147b9', '57c657af-c4f5-440f-aefd-83a93ebad037', '66c568b6-2dd7-45ea-9e0a-5aaafbc98d3a'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:19:12 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-04090dbb-0a06-4931-8c23-58439a490e5b tempest-GroupSnapshotsTest-343869671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:19:12 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-04090dbb-0a06-4931-8c23-58439a490e5b tempest-GroupSnapshotsTest-343869671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:19:12 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-04090dbb-0a06-4931-8c23-58439a490e5b tempest-GroupSnapshotsTest-343869671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:19:12 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-04090dbb-0a06-4931-8c23-58439a490e5b tempest-GroupSnapshotsTest-343869671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:19:12 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-04090dbb-0a06-4931-8c23-58439a490e5b tempest-GroupSnapshotsTest-343869671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:19:12 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-04090dbb-0a06-4931-8c23-58439a490e5b tempest-GroupSnapshotsTest-343869671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:19:12 devstack sudo[88279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:19:12 devstack sudo[88279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:19:12 devstack sudo[88279]: pam_unix(sudo:session): session closed for user root Sep 16 20:19:12 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-04090dbb-0a06-4931-8c23-58439a490e5b tempest-GroupSnapshotsTest-343869671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.412s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:19:12 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-04090dbb-0a06-4931-8c23-58439a490e5b tempest-GroupSnapshotsTest-343869671 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:19:12 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-04090dbb-0a06-4931-8c23-58439a490e5b tempest-GroupSnapshotsTest-343869671 None] Delete group completed successfully. Sep 16 20:19:13 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-e6af6282-9cc1-4455-897b-8e8dbf4ef68e tempest-GroupSnapshotsTest-343869671 None] group_snapshot c44f5059-dee7-43ae-b638-868658ea9b2d: deleting Sep 16 20:19:13 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e6af6282-9cc1-4455-897b-8e8dbf4ef68e tempest-GroupSnapshotsTest-343869671 None] group_snapshot c44f5059-dee7-43ae-b638-868658ea9b2d: deleting {{(pid=86188) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 16 20:19:13 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-e6af6282-9cc1-4455-897b-8e8dbf4ef68e tempest-GroupSnapshotsTest-343869671 None] Acquiring lock "cinder-quobyte-b7c53e27-c3ed-44ff-9ed9-f9ee9bd66b7e" by "delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:19:13 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-e6af6282-9cc1-4455-897b-8e8dbf4ef68e tempest-GroupSnapshotsTest-343869671 None] Lock "cinder-quobyte-b7c53e27-c3ed-44ff-9ed9-f9ee9bd66b7e" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:19:13 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-e6af6282-9cc1-4455-897b-8e8dbf4ef68e tempest-GroupSnapshotsTest-343869671 None] Acquiring lock "cinder-quobyte-c6442f51-e636-430d-8483-eaa60bd0af7f" by "_delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:19:13 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-e6af6282-9cc1-4455-897b-8e8dbf4ef68e tempest-GroupSnapshotsTest-343869671 None] Lock "cinder-quobyte-c6442f51-e636-430d-8483-eaa60bd0af7f" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:19:13 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-e6af6282-9cc1-4455-897b-8e8dbf4ef68e tempest-GroupSnapshotsTest-343869671 None] Deleting offline snapshot c6442f51-e636-430d-8483-eaa60bd0af7f of volume b7c53e27-c3ed-44ff-9ed9-f9ee9bd66b7e {{(pid=86188) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 20:19:13 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-e6af6282-9cc1-4455-897b-8e8dbf4ef68e tempest-GroupSnapshotsTest-343869671 None] snapshot_file for this snap is: volume-b7c53e27-c3ed-44ff-9ed9-f9ee9bd66b7e.c6442f51-e636-430d-8483-eaa60bd0af7f {{(pid=86188) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 20:19:13 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[640d8469-f8bb-4af0-aa38-45d96db3c226]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:19:13 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e6af6282-9cc1-4455-897b-8e8dbf4ef68e tempest-GroupSnapshotsTest-343869671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b7c53e27-c3ed-44ff-9ed9-f9ee9bd66b7e.c6442f51-e636-430d-8483-eaa60bd0af7f {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:19:13 devstack sudo[88585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b7c53e27-c3ed-44ff-9ed9-f9ee9bd66b7e.c6442f51-e636-430d-8483-eaa60bd0af7f Sep 16 20:19:13 devstack sudo[88585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:19:14 devstack sudo[88585]: pam_unix(sudo:session): session closed for user root Sep 16 20:19:14 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e6af6282-9cc1-4455-897b-8e8dbf4ef68e tempest-GroupSnapshotsTest-343869671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b7c53e27-c3ed-44ff-9ed9-f9ee9bd66b7e.c6442f51-e636-430d-8483-eaa60bd0af7f" returned: 0 in 0.719s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:19:14 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-e6af6282-9cc1-4455-897b-8e8dbf4ef68e tempest-GroupSnapshotsTest-343869671 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b7c53e27-c3ed-44ff-9ed9-f9ee9bd66b7e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86188) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 20:19:14 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fd2d5af-0db3-46f3-bb0b-7e296e48df38]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:19:14 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e6af6282-9cc1-4455-897b-8e8dbf4ef68e tempest-GroupSnapshotsTest-343869671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b7c53e27-c3ed-44ff-9ed9-f9ee9bd66b7e {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:19:14 devstack sudo[88602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b7c53e27-c3ed-44ff-9ed9-f9ee9bd66b7e Sep 16 20:19:14 devstack sudo[88602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:19:15 devstack sudo[88602]: pam_unix(sudo:session): session closed for user root Sep 16 20:19:15 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e6af6282-9cc1-4455-897b-8e8dbf4ef68e tempest-GroupSnapshotsTest-343869671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b7c53e27-c3ed-44ff-9ed9-f9ee9bd66b7e" returned: 0 in 0.745s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:19:15 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e6af6282-9cc1-4455-897b-8e8dbf4ef68e tempest-GroupSnapshotsTest-343869671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b7c53e27-c3ed-44ff-9ed9-f9ee9bd66b7e.c6442f51-e636-430d-8483-eaa60bd0af7f {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:19:15 devstack sudo[88621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b7c53e27-c3ed-44ff-9ed9-f9ee9bd66b7e.c6442f51-e636-430d-8483-eaa60bd0af7f Sep 16 20:19:15 devstack sudo[88621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:19:15 devstack sudo[88621]: pam_unix(sudo:session): session closed for user root Sep 16 20:19:15 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e6af6282-9cc1-4455-897b-8e8dbf4ef68e tempest-GroupSnapshotsTest-343869671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b7c53e27-c3ed-44ff-9ed9-f9ee9bd66b7e.c6442f51-e636-430d-8483-eaa60bd0af7f" returned: 0 in 0.479s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:19:15 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e6af6282-9cc1-4455-897b-8e8dbf4ef68e tempest-GroupSnapshotsTest-343869671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b7c53e27-c3ed-44ff-9ed9-f9ee9bd66b7e.c6442f51-e636-430d-8483-eaa60bd0af7f {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:19:15 devstack sudo[88632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b7c53e27-c3ed-44ff-9ed9-f9ee9bd66b7e.c6442f51-e636-430d-8483-eaa60bd0af7f Sep 16 20:19:15 devstack sudo[88632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:19:15 devstack sudo[88632]: pam_unix(sudo:session): session closed for user root Sep 16 20:19:15 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e6af6282-9cc1-4455-897b-8e8dbf4ef68e tempest-GroupSnapshotsTest-343869671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b7c53e27-c3ed-44ff-9ed9-f9ee9bd66b7e.c6442f51-e636-430d-8483-eaa60bd0af7f" returned: 0 in 0.320s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:19:16 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-e6af6282-9cc1-4455-897b-8e8dbf4ef68e tempest-GroupSnapshotsTest-343869671 None] Lock "cinder-quobyte-c6442f51-e636-430d-8483-eaa60bd0af7f" released by "_delete_snapshot" :: held 2.498s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:19:16 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-e6af6282-9cc1-4455-897b-8e8dbf4ef68e tempest-GroupSnapshotsTest-343869671 None] Lock "cinder-quobyte-b7c53e27-c3ed-44ff-9ed9-f9ee9bd66b7e" released by "delete_snapshot" :: held 2.558s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:19:16 devstack cinder-volume[86188]: DEBUG dbcounter [-] [86188] Writing DB stats cinder:SELECT=53,cinder:INSERT=10,cinder:UPDATE=46,cinder:DELETE=3 {{(pid=86188) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 20:19:16 devstack cinder-volume[86188]: DEBUG dbcounter [-] [86188] Writing DB stats cinder:SELECT=57,cinder:UPDATE=45,cinder:INSERT=8,cinder:DELETE=2 {{(pid=86188) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 20:19:16 devstack cinder-volume[86188]: WARNING cinder.quota [None req-e6af6282-9cc1-4455-897b-8e8dbf4ef68e tempest-GroupSnapshotsTest-343869671 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1042026460 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1042026460, it is now deprecated. Please use the default quota class for default quota. Sep 16 20:19:16 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-e6af6282-9cc1-4455-897b-8e8dbf4ef68e tempest-GroupSnapshotsTest-343869671 None] Created reservations ['1e10493a-c40d-4abd-8239-05d99ea09a82', 'a6e006ff-3e1e-47dc-94c6-73d14fa18d78', '014fde7a-0ff9-492e-bbd0-ef1b51b3b3f1', '439f1cb7-fa65-4430-a42e-a886724cd7ab'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:19:16 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-e6af6282-9cc1-4455-897b-8e8dbf4ef68e tempest-GroupSnapshotsTest-343869671 None] group_snapshot c44f5059-dee7-43ae-b638-868658ea9b2d: deleted successfully Sep 16 20:19:16 devstack cinder-volume[86188]: INFO cinder.volume.manager [req-8f80bc6f-2e60-422e-8e85-ba9d3c214358 req-8f4e92df-dd9e-43e3-963a-c70ffadefd93 tempest-TaggedAttachmentsTest-1650878344 None] Terminate volume connection completed successfully. Sep 16 20:19:16 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [req-8f80bc6f-2e60-422e-8e85-ba9d3c214358 req-8f4e92df-dd9e-43e3-963a-c70ffadefd93 tempest-TaggedAttachmentsTest-1650878344 None] Deleting attachment feb7f50f-875f-457c-8145-7d0deda3b919. {{(pid=86188) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 16 20:19:17 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-e005751e-bc0b-431d-8c4b-009ecb0cf228 tempest-GroupSnapshotsTest-343869671 None] Acquiring lock "cinder-quobyte-b7c53e27-c3ed-44ff-9ed9-f9ee9bd66b7e" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:19:17 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-e005751e-bc0b-431d-8c4b-009ecb0cf228 tempest-GroupSnapshotsTest-343869671 None] Lock "cinder-quobyte-b7c53e27-c3ed-44ff-9ed9-f9ee9bd66b7e" acquired by "delete_volume" :: waited 0.021s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:19:17 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecf70f09-3c73-4d4d-9b6c-706beb7f80ea]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:19:17 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e005751e-bc0b-431d-8c4b-009ecb0cf228 tempest-GroupSnapshotsTest-343869671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b7c53e27-c3ed-44ff-9ed9-f9ee9bd66b7e {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:19:17 devstack sudo[88682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b7c53e27-c3ed-44ff-9ed9-f9ee9bd66b7e Sep 16 20:19:17 devstack sudo[88682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:19:18 devstack sudo[88682]: pam_unix(sudo:session): session closed for user root Sep 16 20:19:18 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e005751e-bc0b-431d-8c4b-009ecb0cf228 tempest-GroupSnapshotsTest-343869671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b7c53e27-c3ed-44ff-9ed9-f9ee9bd66b7e" returned: 0 in 0.780s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:19:18 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e005751e-bc0b-431d-8c4b-009ecb0cf228 tempest-GroupSnapshotsTest-343869671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b7c53e27-c3ed-44ff-9ed9-f9ee9bd66b7e {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:19:18 devstack sudo[88704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b7c53e27-c3ed-44ff-9ed9-f9ee9bd66b7e Sep 16 20:19:18 devstack sudo[88704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:19:18 devstack sudo[88704]: pam_unix(sudo:session): session closed for user root Sep 16 20:19:18 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e005751e-bc0b-431d-8c4b-009ecb0cf228 tempest-GroupSnapshotsTest-343869671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b7c53e27-c3ed-44ff-9ed9-f9ee9bd66b7e" returned: 0 in 0.268s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:19:18 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-e005751e-bc0b-431d-8c4b-009ecb0cf228 tempest-GroupSnapshotsTest-343869671 None] Lock "cinder-quobyte-b7c53e27-c3ed-44ff-9ed9-f9ee9bd66b7e" released by "delete_volume" :: held 1.140s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:19:18 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-e005751e-bc0b-431d-8c4b-009ecb0cf228 tempest-GroupSnapshotsTest-343869671 None] Created reservations ['098b9680-9579-4595-8768-8ac3e058c7aa'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:19:18 devstack cinder-volume[86188]: WARNING cinder.db.api [None req-e005751e-bc0b-431d-8c4b-009ecb0cf228 tempest-GroupSnapshotsTest-343869671 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1042026460'] Sep 16 20:19:18 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-e005751e-bc0b-431d-8c4b-009ecb0cf228 tempest-GroupSnapshotsTest-343869671 None] Created reservations ['5832fd0c-a2e2-4f2d-a814-73e5fa4f54a2', 'fde3e410-c87f-4ae6-aa0f-c1645a24a42e', 'a649c93f-8a25-4514-aea2-2cdf1efb6d6d', 'b576f292-4279-4946-b5c7-dbb96f205eb1'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:19:18 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-e005751e-bc0b-431d-8c4b-009ecb0cf228 tempest-GroupSnapshotsTest-343869671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:19:18 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-e005751e-bc0b-431d-8c4b-009ecb0cf228 tempest-GroupSnapshotsTest-343869671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:19:18 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-e005751e-bc0b-431d-8c4b-009ecb0cf228 tempest-GroupSnapshotsTest-343869671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:19:18 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-e005751e-bc0b-431d-8c4b-009ecb0cf228 tempest-GroupSnapshotsTest-343869671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:19:18 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-e005751e-bc0b-431d-8c4b-009ecb0cf228 tempest-GroupSnapshotsTest-343869671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:19:18 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e005751e-bc0b-431d-8c4b-009ecb0cf228 tempest-GroupSnapshotsTest-343869671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:19:19 devstack sudo[88709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:19:19 devstack sudo[88709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:19:19 devstack sudo[88709]: pam_unix(sudo:session): session closed for user root Sep 16 20:19:19 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e005751e-bc0b-431d-8c4b-009ecb0cf228 tempest-GroupSnapshotsTest-343869671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.311s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:19:19 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-e005751e-bc0b-431d-8c4b-009ecb0cf228 tempest-GroupSnapshotsTest-343869671 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:19:19 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-e005751e-bc0b-431d-8c4b-009ecb0cf228 tempest-GroupSnapshotsTest-343869671 None] Delete group completed successfully. Sep 16 20:19:20 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-43410e96-3da8-40cb-9860-3a320f107ac5 tempest-GroupSnapshotsTest-343869671 None] Group tempest-GroupSnapshotsTest-Group-61545405: creating Sep 16 20:19:20 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-43410e96-3da8-40cb-9860-3a320f107ac5 tempest-GroupSnapshotsTest-343869671 None] Group tempest-GroupSnapshotsTest-Group-61545405: created successfully Sep 16 20:19:20 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-43410e96-3da8-40cb-9860-3a320f107ac5 tempest-GroupSnapshotsTest-343869671 None] Create group completed successfully. Sep 16 20:19:22 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-cac23f2e-5986-41ce-afd7-834e00617ada tempest-GroupSnapshotsTest-343869671 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:19:22 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-cac23f2e-5986-41ce-afd7-834e00617ada tempest-GroupSnapshotsTest-343869671 None] Flow 'volume_create_manager' (d94392f6-2664-47fb-b458-14ac2389cb59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:19:22 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-cac23f2e-5986-41ce-afd7-834e00617ada tempest-GroupSnapshotsTest-343869671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37a78f4e-fd45-4673-91b2-fcf715f0bc0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:19:22 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-cac23f2e-5986-41ce-afd7-834e00617ada tempest-GroupSnapshotsTest-343869671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37a78f4e-fd45-4673-91b2-fcf715f0bc0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:19:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-467021358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6fe4e8e8-1fe5-43bc-9c83-9029de1806f4,host='devstack@QuobyteHD#QuobyteHD',id=9ab5021e-73b9-41d2-addd-04d019cd2d5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='534482648c0a44eca02903f01ab2a59f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:19:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:19:23Z,use_quota=True,user_id='737c8364b2ac4d61aa1565d88d58cf84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99b28a3c-f126-4bd9-9c64-d1a486a1e675),volume_type_id=99b28a3c-f126-4bd9-9c64-d1a486a1e675)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:19:22 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-cac23f2e-5986-41ce-afd7-834e00617ada tempest-GroupSnapshotsTest-343869671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28abe0ff-d6e8-42b2-b8fc-590a49b190a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:19:22 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-cac23f2e-5986-41ce-afd7-834e00617ada tempest-GroupSnapshotsTest-343869671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28abe0ff-d6e8-42b2-b8fc-590a49b190a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:19:22 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-cac23f2e-5986-41ce-afd7-834e00617ada tempest-GroupSnapshotsTest-343869671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85964769-c49e-41d7-9eb2-01ce1568d92d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:19:22 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-cac23f2e-5986-41ce-afd7-834e00617ada tempest-GroupSnapshotsTest-343869671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85964769-c49e-41d7-9eb2-01ce1568d92d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ab5021e-73b9-41d2-addd-04d019cd2d5b', 'volume_name': 'volume-9ab5021e-73b9-41d2-addd-04d019cd2d5b', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:19:22 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-cac23f2e-5986-41ce-afd7-834e00617ada tempest-GroupSnapshotsTest-343869671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (825014da-a10e-40a2-9d8c-18dc3e7fea37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:19:22 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-cac23f2e-5986-41ce-afd7-834e00617ada tempest-GroupSnapshotsTest-343869671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (825014da-a10e-40a2-9d8c-18dc3e7fea37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:19:22 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-cac23f2e-5986-41ce-afd7-834e00617ada tempest-GroupSnapshotsTest-343869671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6a759f1-a292-4548-8673-48255def2dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:19:22 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-cac23f2e-5986-41ce-afd7-834e00617ada tempest-GroupSnapshotsTest-343869671 None] Volume 9ab5021e-73b9-41d2-addd-04d019cd2d5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ab5021e-73b9-41d2-addd-04d019cd2d5b', 'volume_size': 1} Sep 16 20:19:22 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-cac23f2e-5986-41ce-afd7-834e00617ada tempest-GroupSnapshotsTest-343869671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:19:22 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-cac23f2e-5986-41ce-afd7-834e00617ada tempest-GroupSnapshotsTest-343869671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:19:22 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-cac23f2e-5986-41ce-afd7-834e00617ada tempest-GroupSnapshotsTest-343869671 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6fe4e8e8-1fe5-43bc-9c83-9029de1806f4,created_at=2026-09-16T18:19:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-467021358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6fe4e8e8-1fe5-43bc-9c83-9029de1806f4,host='devstack@QuobyteHD#QuobyteHD',id=9ab5021e-73b9-41d2-addd-04d019cd2d5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='534482648c0a44eca02903f01ab2a59f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:19:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:19:23Z,use_quota=True,user_id='737c8364b2ac4d61aa1565d88d58cf84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99b28a3c-f126-4bd9-9c64-d1a486a1e675),volume_type_id=99b28a3c-f126-4bd9-9c64-d1a486a1e675)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:19:22 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-cac23f2e-5986-41ce-afd7-834e00617ada tempest-GroupSnapshotsTest-343869671 None] Creating volume 9ab5021e-73b9-41d2-addd-04d019cd2d5b {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:19:22 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-cac23f2e-5986-41ce-afd7-834e00617ada tempest-GroupSnapshotsTest-343869671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:19:22 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-cac23f2e-5986-41ce-afd7-834e00617ada tempest-GroupSnapshotsTest-343869671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:19:22 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-cac23f2e-5986-41ce-afd7-834e00617ada tempest-GroupSnapshotsTest-343869671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:19:22 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-cac23f2e-5986-41ce-afd7-834e00617ada tempest-GroupSnapshotsTest-343869671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:19:22 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-cac23f2e-5986-41ce-afd7-834e00617ada tempest-GroupSnapshotsTest-343869671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:19:22 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-cac23f2e-5986-41ce-afd7-834e00617ada tempest-GroupSnapshotsTest-343869671 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:19:22 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-cac23f2e-5986-41ce-afd7-834e00617ada tempest-GroupSnapshotsTest-343869671 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:19:22 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-cac23f2e-5986-41ce-afd7-834e00617ada tempest-GroupSnapshotsTest-343869671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9ab5021e-73b9-41d2-addd-04d019cd2d5b 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:19:22 devstack sudo[88772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9ab5021e-73b9-41d2-addd-04d019cd2d5b 1073741824 Sep 16 20:19:22 devstack sudo[88772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:19:23 devstack sudo[88772]: pam_unix(sudo:session): session closed for user root Sep 16 20:19:23 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-cac23f2e-5986-41ce-afd7-834e00617ada tempest-GroupSnapshotsTest-343869671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9ab5021e-73b9-41d2-addd-04d019cd2d5b 1073741824" returned: 0 in 1.034s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:19:23 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-cac23f2e-5986-41ce-afd7-834e00617ada tempest-GroupSnapshotsTest-343869671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9ab5021e-73b9-41d2-addd-04d019cd2d5b {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:19:24 devstack sudo[88792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9ab5021e-73b9-41d2-addd-04d019cd2d5b Sep 16 20:19:24 devstack sudo[88792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:19:24 devstack sudo[88792]: pam_unix(sudo:session): session closed for user root Sep 16 20:19:24 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-cac23f2e-5986-41ce-afd7-834e00617ada tempest-GroupSnapshotsTest-343869671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9ab5021e-73b9-41d2-addd-04d019cd2d5b" returned: 0 in 0.454s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:19:24 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-cac23f2e-5986-41ce-afd7-834e00617ada tempest-GroupSnapshotsTest-343869671 None] <== create_volume: return (1597ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:19:24 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-cac23f2e-5986-41ce-afd7-834e00617ada tempest-GroupSnapshotsTest-343869671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.604s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:19:24 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-cac23f2e-5986-41ce-afd7-834e00617ada tempest-GroupSnapshotsTest-343869671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6a759f1-a292-4548-8673-48255def2dd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ab5021e-73b9-41d2-addd-04d019cd2d5b', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:19:24 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-cac23f2e-5986-41ce-afd7-834e00617ada tempest-GroupSnapshotsTest-343869671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2276778d-5067-473c-b05c-e109f6afc52a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:19:24 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-cac23f2e-5986-41ce-afd7-834e00617ada tempest-GroupSnapshotsTest-343869671 None] Volume volume-9ab5021e-73b9-41d2-addd-04d019cd2d5b (9ab5021e-73b9-41d2-addd-04d019cd2d5b): created successfully Sep 16 20:19:24 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-cac23f2e-5986-41ce-afd7-834e00617ada tempest-GroupSnapshotsTest-343869671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2276778d-5067-473c-b05c-e109f6afc52a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:19:24 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-cac23f2e-5986-41ce-afd7-834e00617ada tempest-GroupSnapshotsTest-343869671 None] Flow 'volume_create_manager' (d94392f6-2664-47fb-b458-14ac2389cb59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:19:24 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-cac23f2e-5986-41ce-afd7-834e00617ada tempest-GroupSnapshotsTest-343869671 None] Created volume successfully. Sep 16 20:19:26 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8b7759a-b761-4d79-ace6-7690a52a5a22 tempest-GroupSnapshotsTest-343869671 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:19:26 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a8b7759a-b761-4d79-ace6-7690a52a5a22 tempest-GroupSnapshotsTest-343869671 None] Flow 'volume_create_manager' (c231ca4c-747b-4a5e-a3c1-1d2fe15f55b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:19:26 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a8b7759a-b761-4d79-ace6-7690a52a5a22 tempest-GroupSnapshotsTest-343869671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ec116d8-da4e-493f-8bb1-db9cc975b63a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:19:26 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a8b7759a-b761-4d79-ace6-7690a52a5a22 tempest-GroupSnapshotsTest-343869671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ec116d8-da4e-493f-8bb1-db9cc975b63a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:19:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1183480636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6fe4e8e8-1fe5-43bc-9c83-9029de1806f4,host='devstack@QuobyteHD#QuobyteHD',id=bf9acb2e-7d4e-4e61-9517-4bd28544b107,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='534482648c0a44eca02903f01ab2a59f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:19:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:19:27Z,use_quota=True,user_id='737c8364b2ac4d61aa1565d88d58cf84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99b28a3c-f126-4bd9-9c64-d1a486a1e675),volume_type_id=99b28a3c-f126-4bd9-9c64-d1a486a1e675)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:19:26 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a8b7759a-b761-4d79-ace6-7690a52a5a22 tempest-GroupSnapshotsTest-343869671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (942c5ca3-8c34-463c-aeab-676fcf2e7aac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:19:26 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a8b7759a-b761-4d79-ace6-7690a52a5a22 tempest-GroupSnapshotsTest-343869671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (942c5ca3-8c34-463c-aeab-676fcf2e7aac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:19:26 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a8b7759a-b761-4d79-ace6-7690a52a5a22 tempest-GroupSnapshotsTest-343869671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da672ac2-1f65-43d8-a267-9c8989106437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:19:26 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a8b7759a-b761-4d79-ace6-7690a52a5a22 tempest-GroupSnapshotsTest-343869671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da672ac2-1f65-43d8-a267-9c8989106437) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf9acb2e-7d4e-4e61-9517-4bd28544b107', 'volume_name': 'volume-bf9acb2e-7d4e-4e61-9517-4bd28544b107', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:19:26 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a8b7759a-b761-4d79-ace6-7690a52a5a22 tempest-GroupSnapshotsTest-343869671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd24b3d4-5969-4462-9ae0-9074a6ee10f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:19:26 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a8b7759a-b761-4d79-ace6-7690a52a5a22 tempest-GroupSnapshotsTest-343869671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd24b3d4-5969-4462-9ae0-9074a6ee10f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:19:26 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a8b7759a-b761-4d79-ace6-7690a52a5a22 tempest-GroupSnapshotsTest-343869671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83643533-8818-4cea-adaa-5da6418ae0d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:19:26 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-a8b7759a-b761-4d79-ace6-7690a52a5a22 tempest-GroupSnapshotsTest-343869671 None] Volume bf9acb2e-7d4e-4e61-9517-4bd28544b107: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf9acb2e-7d4e-4e61-9517-4bd28544b107', 'volume_size': 1} Sep 16 20:19:26 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a8b7759a-b761-4d79-ace6-7690a52a5a22 tempest-GroupSnapshotsTest-343869671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:19:26 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a8b7759a-b761-4d79-ace6-7690a52a5a22 tempest-GroupSnapshotsTest-343869671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:19:26 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-a8b7759a-b761-4d79-ace6-7690a52a5a22 tempest-GroupSnapshotsTest-343869671 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6fe4e8e8-1fe5-43bc-9c83-9029de1806f4,created_at=2026-09-16T18:19:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1183480636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6fe4e8e8-1fe5-43bc-9c83-9029de1806f4,host='devstack@QuobyteHD#QuobyteHD',id=bf9acb2e-7d4e-4e61-9517-4bd28544b107,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='534482648c0a44eca02903f01ab2a59f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:19:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:19:27Z,use_quota=True,user_id='737c8364b2ac4d61aa1565d88d58cf84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99b28a3c-f126-4bd9-9c64-d1a486a1e675),volume_type_id=99b28a3c-f126-4bd9-9c64-d1a486a1e675)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:19:26 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-a8b7759a-b761-4d79-ace6-7690a52a5a22 tempest-GroupSnapshotsTest-343869671 None] Creating volume bf9acb2e-7d4e-4e61-9517-4bd28544b107 {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:19:26 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a8b7759a-b761-4d79-ace6-7690a52a5a22 tempest-GroupSnapshotsTest-343869671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:19:26 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a8b7759a-b761-4d79-ace6-7690a52a5a22 tempest-GroupSnapshotsTest-343869671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:19:26 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-a8b7759a-b761-4d79-ace6-7690a52a5a22 tempest-GroupSnapshotsTest-343869671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:19:26 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-a8b7759a-b761-4d79-ace6-7690a52a5a22 tempest-GroupSnapshotsTest-343869671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:19:26 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a8b7759a-b761-4d79-ace6-7690a52a5a22 tempest-GroupSnapshotsTest-343869671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:19:26 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-a8b7759a-b761-4d79-ace6-7690a52a5a22 tempest-GroupSnapshotsTest-343869671 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:19:26 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-a8b7759a-b761-4d79-ace6-7690a52a5a22 tempest-GroupSnapshotsTest-343869671 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:19:26 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a8b7759a-b761-4d79-ace6-7690a52a5a22 tempest-GroupSnapshotsTest-343869671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-bf9acb2e-7d4e-4e61-9517-4bd28544b107 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:19:26 devstack sudo[88836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-bf9acb2e-7d4e-4e61-9517-4bd28544b107 1073741824 Sep 16 20:19:26 devstack sudo[88836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:19:27 devstack sudo[88836]: pam_unix(sudo:session): session closed for user root Sep 16 20:19:27 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a8b7759a-b761-4d79-ace6-7690a52a5a22 tempest-GroupSnapshotsTest-343869671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-bf9acb2e-7d4e-4e61-9517-4bd28544b107 1073741824" returned: 0 in 1.017s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:19:28 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a8b7759a-b761-4d79-ace6-7690a52a5a22 tempest-GroupSnapshotsTest-343869671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-bf9acb2e-7d4e-4e61-9517-4bd28544b107 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:19:28 devstack sudo[88846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-bf9acb2e-7d4e-4e61-9517-4bd28544b107 Sep 16 20:19:28 devstack sudo[88846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:19:28 devstack sudo[88846]: pam_unix(sudo:session): session closed for user root Sep 16 20:19:28 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a8b7759a-b761-4d79-ace6-7690a52a5a22 tempest-GroupSnapshotsTest-343869671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-bf9acb2e-7d4e-4e61-9517-4bd28544b107" returned: 0 in 0.869s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:19:28 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-a8b7759a-b761-4d79-ace6-7690a52a5a22 tempest-GroupSnapshotsTest-343869671 None] <== create_volume: return (2085ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:19:28 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a8b7759a-b761-4d79-ace6-7690a52a5a22 tempest-GroupSnapshotsTest-343869671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.090s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:19:28 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a8b7759a-b761-4d79-ace6-7690a52a5a22 tempest-GroupSnapshotsTest-343869671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83643533-8818-4cea-adaa-5da6418ae0d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf9acb2e-7d4e-4e61-9517-4bd28544b107', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:19:28 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a8b7759a-b761-4d79-ace6-7690a52a5a22 tempest-GroupSnapshotsTest-343869671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (560dd7a0-30b5-4cb5-8b75-bfdcb52ce620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:19:28 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-a8b7759a-b761-4d79-ace6-7690a52a5a22 tempest-GroupSnapshotsTest-343869671 None] Volume volume-bf9acb2e-7d4e-4e61-9517-4bd28544b107 (bf9acb2e-7d4e-4e61-9517-4bd28544b107): created successfully Sep 16 20:19:28 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a8b7759a-b761-4d79-ace6-7690a52a5a22 tempest-GroupSnapshotsTest-343869671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (560dd7a0-30b5-4cb5-8b75-bfdcb52ce620) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:19:28 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a8b7759a-b761-4d79-ace6-7690a52a5a22 tempest-GroupSnapshotsTest-343869671 None] Flow 'volume_create_manager' (c231ca4c-747b-4a5e-a3c1-1d2fe15f55b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:19:28 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-a8b7759a-b761-4d79-ace6-7690a52a5a22 tempest-GroupSnapshotsTest-343869671 None] Created volume successfully. Sep 16 20:19:30 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-30650832-c3f1-4de8-963c-50299fea9c25 tempest-GroupSnapshotsTest-343869671 None] Update group completed successfully. Sep 16 20:19:32 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-12a6b878-c114-477e-bdca-f10379f86f69 tempest-GroupSnapshotsTest-343869671 None] Update group completed successfully. Sep 16 20:19:33 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-b7736e21-6cf6-4297-a933-60472424bcc1 tempest-GroupSnapshotsTest-343869671 None] Update group completed successfully. Sep 16 20:19:34 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-e06036e0-014b-4100-b728-1f4e4fc5ca71 tempest-GroupSnapshotsTest-343869671 None] Update group completed successfully. Sep 16 20:19:36 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-684025a7-ea0c-4e05-bb54-7ad79e65a41e tempest-GroupSnapshotsTest-343869671 None] GroupSnapshot 86533d66-29bb-4427-bed4-913954503492: creating. Sep 16 20:19:37 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-684025a7-ea0c-4e05-bb54-7ad79e65a41e tempest-GroupSnapshotsTest-343869671 None] Group snapshot 86533d66-29bb-4427-bed4-913954503492: creating. {{(pid=86188) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 16 20:19:37 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-684025a7-ea0c-4e05-bb54-7ad79e65a41e tempest-GroupSnapshotsTest-343869671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:19:37 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-684025a7-ea0c-4e05-bb54-7ad79e65a41e tempest-GroupSnapshotsTest-343869671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:19:37 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-684025a7-ea0c-4e05-bb54-7ad79e65a41e tempest-GroupSnapshotsTest-343869671 None] Creating offline snapshot 20a5caed-6d5c-42de-b9da-7eef5b4120a2 of volume 9ab5021e-73b9-41d2-addd-04d019cd2d5b {{(pid=86188) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 20:19:37 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ad262f1-ad5d-4eba-bd1c-74619b422408]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:19:37 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-684025a7-ea0c-4e05-bb54-7ad79e65a41e tempest-GroupSnapshotsTest-343869671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9ab5021e-73b9-41d2-addd-04d019cd2d5b {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:19:37 devstack sudo[88926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9ab5021e-73b9-41d2-addd-04d019cd2d5b Sep 16 20:19:37 devstack sudo[88926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:19:37 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-835bcabf-d356-4df8-b436-48e9cd813209 tempest-TaggedAttachmentsTest-1650878344 None] Acquiring lock "cinder-e9aa136e-3435-4e93-aee5-111e831733e1-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:19:37 devstack sudo[88926]: pam_unix(sudo:session): session closed for user root Sep 16 20:19:38 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-684025a7-ea0c-4e05-bb54-7ad79e65a41e tempest-GroupSnapshotsTest-343869671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9ab5021e-73b9-41d2-addd-04d019cd2d5b" returned: 0 in 0.903s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:19:38 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-684025a7-ea0c-4e05-bb54-7ad79e65a41e tempest-GroupSnapshotsTest-343869671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9ab5021e-73b9-41d2-addd-04d019cd2d5b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9ab5021e-73b9-41d2-addd-04d019cd2d5b.20a5caed-6d5c-42de-b9da-7eef5b4120a2 1G {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:19:38 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-835bcabf-d356-4df8-b436-48e9cd813209 tempest-TaggedAttachmentsTest-1650878344 None] Lock "cinder-e9aa136e-3435-4e93-aee5-111e831733e1-delete_volume" acquired by "delete_volume" :: waited 0.084s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:19:38 devstack sudo[88956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9ab5021e-73b9-41d2-addd-04d019cd2d5b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9ab5021e-73b9-41d2-addd-04d019cd2d5b.20a5caed-6d5c-42de-b9da-7eef5b4120a2 1G Sep 16 20:19:38 devstack sudo[88956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:19:38 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-835bcabf-d356-4df8-b436-48e9cd813209 tempest-TaggedAttachmentsTest-1650878344 None] Acquiring lock "cinder-quobyte-e9aa136e-3435-4e93-aee5-111e831733e1" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:19:38 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-835bcabf-d356-4df8-b436-48e9cd813209 tempest-TaggedAttachmentsTest-1650878344 None] Lock "cinder-quobyte-e9aa136e-3435-4e93-aee5-111e831733e1" acquired by "delete_volume" :: waited 0.023s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:19:38 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[e181c115-7827-42cd-9988-f0a0b44d814b]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:19:38 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-835bcabf-d356-4df8-b436-48e9cd813209 tempest-TaggedAttachmentsTest-1650878344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e9aa136e-3435-4e93-aee5-111e831733e1 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:19:38 devstack sudo[88960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e9aa136e-3435-4e93-aee5-111e831733e1 Sep 16 20:19:38 devstack sudo[88960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:19:38 devstack sudo[88956]: pam_unix(sudo:session): session closed for user root Sep 16 20:19:38 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-684025a7-ea0c-4e05-bb54-7ad79e65a41e tempest-GroupSnapshotsTest-343869671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9ab5021e-73b9-41d2-addd-04d019cd2d5b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9ab5021e-73b9-41d2-addd-04d019cd2d5b.20a5caed-6d5c-42de-b9da-7eef5b4120a2 1G" returned: 0 in 0.721s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:19:38 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-684025a7-ea0c-4e05-bb54-7ad79e65a41e tempest-GroupSnapshotsTest-343869671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ab5021e-73b9-41d2-addd-04d019cd2d5b -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9ab5021e-73b9-41d2-addd-04d019cd2d5b.20a5caed-6d5c-42de-b9da-7eef5b4120a2 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:19:38 devstack sudo[88969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ab5021e-73b9-41d2-addd-04d019cd2d5b -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9ab5021e-73b9-41d2-addd-04d019cd2d5b.20a5caed-6d5c-42de-b9da-7eef5b4120a2 Sep 16 20:19:38 devstack sudo[88969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:19:38 devstack sudo[88960]: pam_unix(sudo:session): session closed for user root Sep 16 20:19:38 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-835bcabf-d356-4df8-b436-48e9cd813209 tempest-TaggedAttachmentsTest-1650878344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e9aa136e-3435-4e93-aee5-111e831733e1" returned: 0 in 0.523s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:19:38 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-835bcabf-d356-4df8-b436-48e9cd813209 tempest-TaggedAttachmentsTest-1650878344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e9aa136e-3435-4e93-aee5-111e831733e1 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:19:38 devstack sudo[88971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e9aa136e-3435-4e93-aee5-111e831733e1 Sep 16 20:19:38 devstack sudo[88971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:19:39 devstack sudo[88971]: pam_unix(sudo:session): session closed for user root Sep 16 20:19:39 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-835bcabf-d356-4df8-b436-48e9cd813209 tempest-TaggedAttachmentsTest-1650878344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e9aa136e-3435-4e93-aee5-111e831733e1" returned: 0 in 0.355s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:19:39 devstack sudo[88969]: pam_unix(sudo:session): session closed for user root Sep 16 20:19:39 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-835bcabf-d356-4df8-b436-48e9cd813209 tempest-TaggedAttachmentsTest-1650878344 None] Lock "cinder-quobyte-e9aa136e-3435-4e93-aee5-111e831733e1" released by "delete_volume" :: held 0.965s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:19:39 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-684025a7-ea0c-4e05-bb54-7ad79e65a41e tempest-GroupSnapshotsTest-343869671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ab5021e-73b9-41d2-addd-04d019cd2d5b -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9ab5021e-73b9-41d2-addd-04d019cd2d5b.20a5caed-6d5c-42de-b9da-7eef5b4120a2" returned: 0 in 0.434s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:19:39 devstack cinder-volume[86188]: WARNING cinder.volume.drivers.remotefs [None req-684025a7-ea0c-4e05-bb54-7ad79e65a41e tempest-GroupSnapshotsTest-343869671 None] /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9ab5021e-73b9-41d2-addd-04d019cd2d5b.20a5caed-6d5c-42de-b9da-7eef5b4120a2 is being set with open permissions: ugo+rw: NotImplementedError Sep 16 20:19:39 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-684025a7-ea0c-4e05-bb54-7ad79e65a41e tempest-GroupSnapshotsTest-343869671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9ab5021e-73b9-41d2-addd-04d019cd2d5b.20a5caed-6d5c-42de-b9da-7eef5b4120a2 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:19:39 devstack sudo[88983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9ab5021e-73b9-41d2-addd-04d019cd2d5b.20a5caed-6d5c-42de-b9da-7eef5b4120a2 Sep 16 20:19:39 devstack sudo[88983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:19:39 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-835bcabf-d356-4df8-b436-48e9cd813209 tempest-TaggedAttachmentsTest-1650878344 None] Created reservations ['bab744da-7fe2-483e-bfdf-39f71931775d', '2a9bdadc-5194-4d16-a1c5-3333ee25168c', '25e5976d-7925-4b6b-8152-e1ba969edcc8', '107cc919-5d73-4c68-88f2-ba25174607f9'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:19:39 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-835bcabf-d356-4df8-b436-48e9cd813209 tempest-TaggedAttachmentsTest-1650878344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:19:39 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-835bcabf-d356-4df8-b436-48e9cd813209 tempest-TaggedAttachmentsTest-1650878344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:19:39 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-835bcabf-d356-4df8-b436-48e9cd813209 tempest-TaggedAttachmentsTest-1650878344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:19:39 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-835bcabf-d356-4df8-b436-48e9cd813209 tempest-TaggedAttachmentsTest-1650878344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:19:39 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-835bcabf-d356-4df8-b436-48e9cd813209 tempest-TaggedAttachmentsTest-1650878344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:19:39 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-835bcabf-d356-4df8-b436-48e9cd813209 tempest-TaggedAttachmentsTest-1650878344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:19:39 devstack sudo[88986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:19:39 devstack sudo[88986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:19:39 devstack sudo[88986]: pam_unix(sudo:session): session closed for user root Sep 16 20:19:39 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-835bcabf-d356-4df8-b436-48e9cd813209 tempest-TaggedAttachmentsTest-1650878344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.435s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:19:39 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-835bcabf-d356-4df8-b436-48e9cd813209 tempest-TaggedAttachmentsTest-1650878344 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:19:39 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-835bcabf-d356-4df8-b436-48e9cd813209 tempest-TaggedAttachmentsTest-1650878344 None] Deleted volume successfully. Sep 16 20:19:39 devstack sudo[88983]: pam_unix(sudo:session): session closed for user root Sep 16 20:19:39 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-835bcabf-d356-4df8-b436-48e9cd813209 tempest-TaggedAttachmentsTest-1650878344 None] Lock "cinder-e9aa136e-3435-4e93-aee5-111e831733e1-delete_volume" released by "delete_volume" :: held 1.838s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:19:39 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-684025a7-ea0c-4e05-bb54-7ad79e65a41e tempest-GroupSnapshotsTest-343869671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9ab5021e-73b9-41d2-addd-04d019cd2d5b.20a5caed-6d5c-42de-b9da-7eef5b4120a2" returned: 0 in 0.739s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:19:39 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-684025a7-ea0c-4e05-bb54-7ad79e65a41e tempest-GroupSnapshotsTest-343869671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9ab5021e-73b9-41d2-addd-04d019cd2d5b.info {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:19:40 devstack sudo[89000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9ab5021e-73b9-41d2-addd-04d019cd2d5b.info Sep 16 20:19:40 devstack sudo[89000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:19:40 devstack sudo[89000]: pam_unix(sudo:session): session closed for user root Sep 16 20:19:40 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-684025a7-ea0c-4e05-bb54-7ad79e65a41e tempest-GroupSnapshotsTest-343869671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9ab5021e-73b9-41d2-addd-04d019cd2d5b.info" returned: 0 in 0.375s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:19:40 devstack cinder-volume[86188]: WARNING cinder.volume.drivers.remotefs [None req-684025a7-ea0c-4e05-bb54-7ad79e65a41e tempest-GroupSnapshotsTest-343869671 None] /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9ab5021e-73b9-41d2-addd-04d019cd2d5b.info is being set with open permissions: ugo+rw: NotImplementedError Sep 16 20:19:40 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-684025a7-ea0c-4e05-bb54-7ad79e65a41e tempest-GroupSnapshotsTest-343869671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9ab5021e-73b9-41d2-addd-04d019cd2d5b.info {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:19:40 devstack sudo[89007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9ab5021e-73b9-41d2-addd-04d019cd2d5b.info Sep 16 20:19:40 devstack sudo[89007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:19:40 devstack sudo[89007]: pam_unix(sudo:session): session closed for user root Sep 16 20:19:40 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-684025a7-ea0c-4e05-bb54-7ad79e65a41e tempest-GroupSnapshotsTest-343869671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9ab5021e-73b9-41d2-addd-04d019cd2d5b.info" returned: 0 in 0.637s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:19:41 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-684025a7-ea0c-4e05-bb54-7ad79e65a41e tempest-GroupSnapshotsTest-343869671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.999s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:19:41 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-684025a7-ea0c-4e05-bb54-7ad79e65a41e tempest-GroupSnapshotsTest-343869671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:19:41 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-684025a7-ea0c-4e05-bb54-7ad79e65a41e tempest-GroupSnapshotsTest-343869671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:19:41 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-684025a7-ea0c-4e05-bb54-7ad79e65a41e tempest-GroupSnapshotsTest-343869671 None] Creating offline snapshot 765d4170-f416-497d-a34a-e0c6b575b8fa of volume bf9acb2e-7d4e-4e61-9517-4bd28544b107 {{(pid=86188) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 20:19:41 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[1879f646-8662-4fa4-ab77-09ae1c3bf661]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:19:41 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-684025a7-ea0c-4e05-bb54-7ad79e65a41e tempest-GroupSnapshotsTest-343869671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-bf9acb2e-7d4e-4e61-9517-4bd28544b107 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:19:41 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-a92b7319-1119-4d0b-91f1-6f8e546e584d tempest-ServerRescueNegativeTestJSON-2010112970 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:19:41 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a92b7319-1119-4d0b-91f1-6f8e546e584d tempest-ServerRescueNegativeTestJSON-2010112970 None] Flow 'volume_create_manager' (2f169c3a-5b3f-47e9-9feb-09afedb130a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:19:41 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a92b7319-1119-4d0b-91f1-6f8e546e584d tempest-ServerRescueNegativeTestJSON-2010112970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a17d5cfb-e003-4afe-973d-080a3f264391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:19:41 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a92b7319-1119-4d0b-91f1-6f8e546e584d tempest-ServerRescueNegativeTestJSON-2010112970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a17d5cfb-e003-4afe-973d-080a3f264391) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:19:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1648713921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58f7d047-2fce-4b5f-b4e1-c6b2c48a671f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fb85507731644d5aa078a5169675b43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:19:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:19:41Z,use_quota=True,user_id='7a068588169a49d69d9cfecb0ec79723',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:19:41 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a92b7319-1119-4d0b-91f1-6f8e546e584d tempest-ServerRescueNegativeTestJSON-2010112970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67e04985-2197-4d23-9299-b9b7fad1b08e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:19:41 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a92b7319-1119-4d0b-91f1-6f8e546e584d tempest-ServerRescueNegativeTestJSON-2010112970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67e04985-2197-4d23-9299-b9b7fad1b08e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:19:41 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a92b7319-1119-4d0b-91f1-6f8e546e584d tempest-ServerRescueNegativeTestJSON-2010112970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcb505b8-291b-47e6-af95-2ca9d0e83f4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:19:41 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a92b7319-1119-4d0b-91f1-6f8e546e584d tempest-ServerRescueNegativeTestJSON-2010112970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcb505b8-291b-47e6-af95-2ca9d0e83f4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58f7d047-2fce-4b5f-b4e1-c6b2c48a671f', 'volume_name': 'volume-58f7d047-2fce-4b5f-b4e1-c6b2c48a671f', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:19:41 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a92b7319-1119-4d0b-91f1-6f8e546e584d tempest-ServerRescueNegativeTestJSON-2010112970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78214932-4c17-4c4c-8c07-548a9ccdd0f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:19:41 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a92b7319-1119-4d0b-91f1-6f8e546e584d tempest-ServerRescueNegativeTestJSON-2010112970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78214932-4c17-4c4c-8c07-548a9ccdd0f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:19:41 devstack sudo[89012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-bf9acb2e-7d4e-4e61-9517-4bd28544b107 Sep 16 20:19:41 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a92b7319-1119-4d0b-91f1-6f8e546e584d tempest-ServerRescueNegativeTestJSON-2010112970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf2a619a-b577-4cc8-879c-4bb1d23dd3ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:19:41 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-a92b7319-1119-4d0b-91f1-6f8e546e584d tempest-ServerRescueNegativeTestJSON-2010112970 None] Volume 58f7d047-2fce-4b5f-b4e1-c6b2c48a671f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58f7d047-2fce-4b5f-b4e1-c6b2c48a671f', 'volume_size': 1} Sep 16 20:19:41 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a92b7319-1119-4d0b-91f1-6f8e546e584d tempest-ServerRescueNegativeTestJSON-2010112970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:19:41 devstack sudo[89012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:19:41 devstack sudo[89012]: pam_unix(sudo:session): session closed for user root Sep 16 20:19:41 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-684025a7-ea0c-4e05-bb54-7ad79e65a41e tempest-GroupSnapshotsTest-343869671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-bf9acb2e-7d4e-4e61-9517-4bd28544b107" returned: 0 in 0.451s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:19:41 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-684025a7-ea0c-4e05-bb54-7ad79e65a41e tempest-GroupSnapshotsTest-343869671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-bf9acb2e-7d4e-4e61-9517-4bd28544b107,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-bf9acb2e-7d4e-4e61-9517-4bd28544b107.765d4170-f416-497d-a34a-e0c6b575b8fa 1G {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:19:41 devstack sudo[89017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-bf9acb2e-7d4e-4e61-9517-4bd28544b107,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-bf9acb2e-7d4e-4e61-9517-4bd28544b107.765d4170-f416-497d-a34a-e0c6b575b8fa 1G Sep 16 20:19:41 devstack sudo[89017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:19:42 devstack sudo[89017]: pam_unix(sudo:session): session closed for user root Sep 16 20:19:42 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-684025a7-ea0c-4e05-bb54-7ad79e65a41e tempest-GroupSnapshotsTest-343869671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-bf9acb2e-7d4e-4e61-9517-4bd28544b107,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-bf9acb2e-7d4e-4e61-9517-4bd28544b107.765d4170-f416-497d-a34a-e0c6b575b8fa 1G" returned: 0 in 0.472s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:19:42 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-684025a7-ea0c-4e05-bb54-7ad79e65a41e tempest-GroupSnapshotsTest-343869671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf9acb2e-7d4e-4e61-9517-4bd28544b107 -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-bf9acb2e-7d4e-4e61-9517-4bd28544b107.765d4170-f416-497d-a34a-e0c6b575b8fa {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:19:42 devstack sudo[89025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf9acb2e-7d4e-4e61-9517-4bd28544b107 -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-bf9acb2e-7d4e-4e61-9517-4bd28544b107.765d4170-f416-497d-a34a-e0c6b575b8fa Sep 16 20:19:42 devstack sudo[89025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:19:42 devstack sudo[89025]: pam_unix(sudo:session): session closed for user root Sep 16 20:19:42 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-684025a7-ea0c-4e05-bb54-7ad79e65a41e tempest-GroupSnapshotsTest-343869671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf9acb2e-7d4e-4e61-9517-4bd28544b107 -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-bf9acb2e-7d4e-4e61-9517-4bd28544b107.765d4170-f416-497d-a34a-e0c6b575b8fa" returned: 0 in 0.379s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:19:42 devstack cinder-volume[86188]: WARNING cinder.volume.drivers.remotefs [None req-684025a7-ea0c-4e05-bb54-7ad79e65a41e tempest-GroupSnapshotsTest-343869671 None] /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-bf9acb2e-7d4e-4e61-9517-4bd28544b107.765d4170-f416-497d-a34a-e0c6b575b8fa is being set with open permissions: ugo+rw: NotImplementedError Sep 16 20:19:42 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-684025a7-ea0c-4e05-bb54-7ad79e65a41e tempest-GroupSnapshotsTest-343869671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-bf9acb2e-7d4e-4e61-9517-4bd28544b107.765d4170-f416-497d-a34a-e0c6b575b8fa {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:19:42 devstack sudo[89031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-bf9acb2e-7d4e-4e61-9517-4bd28544b107.765d4170-f416-497d-a34a-e0c6b575b8fa Sep 16 20:19:42 devstack sudo[89031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:19:42 devstack sudo[89031]: pam_unix(sudo:session): session closed for user root Sep 16 20:19:42 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-684025a7-ea0c-4e05-bb54-7ad79e65a41e tempest-GroupSnapshotsTest-343869671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-bf9acb2e-7d4e-4e61-9517-4bd28544b107.765d4170-f416-497d-a34a-e0c6b575b8fa" returned: 0 in 0.296s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:19:42 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-684025a7-ea0c-4e05-bb54-7ad79e65a41e tempest-GroupSnapshotsTest-343869671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-bf9acb2e-7d4e-4e61-9517-4bd28544b107.info {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:19:42 devstack sudo[89035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-bf9acb2e-7d4e-4e61-9517-4bd28544b107.info Sep 16 20:19:42 devstack sudo[89035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:19:43 devstack sudo[89035]: pam_unix(sudo:session): session closed for user root Sep 16 20:19:43 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-684025a7-ea0c-4e05-bb54-7ad79e65a41e tempest-GroupSnapshotsTest-343869671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-bf9acb2e-7d4e-4e61-9517-4bd28544b107.info" returned: 0 in 0.402s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:19:43 devstack cinder-volume[86188]: WARNING cinder.volume.drivers.remotefs [None req-684025a7-ea0c-4e05-bb54-7ad79e65a41e tempest-GroupSnapshotsTest-343869671 None] /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-bf9acb2e-7d4e-4e61-9517-4bd28544b107.info is being set with open permissions: ugo+rw: NotImplementedError Sep 16 20:19:43 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-684025a7-ea0c-4e05-bb54-7ad79e65a41e tempest-GroupSnapshotsTest-343869671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-bf9acb2e-7d4e-4e61-9517-4bd28544b107.info {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:19:43 devstack sudo[89038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-bf9acb2e-7d4e-4e61-9517-4bd28544b107.info Sep 16 20:19:43 devstack sudo[89038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:19:43 devstack sudo[89038]: pam_unix(sudo:session): session closed for user root Sep 16 20:19:43 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-684025a7-ea0c-4e05-bb54-7ad79e65a41e tempest-GroupSnapshotsTest-343869671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-bf9acb2e-7d4e-4e61-9517-4bd28544b107.info" returned: 0 in 0.378s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:19:43 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-684025a7-ea0c-4e05-bb54-7ad79e65a41e tempest-GroupSnapshotsTest-343869671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.525s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:19:43 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a92b7319-1119-4d0b-91f1-6f8e546e584d tempest-ServerRescueNegativeTestJSON-2010112970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.291s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:19:43 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-a92b7319-1119-4d0b-91f1-6f8e546e584d tempest-ServerRescueNegativeTestJSON-2010112970 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:19:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1648713921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58f7d047-2fce-4b5f-b4e1-c6b2c48a671f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fb85507731644d5aa078a5169675b43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:19:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:19:41Z,use_quota=True,user_id='7a068588169a49d69d9cfecb0ec79723',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:19:43 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-a92b7319-1119-4d0b-91f1-6f8e546e584d tempest-ServerRescueNegativeTestJSON-2010112970 None] Creating volume 58f7d047-2fce-4b5f-b4e1-c6b2c48a671f {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:19:43 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a92b7319-1119-4d0b-91f1-6f8e546e584d tempest-ServerRescueNegativeTestJSON-2010112970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:19:43 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a92b7319-1119-4d0b-91f1-6f8e546e584d tempest-ServerRescueNegativeTestJSON-2010112970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:19:43 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-a92b7319-1119-4d0b-91f1-6f8e546e584d tempest-ServerRescueNegativeTestJSON-2010112970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:19:43 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-a92b7319-1119-4d0b-91f1-6f8e546e584d tempest-ServerRescueNegativeTestJSON-2010112970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:19:43 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a92b7319-1119-4d0b-91f1-6f8e546e584d tempest-ServerRescueNegativeTestJSON-2010112970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:19:43 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-a92b7319-1119-4d0b-91f1-6f8e546e584d tempest-ServerRescueNegativeTestJSON-2010112970 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:19:43 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-a92b7319-1119-4d0b-91f1-6f8e546e584d tempest-ServerRescueNegativeTestJSON-2010112970 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:19:43 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a92b7319-1119-4d0b-91f1-6f8e546e584d tempest-ServerRescueNegativeTestJSON-2010112970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-58f7d047-2fce-4b5f-b4e1-c6b2c48a671f 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:19:43 devstack sudo[89043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-58f7d047-2fce-4b5f-b4e1-c6b2c48a671f 1073741824 Sep 16 20:19:43 devstack sudo[89043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:19:43 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-684025a7-ea0c-4e05-bb54-7ad79e65a41e tempest-GroupSnapshotsTest-343869671 None] group_snapshot 86533d66-29bb-4427-bed4-913954503492: created successfully Sep 16 20:19:44 devstack sudo[89043]: pam_unix(sudo:session): session closed for user root Sep 16 20:19:44 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a92b7319-1119-4d0b-91f1-6f8e546e584d tempest-ServerRescueNegativeTestJSON-2010112970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-58f7d047-2fce-4b5f-b4e1-c6b2c48a671f 1073741824" returned: 0 in 1.153s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:19:44 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a92b7319-1119-4d0b-91f1-6f8e546e584d tempest-ServerRescueNegativeTestJSON-2010112970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-58f7d047-2fce-4b5f-b4e1-c6b2c48a671f {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:19:44 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-22c6cff0-65d0-4a73-a856-a19448a4fd24 tempest-GroupSnapshotsTest-343869671 None] group_snapshot 86533d66-29bb-4427-bed4-913954503492: deleting Sep 16 20:19:44 devstack sudo[89062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-58f7d047-2fce-4b5f-b4e1-c6b2c48a671f Sep 16 20:19:44 devstack sudo[89062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:19:44 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-22c6cff0-65d0-4a73-a856-a19448a4fd24 tempest-GroupSnapshotsTest-343869671 None] group_snapshot 86533d66-29bb-4427-bed4-913954503492: deleting {{(pid=86188) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 16 20:19:45 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-22c6cff0-65d0-4a73-a856-a19448a4fd24 tempest-GroupSnapshotsTest-343869671 None] Acquiring lock "cinder-quobyte-9ab5021e-73b9-41d2-addd-04d019cd2d5b" by "delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:19:45 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-22c6cff0-65d0-4a73-a856-a19448a4fd24 tempest-GroupSnapshotsTest-343869671 None] Lock "cinder-quobyte-9ab5021e-73b9-41d2-addd-04d019cd2d5b" acquired by "delete_snapshot" :: waited 0.064s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:19:45 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-22c6cff0-65d0-4a73-a856-a19448a4fd24 tempest-GroupSnapshotsTest-343869671 None] Acquiring lock "cinder-quobyte-20a5caed-6d5c-42de-b9da-7eef5b4120a2" by "_delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:19:45 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-22c6cff0-65d0-4a73-a856-a19448a4fd24 tempest-GroupSnapshotsTest-343869671 None] Lock "cinder-quobyte-20a5caed-6d5c-42de-b9da-7eef5b4120a2" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:19:45 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-22c6cff0-65d0-4a73-a856-a19448a4fd24 tempest-GroupSnapshotsTest-343869671 None] Deleting offline snapshot 20a5caed-6d5c-42de-b9da-7eef5b4120a2 of volume 9ab5021e-73b9-41d2-addd-04d019cd2d5b {{(pid=86188) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 20:19:45 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-22c6cff0-65d0-4a73-a856-a19448a4fd24 tempest-GroupSnapshotsTest-343869671 None] snapshot_file for this snap is: volume-9ab5021e-73b9-41d2-addd-04d019cd2d5b.20a5caed-6d5c-42de-b9da-7eef5b4120a2 {{(pid=86188) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 20:19:45 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[a94fc892-24ba-4593-afde-dfef26d7570b]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:19:45 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-22c6cff0-65d0-4a73-a856-a19448a4fd24 tempest-GroupSnapshotsTest-343869671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9ab5021e-73b9-41d2-addd-04d019cd2d5b.20a5caed-6d5c-42de-b9da-7eef5b4120a2 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:19:45 devstack sudo[89089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9ab5021e-73b9-41d2-addd-04d019cd2d5b.20a5caed-6d5c-42de-b9da-7eef5b4120a2 Sep 16 20:19:45 devstack sudo[89089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:19:45 devstack sudo[89062]: pam_unix(sudo:session): session closed for user root Sep 16 20:19:45 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a92b7319-1119-4d0b-91f1-6f8e546e584d tempest-ServerRescueNegativeTestJSON-2010112970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-58f7d047-2fce-4b5f-b4e1-c6b2c48a671f" returned: 0 in 1.028s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:19:45 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-a92b7319-1119-4d0b-91f1-6f8e546e584d tempest-ServerRescueNegativeTestJSON-2010112970 None] <== create_volume: return (2296ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:19:45 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a92b7319-1119-4d0b-91f1-6f8e546e584d tempest-ServerRescueNegativeTestJSON-2010112970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.300s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:19:45 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a92b7319-1119-4d0b-91f1-6f8e546e584d tempest-ServerRescueNegativeTestJSON-2010112970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf2a619a-b577-4cc8-879c-4bb1d23dd3ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58f7d047-2fce-4b5f-b4e1-c6b2c48a671f', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:19:45 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a92b7319-1119-4d0b-91f1-6f8e546e584d tempest-ServerRescueNegativeTestJSON-2010112970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1141c5cf-7588-4492-8a2b-6e99ad59134c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:19:46 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-a92b7319-1119-4d0b-91f1-6f8e546e584d tempest-ServerRescueNegativeTestJSON-2010112970 None] Volume volume-58f7d047-2fce-4b5f-b4e1-c6b2c48a671f (58f7d047-2fce-4b5f-b4e1-c6b2c48a671f): created successfully Sep 16 20:19:46 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a92b7319-1119-4d0b-91f1-6f8e546e584d tempest-ServerRescueNegativeTestJSON-2010112970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1141c5cf-7588-4492-8a2b-6e99ad59134c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:19:46 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a92b7319-1119-4d0b-91f1-6f8e546e584d tempest-ServerRescueNegativeTestJSON-2010112970 None] Flow 'volume_create_manager' (2f169c3a-5b3f-47e9-9feb-09afedb130a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:19:46 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-a92b7319-1119-4d0b-91f1-6f8e546e584d tempest-ServerRescueNegativeTestJSON-2010112970 None] Created volume successfully. Sep 16 20:19:46 devstack sudo[89089]: pam_unix(sudo:session): session closed for user root Sep 16 20:19:46 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-22c6cff0-65d0-4a73-a856-a19448a4fd24 tempest-GroupSnapshotsTest-343869671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9ab5021e-73b9-41d2-addd-04d019cd2d5b.20a5caed-6d5c-42de-b9da-7eef5b4120a2" returned: 0 in 1.337s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:19:46 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-22c6cff0-65d0-4a73-a856-a19448a4fd24 tempest-GroupSnapshotsTest-343869671 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ab5021e-73b9-41d2-addd-04d019cd2d5b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86188) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 20:19:46 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[0040b68a-c972-4bd0-a2c1-e6146f0d7393]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:19:46 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-22c6cff0-65d0-4a73-a856-a19448a4fd24 tempest-GroupSnapshotsTest-343869671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9ab5021e-73b9-41d2-addd-04d019cd2d5b {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:19:47 devstack sudo[89122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9ab5021e-73b9-41d2-addd-04d019cd2d5b Sep 16 20:19:47 devstack sudo[89122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:19:47 devstack sudo[89122]: pam_unix(sudo:session): session closed for user root Sep 16 20:19:47 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-22c6cff0-65d0-4a73-a856-a19448a4fd24 tempest-GroupSnapshotsTest-343869671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9ab5021e-73b9-41d2-addd-04d019cd2d5b" returned: 0 in 1.085s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:19:47 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-22c6cff0-65d0-4a73-a856-a19448a4fd24 tempest-GroupSnapshotsTest-343869671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9ab5021e-73b9-41d2-addd-04d019cd2d5b.20a5caed-6d5c-42de-b9da-7eef5b4120a2 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:19:47 devstack sudo[89140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9ab5021e-73b9-41d2-addd-04d019cd2d5b.20a5caed-6d5c-42de-b9da-7eef5b4120a2 Sep 16 20:19:47 devstack sudo[89140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:19:49 devstack sudo[89140]: pam_unix(sudo:session): session closed for user root Sep 16 20:19:49 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-22c6cff0-65d0-4a73-a856-a19448a4fd24 tempest-GroupSnapshotsTest-343869671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9ab5021e-73b9-41d2-addd-04d019cd2d5b.20a5caed-6d5c-42de-b9da-7eef5b4120a2" returned: 0 in 1.492s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:19:49 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-22c6cff0-65d0-4a73-a856-a19448a4fd24 tempest-GroupSnapshotsTest-343869671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9ab5021e-73b9-41d2-addd-04d019cd2d5b.20a5caed-6d5c-42de-b9da-7eef5b4120a2 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:19:49 devstack sudo[89175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9ab5021e-73b9-41d2-addd-04d019cd2d5b.20a5caed-6d5c-42de-b9da-7eef5b4120a2 Sep 16 20:19:49 devstack sudo[89175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:19:49 devstack sudo[89175]: pam_unix(sudo:session): session closed for user root Sep 16 20:19:49 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-22c6cff0-65d0-4a73-a856-a19448a4fd24 tempest-GroupSnapshotsTest-343869671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9ab5021e-73b9-41d2-addd-04d019cd2d5b.20a5caed-6d5c-42de-b9da-7eef5b4120a2" returned: 0 in 0.593s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:19:49 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-22c6cff0-65d0-4a73-a856-a19448a4fd24 tempest-GroupSnapshotsTest-343869671 None] Lock "cinder-quobyte-20a5caed-6d5c-42de-b9da-7eef5b4120a2" released by "_delete_snapshot" :: held 4.739s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:19:49 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-22c6cff0-65d0-4a73-a856-a19448a4fd24 tempest-GroupSnapshotsTest-343869671 None] Lock "cinder-quobyte-9ab5021e-73b9-41d2-addd-04d019cd2d5b" released by "delete_snapshot" :: held 4.796s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:19:49 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-22c6cff0-65d0-4a73-a856-a19448a4fd24 tempest-GroupSnapshotsTest-343869671 None] Acquiring lock "cinder-quobyte-bf9acb2e-7d4e-4e61-9517-4bd28544b107" by "delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:19:49 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-22c6cff0-65d0-4a73-a856-a19448a4fd24 tempest-GroupSnapshotsTest-343869671 None] Lock "cinder-quobyte-bf9acb2e-7d4e-4e61-9517-4bd28544b107" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:19:49 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-22c6cff0-65d0-4a73-a856-a19448a4fd24 tempest-GroupSnapshotsTest-343869671 None] Acquiring lock "cinder-quobyte-765d4170-f416-497d-a34a-e0c6b575b8fa" by "_delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:19:50 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-22c6cff0-65d0-4a73-a856-a19448a4fd24 tempest-GroupSnapshotsTest-343869671 None] Lock "cinder-quobyte-765d4170-f416-497d-a34a-e0c6b575b8fa" acquired by "_delete_snapshot" :: waited 0.053s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:19:50 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-22c6cff0-65d0-4a73-a856-a19448a4fd24 tempest-GroupSnapshotsTest-343869671 None] Deleting offline snapshot 765d4170-f416-497d-a34a-e0c6b575b8fa of volume bf9acb2e-7d4e-4e61-9517-4bd28544b107 {{(pid=86188) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 20:19:50 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-22c6cff0-65d0-4a73-a856-a19448a4fd24 tempest-GroupSnapshotsTest-343869671 None] snapshot_file for this snap is: volume-bf9acb2e-7d4e-4e61-9517-4bd28544b107.765d4170-f416-497d-a34a-e0c6b575b8fa {{(pid=86188) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 20:19:50 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f1526b0-250c-4a2a-97f7-594ccc3a9605]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:19:50 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-22c6cff0-65d0-4a73-a856-a19448a4fd24 tempest-GroupSnapshotsTest-343869671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-bf9acb2e-7d4e-4e61-9517-4bd28544b107.765d4170-f416-497d-a34a-e0c6b575b8fa {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:19:50 devstack sudo[89180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-bf9acb2e-7d4e-4e61-9517-4bd28544b107.765d4170-f416-497d-a34a-e0c6b575b8fa Sep 16 20:19:50 devstack sudo[89180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:19:50 devstack sudo[89180]: pam_unix(sudo:session): session closed for user root Sep 16 20:19:50 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-22c6cff0-65d0-4a73-a856-a19448a4fd24 tempest-GroupSnapshotsTest-343869671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-bf9acb2e-7d4e-4e61-9517-4bd28544b107.765d4170-f416-497d-a34a-e0c6b575b8fa" returned: 0 in 0.728s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:19:50 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-22c6cff0-65d0-4a73-a856-a19448a4fd24 tempest-GroupSnapshotsTest-343869671 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf9acb2e-7d4e-4e61-9517-4bd28544b107(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86188) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 20:19:50 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[23714ecc-6720-4542-b2dc-8cb3557f8223]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:19:50 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-22c6cff0-65d0-4a73-a856-a19448a4fd24 tempest-GroupSnapshotsTest-343869671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-bf9acb2e-7d4e-4e61-9517-4bd28544b107 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:19:51 devstack sudo[89191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-bf9acb2e-7d4e-4e61-9517-4bd28544b107 Sep 16 20:19:51 devstack sudo[89191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:19:51 devstack sudo[89191]: pam_unix(sudo:session): session closed for user root Sep 16 20:19:51 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-22c6cff0-65d0-4a73-a856-a19448a4fd24 tempest-GroupSnapshotsTest-343869671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-bf9acb2e-7d4e-4e61-9517-4bd28544b107" returned: 0 in 0.597s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:19:51 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-22c6cff0-65d0-4a73-a856-a19448a4fd24 tempest-GroupSnapshotsTest-343869671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-bf9acb2e-7d4e-4e61-9517-4bd28544b107.765d4170-f416-497d-a34a-e0c6b575b8fa {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:19:51 devstack sudo[89236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-bf9acb2e-7d4e-4e61-9517-4bd28544b107.765d4170-f416-497d-a34a-e0c6b575b8fa Sep 16 20:19:51 devstack sudo[89236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:19:52 devstack sudo[89236]: pam_unix(sudo:session): session closed for user root Sep 16 20:19:52 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-22c6cff0-65d0-4a73-a856-a19448a4fd24 tempest-GroupSnapshotsTest-343869671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-bf9acb2e-7d4e-4e61-9517-4bd28544b107.765d4170-f416-497d-a34a-e0c6b575b8fa" returned: 0 in 0.684s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:19:52 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-22c6cff0-65d0-4a73-a856-a19448a4fd24 tempest-GroupSnapshotsTest-343869671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-bf9acb2e-7d4e-4e61-9517-4bd28544b107.765d4170-f416-497d-a34a-e0c6b575b8fa {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:19:52 devstack sudo[89260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-bf9acb2e-7d4e-4e61-9517-4bd28544b107.765d4170-f416-497d-a34a-e0c6b575b8fa Sep 16 20:19:52 devstack sudo[89260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:19:52 devstack sudo[89260]: pam_unix(sudo:session): session closed for user root Sep 16 20:19:52 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-22c6cff0-65d0-4a73-a856-a19448a4fd24 tempest-GroupSnapshotsTest-343869671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-bf9acb2e-7d4e-4e61-9517-4bd28544b107.765d4170-f416-497d-a34a-e0c6b575b8fa" returned: 0 in 0.339s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:19:52 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-22c6cff0-65d0-4a73-a856-a19448a4fd24 tempest-GroupSnapshotsTest-343869671 None] Lock "cinder-quobyte-765d4170-f416-497d-a34a-e0c6b575b8fa" released by "_delete_snapshot" :: held 2.539s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:19:52 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-22c6cff0-65d0-4a73-a856-a19448a4fd24 tempest-GroupSnapshotsTest-343869671 None] Lock "cinder-quobyte-bf9acb2e-7d4e-4e61-9517-4bd28544b107" released by "delete_snapshot" :: held 2.609s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:19:52 devstack cinder-volume[86188]: WARNING cinder.quota [None req-22c6cff0-65d0-4a73-a856-a19448a4fd24 tempest-GroupSnapshotsTest-343869671 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1471426036 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1471426036, it is now deprecated. Please use the default quota class for default quota. Sep 16 20:19:52 devstack cinder-volume[86188]: WARNING cinder.quota [None req-22c6cff0-65d0-4a73-a856-a19448a4fd24 tempest-GroupSnapshotsTest-343869671 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1471426036 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1471426036, it is now deprecated. Please use the default quota class for default quota. Sep 16 20:19:52 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-22c6cff0-65d0-4a73-a856-a19448a4fd24 tempest-GroupSnapshotsTest-343869671 None] Created reservations ['5dbf15d8-7fcd-4291-8eb3-3f131249956c', 'f90d061a-35bb-4b0a-82e1-8a6f46e894e5', 'bdc2cdfc-9b8a-4e11-a882-888f70308c73', '45e5b0da-1bde-4550-9025-7e28de23644b'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:19:52 devstack cinder-volume[86188]: DEBUG oslo_service.periodic_task [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86188) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 20:19:52 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:19:52 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:19:52 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:19:53 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:19:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:19:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:19:53 devstack sudo[89271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:19:53 devstack sudo[89271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:19:53 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-22c6cff0-65d0-4a73-a856-a19448a4fd24 tempest-GroupSnapshotsTest-343869671 None] Created reservations ['380a71c5-3f3b-4da6-af17-471f2e8e94a6', '650167c0-18b3-46b1-911a-efd7df358590', '2e8e4894-668e-4b99-acc3-3ad4e78de853', '75cf6820-6f92-404d-a8c6-3ffe33253fcc'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:19:53 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-22c6cff0-65d0-4a73-a856-a19448a4fd24 tempest-GroupSnapshotsTest-343869671 None] group_snapshot 86533d66-29bb-4427-bed4-913954503492: deleted successfully Sep 16 20:19:53 devstack sudo[89271]: pam_unix(sudo:session): session closed for user root Sep 16 20:19:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.378s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:19:53 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:19:54 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-7ae12504-a45d-4093-b3b2-75df7e9119f7 tempest-GroupSnapshotsTest-343869671 None] Acquiring lock "cinder-quobyte-9ab5021e-73b9-41d2-addd-04d019cd2d5b" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:19:54 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-7ae12504-a45d-4093-b3b2-75df7e9119f7 tempest-GroupSnapshotsTest-343869671 None] Lock "cinder-quobyte-9ab5021e-73b9-41d2-addd-04d019cd2d5b" acquired by "delete_volume" :: waited 0.022s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:19:54 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[6af5953e-49d5-48c5-b188-131fa2542ee1]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:19:54 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-7ae12504-a45d-4093-b3b2-75df7e9119f7 tempest-GroupSnapshotsTest-343869671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9ab5021e-73b9-41d2-addd-04d019cd2d5b {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:19:55 devstack sudo[89278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9ab5021e-73b9-41d2-addd-04d019cd2d5b Sep 16 20:19:55 devstack sudo[89278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:19:55 devstack sudo[89278]: pam_unix(sudo:session): session closed for user root Sep 16 20:19:55 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-7ae12504-a45d-4093-b3b2-75df7e9119f7 tempest-GroupSnapshotsTest-343869671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9ab5021e-73b9-41d2-addd-04d019cd2d5b" returned: 0 in 0.780s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:19:55 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-7ae12504-a45d-4093-b3b2-75df7e9119f7 tempest-GroupSnapshotsTest-343869671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9ab5021e-73b9-41d2-addd-04d019cd2d5b {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:19:55 devstack sudo[89284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9ab5021e-73b9-41d2-addd-04d019cd2d5b Sep 16 20:19:55 devstack sudo[89284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:19:55 devstack sudo[89284]: pam_unix(sudo:session): session closed for user root Sep 16 20:19:55 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-7ae12504-a45d-4093-b3b2-75df7e9119f7 tempest-GroupSnapshotsTest-343869671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9ab5021e-73b9-41d2-addd-04d019cd2d5b" returned: 0 in 0.319s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:19:56 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-7ae12504-a45d-4093-b3b2-75df7e9119f7 tempest-GroupSnapshotsTest-343869671 None] Lock "cinder-quobyte-9ab5021e-73b9-41d2-addd-04d019cd2d5b" released by "delete_volume" :: held 1.248s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:19:56 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-7ae12504-a45d-4093-b3b2-75df7e9119f7 tempest-GroupSnapshotsTest-343869671 None] Acquiring lock "cinder-quobyte-bf9acb2e-7d4e-4e61-9517-4bd28544b107" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:19:56 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-7ae12504-a45d-4093-b3b2-75df7e9119f7 tempest-GroupSnapshotsTest-343869671 None] Lock "cinder-quobyte-bf9acb2e-7d4e-4e61-9517-4bd28544b107" acquired by "delete_volume" :: waited 0.020s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:19:56 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[af8e93b3-cd84-4c6d-8354-58ea9021bb67]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:19:56 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-7ae12504-a45d-4093-b3b2-75df7e9119f7 tempest-GroupSnapshotsTest-343869671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-bf9acb2e-7d4e-4e61-9517-4bd28544b107 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:19:56 devstack sudo[89287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-bf9acb2e-7d4e-4e61-9517-4bd28544b107 Sep 16 20:19:56 devstack sudo[89287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:19:56 devstack sudo[89287]: pam_unix(sudo:session): session closed for user root Sep 16 20:19:56 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-7ae12504-a45d-4093-b3b2-75df7e9119f7 tempest-GroupSnapshotsTest-343869671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-bf9acb2e-7d4e-4e61-9517-4bd28544b107" returned: 0 in 0.609s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:19:56 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-7ae12504-a45d-4093-b3b2-75df7e9119f7 tempest-GroupSnapshotsTest-343869671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-bf9acb2e-7d4e-4e61-9517-4bd28544b107 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:19:56 devstack sudo[89302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-bf9acb2e-7d4e-4e61-9517-4bd28544b107 Sep 16 20:19:56 devstack sudo[89302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:19:57 devstack sudo[89302]: pam_unix(sudo:session): session closed for user root Sep 16 20:19:57 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-7ae12504-a45d-4093-b3b2-75df7e9119f7 tempest-GroupSnapshotsTest-343869671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-bf9acb2e-7d4e-4e61-9517-4bd28544b107" returned: 0 in 0.457s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:19:57 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-7ae12504-a45d-4093-b3b2-75df7e9119f7 tempest-GroupSnapshotsTest-343869671 None] Lock "cinder-quobyte-bf9acb2e-7d4e-4e61-9517-4bd28544b107" released by "delete_volume" :: held 1.187s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:19:57 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-7ae12504-a45d-4093-b3b2-75df7e9119f7 tempest-GroupSnapshotsTest-343869671 None] Created reservations ['9dafe1a0-c0ea-4985-a8c8-8d9a6c8754f1'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:19:57 devstack cinder-volume[86188]: WARNING cinder.quota [None req-7ae12504-a45d-4093-b3b2-75df7e9119f7 tempest-GroupSnapshotsTest-343869671 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1471426036 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1471426036, it is now deprecated. Please use the default quota class for default quota. Sep 16 20:19:57 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-7ae12504-a45d-4093-b3b2-75df7e9119f7 tempest-GroupSnapshotsTest-343869671 None] Created reservations ['f665d0a4-ee01-43a3-b4d3-ea395c00d070', 'd4a7b90a-f352-4ec5-8be2-a3c5d45eb003', '23359765-cb93-487a-8caf-dde593c2b298', '6d2ae518-f0dd-4e5b-abd8-c57b8cc742fa'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:19:57 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-7ae12504-a45d-4093-b3b2-75df7e9119f7 tempest-GroupSnapshotsTest-343869671 None] Created reservations ['a804ecd4-53c1-4a01-b423-2c72368a4063', '0a69d1e8-17c3-4af9-a9a1-97dfae14a88b', 'b56d5e60-3739-4318-a3fa-e73ed8c4309d', 'aa7b4485-b07d-4c3d-bcf1-5b1fd7a048bc'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:19:57 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-7ae12504-a45d-4093-b3b2-75df7e9119f7 tempest-GroupSnapshotsTest-343869671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:19:57 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-7ae12504-a45d-4093-b3b2-75df7e9119f7 tempest-GroupSnapshotsTest-343869671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:19:57 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-7ae12504-a45d-4093-b3b2-75df7e9119f7 tempest-GroupSnapshotsTest-343869671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:19:57 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-7ae12504-a45d-4093-b3b2-75df7e9119f7 tempest-GroupSnapshotsTest-343869671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:19:57 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-7ae12504-a45d-4093-b3b2-75df7e9119f7 tempest-GroupSnapshotsTest-343869671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:19:57 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-7ae12504-a45d-4093-b3b2-75df7e9119f7 tempest-GroupSnapshotsTest-343869671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:19:57 devstack sudo[89322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:19:57 devstack sudo[89322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:19:58 devstack sudo[89322]: pam_unix(sudo:session): session closed for user root Sep 16 20:19:58 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-7ae12504-a45d-4093-b3b2-75df7e9119f7 tempest-GroupSnapshotsTest-343869671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.356s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:19:58 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-7ae12504-a45d-4093-b3b2-75df7e9119f7 tempest-GroupSnapshotsTest-343869671 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:19:58 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-7ae12504-a45d-4093-b3b2-75df7e9119f7 tempest-GroupSnapshotsTest-343869671 None] Delete group completed successfully. Sep 16 20:19:59 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-2ddff4a9-8041-4db4-90c5-76c990b9b73a tempest-GroupSnapshotsTest-343869671 None] Group tempest-GroupSnapshotsTest-Group-646273285: creating Sep 16 20:19:59 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-2ddff4a9-8041-4db4-90c5-76c990b9b73a tempest-GroupSnapshotsTest-343869671 None] Group tempest-GroupSnapshotsTest-Group-646273285: created successfully Sep 16 20:19:59 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-2ddff4a9-8041-4db4-90c5-76c990b9b73a tempest-GroupSnapshotsTest-343869671 None] Create group completed successfully. Sep 16 20:20:00 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-c8dcd4ae-3aa5-4749-86a0-ae79d3a7902f tempest-ServerRescueNegativeTestJSON-2010112970 None] Acquiring lock "cinder-58f7d047-2fce-4b5f-b4e1-c6b2c48a671f-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:20:00 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-c8dcd4ae-3aa5-4749-86a0-ae79d3a7902f tempest-ServerRescueNegativeTestJSON-2010112970 None] Lock "cinder-58f7d047-2fce-4b5f-b4e1-c6b2c48a671f-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:20:00 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-c8dcd4ae-3aa5-4749-86a0-ae79d3a7902f tempest-ServerRescueNegativeTestJSON-2010112970 None] Acquiring lock "cinder-quobyte-58f7d047-2fce-4b5f-b4e1-c6b2c48a671f" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:20:00 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-c8dcd4ae-3aa5-4749-86a0-ae79d3a7902f tempest-ServerRescueNegativeTestJSON-2010112970 None] Lock "cinder-quobyte-58f7d047-2fce-4b5f-b4e1-c6b2c48a671f" acquired by "delete_volume" :: waited 0.046s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:20:00 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[31977edf-c0e2-49d0-aa7c-8fea18e6c9a6]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:20:00 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-c8dcd4ae-3aa5-4749-86a0-ae79d3a7902f tempest-ServerRescueNegativeTestJSON-2010112970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-58f7d047-2fce-4b5f-b4e1-c6b2c48a671f {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:20:00 devstack sudo[89329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-58f7d047-2fce-4b5f-b4e1-c6b2c48a671f Sep 16 20:20:00 devstack sudo[89329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:20:01 devstack sudo[89329]: pam_unix(sudo:session): session closed for user root Sep 16 20:20:01 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-c8dcd4ae-3aa5-4749-86a0-ae79d3a7902f tempest-ServerRescueNegativeTestJSON-2010112970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-58f7d047-2fce-4b5f-b4e1-c6b2c48a671f" returned: 0 in 0.964s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:20:01 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-c8dcd4ae-3aa5-4749-86a0-ae79d3a7902f tempest-ServerRescueNegativeTestJSON-2010112970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-58f7d047-2fce-4b5f-b4e1-c6b2c48a671f {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:20:01 devstack sudo[89335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-58f7d047-2fce-4b5f-b4e1-c6b2c48a671f Sep 16 20:20:01 devstack sudo[89335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:20:01 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b170fe4-87c5-451f-be94-a3a2af818a47 tempest-GroupSnapshotsTest-343869671 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:20:01 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-2b170fe4-87c5-451f-be94-a3a2af818a47 tempest-GroupSnapshotsTest-343869671 None] Flow 'volume_create_manager' (945159ca-35b2-400a-b421-a57dac2767d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:20:01 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-2b170fe4-87c5-451f-be94-a3a2af818a47 tempest-GroupSnapshotsTest-343869671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9a29ff3-10e0-43d6-aaaa-a2ce33f37660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:20:02 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-2b170fe4-87c5-451f-be94-a3a2af818a47 tempest-GroupSnapshotsTest-343869671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9a29ff3-10e0-43d6-aaaa-a2ce33f37660) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:20:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-239988958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1e5cbdef-26f2-4d9e-a590-7c4e028043d1,host='devstack@QuobyteHD#QuobyteHD',id=ee3f4e08-45cf-4457-a549-75ad9d4c800c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='534482648c0a44eca02903f01ab2a59f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:20:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:20:02Z,use_quota=True,user_id='737c8364b2ac4d61aa1565d88d58cf84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e8a8d3d-35af-40c8-b850-4f29bcad40fa),volume_type_id=8e8a8d3d-35af-40c8-b850-4f29bcad40fa)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:20:02 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-2b170fe4-87c5-451f-be94-a3a2af818a47 tempest-GroupSnapshotsTest-343869671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f135bb3-f4c4-473d-86d4-a400b6a1fb67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:20:02 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-2b170fe4-87c5-451f-be94-a3a2af818a47 tempest-GroupSnapshotsTest-343869671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f135bb3-f4c4-473d-86d4-a400b6a1fb67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:20:02 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-2b170fe4-87c5-451f-be94-a3a2af818a47 tempest-GroupSnapshotsTest-343869671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8435df48-a3f1-42c9-a204-796bb60f4a45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:20:02 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-2b170fe4-87c5-451f-be94-a3a2af818a47 tempest-GroupSnapshotsTest-343869671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8435df48-a3f1-42c9-a204-796bb60f4a45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee3f4e08-45cf-4457-a549-75ad9d4c800c', 'volume_name': 'volume-ee3f4e08-45cf-4457-a549-75ad9d4c800c', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:20:02 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-2b170fe4-87c5-451f-be94-a3a2af818a47 tempest-GroupSnapshotsTest-343869671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (099ccf80-4a1e-47bf-8e14-7294a4c59298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:20:02 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-2b170fe4-87c5-451f-be94-a3a2af818a47 tempest-GroupSnapshotsTest-343869671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (099ccf80-4a1e-47bf-8e14-7294a4c59298) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:20:02 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-2b170fe4-87c5-451f-be94-a3a2af818a47 tempest-GroupSnapshotsTest-343869671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4522f4db-2c01-4da1-a74c-62bf1aeca92c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:20:02 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-2b170fe4-87c5-451f-be94-a3a2af818a47 tempest-GroupSnapshotsTest-343869671 None] Volume ee3f4e08-45cf-4457-a549-75ad9d4c800c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee3f4e08-45cf-4457-a549-75ad9d4c800c', 'volume_size': 1} Sep 16 20:20:02 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-2b170fe4-87c5-451f-be94-a3a2af818a47 tempest-GroupSnapshotsTest-343869671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:20:02 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-2b170fe4-87c5-451f-be94-a3a2af818a47 tempest-GroupSnapshotsTest-343869671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:20:02 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-2b170fe4-87c5-451f-be94-a3a2af818a47 tempest-GroupSnapshotsTest-343869671 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=1e5cbdef-26f2-4d9e-a590-7c4e028043d1,created_at=2026-09-16T18:20:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-239988958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1e5cbdef-26f2-4d9e-a590-7c4e028043d1,host='devstack@QuobyteHD#QuobyteHD',id=ee3f4e08-45cf-4457-a549-75ad9d4c800c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='534482648c0a44eca02903f01ab2a59f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:20:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:20:02Z,use_quota=True,user_id='737c8364b2ac4d61aa1565d88d58cf84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e8a8d3d-35af-40c8-b850-4f29bcad40fa),volume_type_id=8e8a8d3d-35af-40c8-b850-4f29bcad40fa)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:20:02 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-2b170fe4-87c5-451f-be94-a3a2af818a47 tempest-GroupSnapshotsTest-343869671 None] Creating volume ee3f4e08-45cf-4457-a549-75ad9d4c800c {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:20:02 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-2b170fe4-87c5-451f-be94-a3a2af818a47 tempest-GroupSnapshotsTest-343869671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:20:02 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-2b170fe4-87c5-451f-be94-a3a2af818a47 tempest-GroupSnapshotsTest-343869671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:20:02 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-2b170fe4-87c5-451f-be94-a3a2af818a47 tempest-GroupSnapshotsTest-343869671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:20:02 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-2b170fe4-87c5-451f-be94-a3a2af818a47 tempest-GroupSnapshotsTest-343869671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:20:02 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-2b170fe4-87c5-451f-be94-a3a2af818a47 tempest-GroupSnapshotsTest-343869671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:20:02 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-2b170fe4-87c5-451f-be94-a3a2af818a47 tempest-GroupSnapshotsTest-343869671 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:20:02 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-2b170fe4-87c5-451f-be94-a3a2af818a47 tempest-GroupSnapshotsTest-343869671 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:20:02 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-2b170fe4-87c5-451f-be94-a3a2af818a47 tempest-GroupSnapshotsTest-343869671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ee3f4e08-45cf-4457-a549-75ad9d4c800c 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:20:02 devstack sudo[89340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ee3f4e08-45cf-4457-a549-75ad9d4c800c 1073741824 Sep 16 20:20:02 devstack sudo[89340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:20:02 devstack sudo[89335]: pam_unix(sudo:session): session closed for user root Sep 16 20:20:02 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-c8dcd4ae-3aa5-4749-86a0-ae79d3a7902f tempest-ServerRescueNegativeTestJSON-2010112970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-58f7d047-2fce-4b5f-b4e1-c6b2c48a671f" returned: 0 in 0.591s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:20:02 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-c8dcd4ae-3aa5-4749-86a0-ae79d3a7902f tempest-ServerRescueNegativeTestJSON-2010112970 None] Lock "cinder-quobyte-58f7d047-2fce-4b5f-b4e1-c6b2c48a671f" released by "delete_volume" :: held 1.668s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:20:02 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-c8dcd4ae-3aa5-4749-86a0-ae79d3a7902f tempest-ServerRescueNegativeTestJSON-2010112970 None] Created reservations ['0807fc1e-359d-4e93-ad77-b05a19efebf1', 'e586cd9b-ba42-4305-9006-35857ef295fc', '959a9d0d-d13c-4a6a-a2bf-08ff179a3f35', 'ed93d20b-0a54-4ec2-8808-d6b17c8dd242'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:20:02 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-c8dcd4ae-3aa5-4749-86a0-ae79d3a7902f tempest-ServerRescueNegativeTestJSON-2010112970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:20:02 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-c8dcd4ae-3aa5-4749-86a0-ae79d3a7902f tempest-ServerRescueNegativeTestJSON-2010112970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:20:02 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-c8dcd4ae-3aa5-4749-86a0-ae79d3a7902f tempest-ServerRescueNegativeTestJSON-2010112970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:20:02 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-c8dcd4ae-3aa5-4749-86a0-ae79d3a7902f tempest-ServerRescueNegativeTestJSON-2010112970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:20:02 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-c8dcd4ae-3aa5-4749-86a0-ae79d3a7902f tempest-ServerRescueNegativeTestJSON-2010112970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:20:02 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-c8dcd4ae-3aa5-4749-86a0-ae79d3a7902f tempest-ServerRescueNegativeTestJSON-2010112970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:20:02 devstack sudo[89376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:20:02 devstack sudo[89376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:20:03 devstack sudo[89376]: pam_unix(sudo:session): session closed for user root Sep 16 20:20:03 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-c8dcd4ae-3aa5-4749-86a0-ae79d3a7902f tempest-ServerRescueNegativeTestJSON-2010112970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.590s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:20:03 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-c8dcd4ae-3aa5-4749-86a0-ae79d3a7902f tempest-ServerRescueNegativeTestJSON-2010112970 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:20:03 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-c8dcd4ae-3aa5-4749-86a0-ae79d3a7902f tempest-ServerRescueNegativeTestJSON-2010112970 None] Deleted volume successfully. Sep 16 20:20:03 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-c8dcd4ae-3aa5-4749-86a0-ae79d3a7902f tempest-ServerRescueNegativeTestJSON-2010112970 None] Lock "cinder-58f7d047-2fce-4b5f-b4e1-c6b2c48a671f-delete_volume" released by "delete_volume" :: held 2.822s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:20:03 devstack sudo[89340]: pam_unix(sudo:session): session closed for user root Sep 16 20:20:03 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-2b170fe4-87c5-451f-be94-a3a2af818a47 tempest-GroupSnapshotsTest-343869671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ee3f4e08-45cf-4457-a549-75ad9d4c800c 1073741824" returned: 0 in 1.185s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:20:03 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-2b170fe4-87c5-451f-be94-a3a2af818a47 tempest-GroupSnapshotsTest-343869671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ee3f4e08-45cf-4457-a549-75ad9d4c800c {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:20:03 devstack sudo[89393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ee3f4e08-45cf-4457-a549-75ad9d4c800c Sep 16 20:20:03 devstack sudo[89393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:20:03 devstack sudo[89393]: pam_unix(sudo:session): session closed for user root Sep 16 20:20:03 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-2b170fe4-87c5-451f-be94-a3a2af818a47 tempest-GroupSnapshotsTest-343869671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ee3f4e08-45cf-4457-a549-75ad9d4c800c" returned: 0 in 0.527s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:20:03 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-2b170fe4-87c5-451f-be94-a3a2af818a47 tempest-GroupSnapshotsTest-343869671 None] <== create_volume: return (1802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:20:03 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-2b170fe4-87c5-451f-be94-a3a2af818a47 tempest-GroupSnapshotsTest-343869671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.812s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:20:03 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-2b170fe4-87c5-451f-be94-a3a2af818a47 tempest-GroupSnapshotsTest-343869671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4522f4db-2c01-4da1-a74c-62bf1aeca92c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee3f4e08-45cf-4457-a549-75ad9d4c800c', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:20:03 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-2b170fe4-87c5-451f-be94-a3a2af818a47 tempest-GroupSnapshotsTest-343869671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e00e8308-73d3-4c2c-bb76-25fa7f69959d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:20:04 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-2b170fe4-87c5-451f-be94-a3a2af818a47 tempest-GroupSnapshotsTest-343869671 None] Volume volume-ee3f4e08-45cf-4457-a549-75ad9d4c800c (ee3f4e08-45cf-4457-a549-75ad9d4c800c): created successfully Sep 16 20:20:04 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-2b170fe4-87c5-451f-be94-a3a2af818a47 tempest-GroupSnapshotsTest-343869671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e00e8308-73d3-4c2c-bb76-25fa7f69959d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:20:04 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-2b170fe4-87c5-451f-be94-a3a2af818a47 tempest-GroupSnapshotsTest-343869671 None] Flow 'volume_create_manager' (945159ca-35b2-400a-b421-a57dac2767d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:20:04 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-2b170fe4-87c5-451f-be94-a3a2af818a47 tempest-GroupSnapshotsTest-343869671 None] Created volume successfully. Sep 16 20:20:05 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-2e096a98-2cea-4d02-9b4c-2eecb0414e8e tempest-GroupSnapshotsTest-343869671 None] GroupSnapshot 8848caf4-9f1f-413b-be24-327b2bf90366: creating. Sep 16 20:20:05 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-2e096a98-2cea-4d02-9b4c-2eecb0414e8e tempest-GroupSnapshotsTest-343869671 None] Group snapshot 8848caf4-9f1f-413b-be24-327b2bf90366: creating. {{(pid=86188) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 16 20:20:05 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-2e096a98-2cea-4d02-9b4c-2eecb0414e8e tempest-GroupSnapshotsTest-343869671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:20:05 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-2e096a98-2cea-4d02-9b4c-2eecb0414e8e tempest-GroupSnapshotsTest-343869671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:20:05 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-2e096a98-2cea-4d02-9b4c-2eecb0414e8e tempest-GroupSnapshotsTest-343869671 None] Creating offline snapshot cea5d0c8-3d74-4421-b84d-93d88466d01e of volume ee3f4e08-45cf-4457-a549-75ad9d4c800c {{(pid=86188) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 20:20:05 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5368c2f-83d2-4f14-89a0-37bc3d89abe8]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:20:05 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-2e096a98-2cea-4d02-9b4c-2eecb0414e8e tempest-GroupSnapshotsTest-343869671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ee3f4e08-45cf-4457-a549-75ad9d4c800c {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:20:05 devstack sudo[89442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ee3f4e08-45cf-4457-a549-75ad9d4c800c Sep 16 20:20:05 devstack sudo[89442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:20:05 devstack sudo[89442]: pam_unix(sudo:session): session closed for user root Sep 16 20:20:05 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-2e096a98-2cea-4d02-9b4c-2eecb0414e8e tempest-GroupSnapshotsTest-343869671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ee3f4e08-45cf-4457-a549-75ad9d4c800c" returned: 0 in 0.551s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:20:05 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-2e096a98-2cea-4d02-9b4c-2eecb0414e8e tempest-GroupSnapshotsTest-343869671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ee3f4e08-45cf-4457-a549-75ad9d4c800c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ee3f4e08-45cf-4457-a549-75ad9d4c800c.cea5d0c8-3d74-4421-b84d-93d88466d01e 1G {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:20:05 devstack sudo[89448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ee3f4e08-45cf-4457-a549-75ad9d4c800c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ee3f4e08-45cf-4457-a549-75ad9d4c800c.cea5d0c8-3d74-4421-b84d-93d88466d01e 1G Sep 16 20:20:05 devstack sudo[89448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:20:06 devstack sudo[89448]: pam_unix(sudo:session): session closed for user root Sep 16 20:20:06 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-2e096a98-2cea-4d02-9b4c-2eecb0414e8e tempest-GroupSnapshotsTest-343869671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ee3f4e08-45cf-4457-a549-75ad9d4c800c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ee3f4e08-45cf-4457-a549-75ad9d4c800c.cea5d0c8-3d74-4421-b84d-93d88466d01e 1G" returned: 0 in 0.658s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:20:06 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-2e096a98-2cea-4d02-9b4c-2eecb0414e8e tempest-GroupSnapshotsTest-343869671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee3f4e08-45cf-4457-a549-75ad9d4c800c -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ee3f4e08-45cf-4457-a549-75ad9d4c800c.cea5d0c8-3d74-4421-b84d-93d88466d01e {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:20:06 devstack sudo[89454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee3f4e08-45cf-4457-a549-75ad9d4c800c -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ee3f4e08-45cf-4457-a549-75ad9d4c800c.cea5d0c8-3d74-4421-b84d-93d88466d01e Sep 16 20:20:06 devstack sudo[89454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:20:06 devstack sudo[89454]: pam_unix(sudo:session): session closed for user root Sep 16 20:20:06 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-2e096a98-2cea-4d02-9b4c-2eecb0414e8e tempest-GroupSnapshotsTest-343869671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee3f4e08-45cf-4457-a549-75ad9d4c800c -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ee3f4e08-45cf-4457-a549-75ad9d4c800c.cea5d0c8-3d74-4421-b84d-93d88466d01e" returned: 0 in 0.391s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:20:06 devstack cinder-volume[86188]: WARNING cinder.volume.drivers.remotefs [None req-2e096a98-2cea-4d02-9b4c-2eecb0414e8e tempest-GroupSnapshotsTest-343869671 None] /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ee3f4e08-45cf-4457-a549-75ad9d4c800c.cea5d0c8-3d74-4421-b84d-93d88466d01e is being set with open permissions: ugo+rw: NotImplementedError Sep 16 20:20:06 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-2e096a98-2cea-4d02-9b4c-2eecb0414e8e tempest-GroupSnapshotsTest-343869671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ee3f4e08-45cf-4457-a549-75ad9d4c800c.cea5d0c8-3d74-4421-b84d-93d88466d01e {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:20:06 devstack sudo[89462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ee3f4e08-45cf-4457-a549-75ad9d4c800c.cea5d0c8-3d74-4421-b84d-93d88466d01e Sep 16 20:20:06 devstack sudo[89462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:20:07 devstack sudo[89462]: pam_unix(sudo:session): session closed for user root Sep 16 20:20:07 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-2e096a98-2cea-4d02-9b4c-2eecb0414e8e tempest-GroupSnapshotsTest-343869671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ee3f4e08-45cf-4457-a549-75ad9d4c800c.cea5d0c8-3d74-4421-b84d-93d88466d01e" returned: 0 in 0.328s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:20:07 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-2e096a98-2cea-4d02-9b4c-2eecb0414e8e tempest-GroupSnapshotsTest-343869671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ee3f4e08-45cf-4457-a549-75ad9d4c800c.info {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:20:07 devstack sudo[89482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ee3f4e08-45cf-4457-a549-75ad9d4c800c.info Sep 16 20:20:07 devstack sudo[89482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:20:07 devstack sudo[89482]: pam_unix(sudo:session): session closed for user root Sep 16 20:20:07 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-2e096a98-2cea-4d02-9b4c-2eecb0414e8e tempest-GroupSnapshotsTest-343869671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ee3f4e08-45cf-4457-a549-75ad9d4c800c.info" returned: 0 in 0.295s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:20:07 devstack cinder-volume[86188]: WARNING cinder.volume.drivers.remotefs [None req-2e096a98-2cea-4d02-9b4c-2eecb0414e8e tempest-GroupSnapshotsTest-343869671 None] /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ee3f4e08-45cf-4457-a549-75ad9d4c800c.info is being set with open permissions: ugo+rw: NotImplementedError Sep 16 20:20:07 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-2e096a98-2cea-4d02-9b4c-2eecb0414e8e tempest-GroupSnapshotsTest-343869671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ee3f4e08-45cf-4457-a549-75ad9d4c800c.info {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:20:07 devstack sudo[89490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ee3f4e08-45cf-4457-a549-75ad9d4c800c.info Sep 16 20:20:07 devstack sudo[89490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:20:07 devstack sudo[89490]: pam_unix(sudo:session): session closed for user root Sep 16 20:20:07 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-2e096a98-2cea-4d02-9b4c-2eecb0414e8e tempest-GroupSnapshotsTest-343869671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ee3f4e08-45cf-4457-a549-75ad9d4c800c.info" returned: 0 in 0.275s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:20:07 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-2e096a98-2cea-4d02-9b4c-2eecb0414e8e tempest-GroupSnapshotsTest-343869671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.669s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:20:07 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-2e096a98-2cea-4d02-9b4c-2eecb0414e8e tempest-GroupSnapshotsTest-343869671 None] group_snapshot 8848caf4-9f1f-413b-be24-327b2bf90366: created successfully Sep 16 20:20:08 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-aad534b5-3510-4625-8bac-eb2ab3bcb348 tempest-GroupSnapshotsTest-343869671 None] group_snapshot 8848caf4-9f1f-413b-be24-327b2bf90366: deleting Sep 16 20:20:08 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-aad534b5-3510-4625-8bac-eb2ab3bcb348 tempest-GroupSnapshotsTest-343869671 None] group_snapshot 8848caf4-9f1f-413b-be24-327b2bf90366: deleting {{(pid=86188) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 16 20:20:08 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-aad534b5-3510-4625-8bac-eb2ab3bcb348 tempest-GroupSnapshotsTest-343869671 None] Acquiring lock "cinder-quobyte-ee3f4e08-45cf-4457-a549-75ad9d4c800c" by "delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:20:08 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-aad534b5-3510-4625-8bac-eb2ab3bcb348 tempest-GroupSnapshotsTest-343869671 None] Lock "cinder-quobyte-ee3f4e08-45cf-4457-a549-75ad9d4c800c" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:20:08 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-aad534b5-3510-4625-8bac-eb2ab3bcb348 tempest-GroupSnapshotsTest-343869671 None] Acquiring lock "cinder-quobyte-cea5d0c8-3d74-4421-b84d-93d88466d01e" by "_delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:20:08 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-aad534b5-3510-4625-8bac-eb2ab3bcb348 tempest-GroupSnapshotsTest-343869671 None] Lock "cinder-quobyte-cea5d0c8-3d74-4421-b84d-93d88466d01e" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:20:08 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-aad534b5-3510-4625-8bac-eb2ab3bcb348 tempest-GroupSnapshotsTest-343869671 None] Deleting offline snapshot cea5d0c8-3d74-4421-b84d-93d88466d01e of volume ee3f4e08-45cf-4457-a549-75ad9d4c800c {{(pid=86188) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 20:20:08 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-aad534b5-3510-4625-8bac-eb2ab3bcb348 tempest-GroupSnapshotsTest-343869671 None] snapshot_file for this snap is: volume-ee3f4e08-45cf-4457-a549-75ad9d4c800c.cea5d0c8-3d74-4421-b84d-93d88466d01e {{(pid=86188) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 20:20:08 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[12afafe8-d148-4344-8f52-812130b8289a]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:20:08 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-aad534b5-3510-4625-8bac-eb2ab3bcb348 tempest-GroupSnapshotsTest-343869671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ee3f4e08-45cf-4457-a549-75ad9d4c800c.cea5d0c8-3d74-4421-b84d-93d88466d01e {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:20:08 devstack sudo[89496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ee3f4e08-45cf-4457-a549-75ad9d4c800c.cea5d0c8-3d74-4421-b84d-93d88466d01e Sep 16 20:20:08 devstack sudo[89496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:20:09 devstack sudo[89496]: pam_unix(sudo:session): session closed for user root Sep 16 20:20:09 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-aad534b5-3510-4625-8bac-eb2ab3bcb348 tempest-GroupSnapshotsTest-343869671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ee3f4e08-45cf-4457-a549-75ad9d4c800c.cea5d0c8-3d74-4421-b84d-93d88466d01e" returned: 0 in 0.457s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:20:09 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-aad534b5-3510-4625-8bac-eb2ab3bcb348 tempest-GroupSnapshotsTest-343869671 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee3f4e08-45cf-4457-a549-75ad9d4c800c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86188) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 20:20:09 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[a341bf37-60d8-43ee-a3ef-2c71e5866faf]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:20:09 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-aad534b5-3510-4625-8bac-eb2ab3bcb348 tempest-GroupSnapshotsTest-343869671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ee3f4e08-45cf-4457-a549-75ad9d4c800c {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:20:09 devstack sudo[89502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ee3f4e08-45cf-4457-a549-75ad9d4c800c Sep 16 20:20:09 devstack sudo[89502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:20:09 devstack sudo[89502]: pam_unix(sudo:session): session closed for user root Sep 16 20:20:09 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-aad534b5-3510-4625-8bac-eb2ab3bcb348 tempest-GroupSnapshotsTest-343869671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ee3f4e08-45cf-4457-a549-75ad9d4c800c" returned: 0 in 0.428s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:20:09 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-aad534b5-3510-4625-8bac-eb2ab3bcb348 tempest-GroupSnapshotsTest-343869671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ee3f4e08-45cf-4457-a549-75ad9d4c800c.cea5d0c8-3d74-4421-b84d-93d88466d01e {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:20:09 devstack sudo[89507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ee3f4e08-45cf-4457-a549-75ad9d4c800c.cea5d0c8-3d74-4421-b84d-93d88466d01e Sep 16 20:20:09 devstack sudo[89507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:20:10 devstack sudo[89507]: pam_unix(sudo:session): session closed for user root Sep 16 20:20:10 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-aad534b5-3510-4625-8bac-eb2ab3bcb348 tempest-GroupSnapshotsTest-343869671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ee3f4e08-45cf-4457-a549-75ad9d4c800c.cea5d0c8-3d74-4421-b84d-93d88466d01e" returned: 0 in 0.366s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:20:10 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-aad534b5-3510-4625-8bac-eb2ab3bcb348 tempest-GroupSnapshotsTest-343869671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ee3f4e08-45cf-4457-a549-75ad9d4c800c.cea5d0c8-3d74-4421-b84d-93d88466d01e {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:20:10 devstack sudo[89512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ee3f4e08-45cf-4457-a549-75ad9d4c800c.cea5d0c8-3d74-4421-b84d-93d88466d01e Sep 16 20:20:10 devstack sudo[89512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:20:10 devstack sudo[89512]: pam_unix(sudo:session): session closed for user root Sep 16 20:20:10 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-aad534b5-3510-4625-8bac-eb2ab3bcb348 tempest-GroupSnapshotsTest-343869671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ee3f4e08-45cf-4457-a549-75ad9d4c800c.cea5d0c8-3d74-4421-b84d-93d88466d01e" returned: 0 in 0.326s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:20:10 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-aad534b5-3510-4625-8bac-eb2ab3bcb348 tempest-GroupSnapshotsTest-343869671 None] Lock "cinder-quobyte-cea5d0c8-3d74-4421-b84d-93d88466d01e" released by "_delete_snapshot" :: held 1.714s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:20:10 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-aad534b5-3510-4625-8bac-eb2ab3bcb348 tempest-GroupSnapshotsTest-343869671 None] Lock "cinder-quobyte-ee3f4e08-45cf-4457-a549-75ad9d4c800c" released by "delete_snapshot" :: held 1.740s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:20:10 devstack cinder-volume[86188]: WARNING cinder.quota [None req-aad534b5-3510-4625-8bac-eb2ab3bcb348 tempest-GroupSnapshotsTest-343869671 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1573892218 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1573892218, it is now deprecated. Please use the default quota class for default quota. Sep 16 20:20:10 devstack cinder-volume[86188]: WARNING cinder.quota [None req-aad534b5-3510-4625-8bac-eb2ab3bcb348 tempest-GroupSnapshotsTest-343869671 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1573892218 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1573892218, it is now deprecated. Please use the default quota class for default quota. Sep 16 20:20:10 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-aad534b5-3510-4625-8bac-eb2ab3bcb348 tempest-GroupSnapshotsTest-343869671 None] Created reservations ['13bb3a8f-32cd-4ff6-8997-90f360165136', 'efe20f1e-40d5-4f5f-a104-ec92ff7a819e', '7279c639-5c92-419d-8cdf-ce27263dea44', '8a9d7359-495f-422b-955e-247049b3dc14'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:20:10 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-aad534b5-3510-4625-8bac-eb2ab3bcb348 tempest-GroupSnapshotsTest-343869671 None] group_snapshot 8848caf4-9f1f-413b-be24-327b2bf90366: deleted successfully Sep 16 20:20:11 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-358bbffe-b2fb-4227-9ce4-5fdd0c78fad6 tempest-GroupSnapshotsTest-343869671 None] Acquiring lock "cinder-quobyte-ee3f4e08-45cf-4457-a549-75ad9d4c800c" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:20:11 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-358bbffe-b2fb-4227-9ce4-5fdd0c78fad6 tempest-GroupSnapshotsTest-343869671 None] Lock "cinder-quobyte-ee3f4e08-45cf-4457-a549-75ad9d4c800c" acquired by "delete_volume" :: waited 0.043s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:20:11 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f3a5b57-3126-4205-acfb-6ca8ed415e5a]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:20:11 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-358bbffe-b2fb-4227-9ce4-5fdd0c78fad6 tempest-GroupSnapshotsTest-343869671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ee3f4e08-45cf-4457-a549-75ad9d4c800c {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:20:11 devstack sudo[89516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ee3f4e08-45cf-4457-a549-75ad9d4c800c Sep 16 20:20:11 devstack sudo[89516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:20:12 devstack sudo[89516]: pam_unix(sudo:session): session closed for user root Sep 16 20:20:12 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-358bbffe-b2fb-4227-9ce4-5fdd0c78fad6 tempest-GroupSnapshotsTest-343869671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ee3f4e08-45cf-4457-a549-75ad9d4c800c" returned: 0 in 0.616s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:20:12 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-358bbffe-b2fb-4227-9ce4-5fdd0c78fad6 tempest-GroupSnapshotsTest-343869671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ee3f4e08-45cf-4457-a549-75ad9d4c800c {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:20:12 devstack sudo[89521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ee3f4e08-45cf-4457-a549-75ad9d4c800c Sep 16 20:20:12 devstack sudo[89521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:20:12 devstack sudo[89521]: pam_unix(sudo:session): session closed for user root Sep 16 20:20:12 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-358bbffe-b2fb-4227-9ce4-5fdd0c78fad6 tempest-GroupSnapshotsTest-343869671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ee3f4e08-45cf-4457-a549-75ad9d4c800c" returned: 0 in 0.332s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:20:12 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-358bbffe-b2fb-4227-9ce4-5fdd0c78fad6 tempest-GroupSnapshotsTest-343869671 None] Lock "cinder-quobyte-ee3f4e08-45cf-4457-a549-75ad9d4c800c" released by "delete_volume" :: held 1.089s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:20:12 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-358bbffe-b2fb-4227-9ce4-5fdd0c78fad6 tempest-GroupSnapshotsTest-343869671 None] Created reservations ['3e3077e7-f42d-443e-aeb9-eca84a12c859'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:20:12 devstack cinder-volume[86188]: WARNING cinder.quota [None req-358bbffe-b2fb-4227-9ce4-5fdd0c78fad6 tempest-GroupSnapshotsTest-343869671 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1573892218 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1573892218, it is now deprecated. Please use the default quota class for default quota. Sep 16 20:20:12 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-358bbffe-b2fb-4227-9ce4-5fdd0c78fad6 tempest-GroupSnapshotsTest-343869671 None] Created reservations ['89f05b93-e99a-4817-bf4f-f20f1fcb77e2', '5489878b-9df1-4862-8c59-c59c9aa7a88f', '4b724a14-d53e-44c1-b25f-43ec29e0c121', '3ca480f6-b741-4828-8691-233867602f1e'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:20:12 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-358bbffe-b2fb-4227-9ce4-5fdd0c78fad6 tempest-GroupSnapshotsTest-343869671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:20:12 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-358bbffe-b2fb-4227-9ce4-5fdd0c78fad6 tempest-GroupSnapshotsTest-343869671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:20:12 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-358bbffe-b2fb-4227-9ce4-5fdd0c78fad6 tempest-GroupSnapshotsTest-343869671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:20:12 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-358bbffe-b2fb-4227-9ce4-5fdd0c78fad6 tempest-GroupSnapshotsTest-343869671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:20:12 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-358bbffe-b2fb-4227-9ce4-5fdd0c78fad6 tempest-GroupSnapshotsTest-343869671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:20:12 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-358bbffe-b2fb-4227-9ce4-5fdd0c78fad6 tempest-GroupSnapshotsTest-343869671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:20:12 devstack sudo[89524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:20:12 devstack sudo[89524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:20:13 devstack sudo[89524]: pam_unix(sudo:session): session closed for user root Sep 16 20:20:13 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-358bbffe-b2fb-4227-9ce4-5fdd0c78fad6 tempest-GroupSnapshotsTest-343869671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.404s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:20:13 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-358bbffe-b2fb-4227-9ce4-5fdd0c78fad6 tempest-GroupSnapshotsTest-343869671 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:20:13 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-358bbffe-b2fb-4227-9ce4-5fdd0c78fad6 tempest-GroupSnapshotsTest-343869671 None] Delete group completed successfully. Sep 16 20:20:16 devstack cinder-volume[86188]: DEBUG dbcounter [-] [86188] Writing DB stats cinder:SELECT=100,cinder:INSERT=24,cinder:UPDATE=111,cinder:DELETE=3 {{(pid=86188) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 20:20:16 devstack cinder-volume[86188]: DEBUG dbcounter [-] [86188] Writing DB stats cinder:INSERT=26,cinder:UPDATE=96,cinder:SELECT=93,cinder:DELETE=3 {{(pid=86188) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 20:20:16 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-0462ec3b-0deb-4251-873e-7f64b1b4ec10 tempest-ServerActionsTestOtherA-1167936048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:20:16 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-0462ec3b-0deb-4251-873e-7f64b1b4ec10 tempest-ServerActionsTestOtherA-1167936048 None] Flow 'volume_create_manager' (b87dce5d-d818-497b-870c-e1d7b8bd0d39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:20:16 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-0462ec3b-0deb-4251-873e-7f64b1b4ec10 tempest-ServerActionsTestOtherA-1167936048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c40d3e57-410f-4ce6-b6a6-5508e39af067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:20:16 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-0462ec3b-0deb-4251-873e-7f64b1b4ec10 tempest-ServerActionsTestOtherA-1167936048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c40d3e57-410f-4ce6-b6a6-5508e39af067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:20:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1230585598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32516f9b-5697-4c95-9c01-1437f6a72d4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ac72cf9371045bbaa95ae2b7fe651ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:20:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:20:16Z,use_quota=True,user_id='4b61169517484204b4db2b68cf8000c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:20:16 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-0462ec3b-0deb-4251-873e-7f64b1b4ec10 tempest-ServerActionsTestOtherA-1167936048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (578e96c6-54bf-49aa-a7c7-ab79d4ceb307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:20:16 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-0462ec3b-0deb-4251-873e-7f64b1b4ec10 tempest-ServerActionsTestOtherA-1167936048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (578e96c6-54bf-49aa-a7c7-ab79d4ceb307) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:20:16 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-0462ec3b-0deb-4251-873e-7f64b1b4ec10 tempest-ServerActionsTestOtherA-1167936048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2485a606-9e2b-4769-9d8c-5f3b448e0559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:20:16 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-0462ec3b-0deb-4251-873e-7f64b1b4ec10 tempest-ServerActionsTestOtherA-1167936048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2485a606-9e2b-4769-9d8c-5f3b448e0559) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32516f9b-5697-4c95-9c01-1437f6a72d4f', 'volume_name': 'volume-32516f9b-5697-4c95-9c01-1437f6a72d4f', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:20:16 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-0462ec3b-0deb-4251-873e-7f64b1b4ec10 tempest-ServerActionsTestOtherA-1167936048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb0acf32-237e-40ba-8b37-a9292358eb8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:20:16 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-0462ec3b-0deb-4251-873e-7f64b1b4ec10 tempest-ServerActionsTestOtherA-1167936048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb0acf32-237e-40ba-8b37-a9292358eb8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:20:16 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-0462ec3b-0deb-4251-873e-7f64b1b4ec10 tempest-ServerActionsTestOtherA-1167936048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bb91f52-a6cc-44f0-992d-c7410cccded9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:20:16 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-0462ec3b-0deb-4251-873e-7f64b1b4ec10 tempest-ServerActionsTestOtherA-1167936048 None] Volume 32516f9b-5697-4c95-9c01-1437f6a72d4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32516f9b-5697-4c95-9c01-1437f6a72d4f', 'volume_size': 1} Sep 16 20:20:16 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-0462ec3b-0deb-4251-873e-7f64b1b4ec10 tempest-ServerActionsTestOtherA-1167936048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:20:16 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-0462ec3b-0deb-4251-873e-7f64b1b4ec10 tempest-ServerActionsTestOtherA-1167936048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:20:16 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-0462ec3b-0deb-4251-873e-7f64b1b4ec10 tempest-ServerActionsTestOtherA-1167936048 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:20:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1230585598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32516f9b-5697-4c95-9c01-1437f6a72d4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ac72cf9371045bbaa95ae2b7fe651ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:20:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:20:16Z,use_quota=True,user_id='4b61169517484204b4db2b68cf8000c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:20:16 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-0462ec3b-0deb-4251-873e-7f64b1b4ec10 tempest-ServerActionsTestOtherA-1167936048 None] Creating volume 32516f9b-5697-4c95-9c01-1437f6a72d4f {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:20:16 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-0462ec3b-0deb-4251-873e-7f64b1b4ec10 tempest-ServerActionsTestOtherA-1167936048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:20:16 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-0462ec3b-0deb-4251-873e-7f64b1b4ec10 tempest-ServerActionsTestOtherA-1167936048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:20:16 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-0462ec3b-0deb-4251-873e-7f64b1b4ec10 tempest-ServerActionsTestOtherA-1167936048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:20:16 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-0462ec3b-0deb-4251-873e-7f64b1b4ec10 tempest-ServerActionsTestOtherA-1167936048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:20:16 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-0462ec3b-0deb-4251-873e-7f64b1b4ec10 tempest-ServerActionsTestOtherA-1167936048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:20:16 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-0462ec3b-0deb-4251-873e-7f64b1b4ec10 tempest-ServerActionsTestOtherA-1167936048 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:20:16 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-0462ec3b-0deb-4251-873e-7f64b1b4ec10 tempest-ServerActionsTestOtherA-1167936048 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:20:16 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-0462ec3b-0deb-4251-873e-7f64b1b4ec10 tempest-ServerActionsTestOtherA-1167936048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-32516f9b-5697-4c95-9c01-1437f6a72d4f 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:20:16 devstack sudo[89530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-32516f9b-5697-4c95-9c01-1437f6a72d4f 1073741824 Sep 16 20:20:16 devstack sudo[89530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:20:17 devstack sudo[89530]: pam_unix(sudo:session): session closed for user root Sep 16 20:20:17 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-0462ec3b-0deb-4251-873e-7f64b1b4ec10 tempest-ServerActionsTestOtherA-1167936048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-32516f9b-5697-4c95-9c01-1437f6a72d4f 1073741824" returned: 0 in 0.728s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:20:17 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-0462ec3b-0deb-4251-873e-7f64b1b4ec10 tempest-ServerActionsTestOtherA-1167936048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-32516f9b-5697-4c95-9c01-1437f6a72d4f {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:20:17 devstack sudo[89537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-32516f9b-5697-4c95-9c01-1437f6a72d4f Sep 16 20:20:17 devstack sudo[89537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:20:17 devstack sudo[89537]: pam_unix(sudo:session): session closed for user root Sep 16 20:20:17 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-0462ec3b-0deb-4251-873e-7f64b1b4ec10 tempest-ServerActionsTestOtherA-1167936048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-32516f9b-5697-4c95-9c01-1437f6a72d4f" returned: 0 in 0.311s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:20:17 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-0462ec3b-0deb-4251-873e-7f64b1b4ec10 tempest-ServerActionsTestOtherA-1167936048 None] <== create_volume: return (1121ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:20:17 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-0462ec3b-0deb-4251-873e-7f64b1b4ec10 tempest-ServerActionsTestOtherA-1167936048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.124s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:20:17 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-0462ec3b-0deb-4251-873e-7f64b1b4ec10 tempest-ServerActionsTestOtherA-1167936048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bb91f52-a6cc-44f0-992d-c7410cccded9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32516f9b-5697-4c95-9c01-1437f6a72d4f', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:20:17 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-0462ec3b-0deb-4251-873e-7f64b1b4ec10 tempest-ServerActionsTestOtherA-1167936048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (520a9bf9-9931-4570-86bd-545cb8a889d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:20:17 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-0462ec3b-0deb-4251-873e-7f64b1b4ec10 tempest-ServerActionsTestOtherA-1167936048 None] Volume volume-32516f9b-5697-4c95-9c01-1437f6a72d4f (32516f9b-5697-4c95-9c01-1437f6a72d4f): created successfully Sep 16 20:20:17 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-0462ec3b-0deb-4251-873e-7f64b1b4ec10 tempest-ServerActionsTestOtherA-1167936048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (520a9bf9-9931-4570-86bd-545cb8a889d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:20:17 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-0462ec3b-0deb-4251-873e-7f64b1b4ec10 tempest-ServerActionsTestOtherA-1167936048 None] Flow 'volume_create_manager' (b87dce5d-d818-497b-870c-e1d7b8bd0d39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:20:17 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-0462ec3b-0deb-4251-873e-7f64b1b4ec10 tempest-ServerActionsTestOtherA-1167936048 None] Created volume successfully. Sep 16 20:20:22 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-c65dfbd0-1363-4698-8c65-b3553b58895a tempest-GroupSnapshotsV319Test-1576726587 None] Group tempest-GroupSnapshotsV319Test-Group-191263891: creating Sep 16 20:20:22 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-c65dfbd0-1363-4698-8c65-b3553b58895a tempest-GroupSnapshotsV319Test-1576726587 None] Group tempest-GroupSnapshotsV319Test-Group-191263891: created successfully Sep 16 20:20:22 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-c65dfbd0-1363-4698-8c65-b3553b58895a tempest-GroupSnapshotsV319Test-1576726587 None] Create group completed successfully. Sep 16 20:20:24 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-440af4da-6232-42ba-be50-89a4ee36d9c8 tempest-GroupSnapshotsV319Test-1576726587 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:20:24 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-440af4da-6232-42ba-be50-89a4ee36d9c8 tempest-GroupSnapshotsV319Test-1576726587 None] Flow 'volume_create_manager' (408036fa-f10b-4189-9040-91ebdf5054a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:20:24 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-440af4da-6232-42ba-be50-89a4ee36d9c8 tempest-GroupSnapshotsV319Test-1576726587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72d7b266-5fcb-42a2-bfc4-657bd53aaa43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:20:24 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-440af4da-6232-42ba-be50-89a4ee36d9c8 tempest-GroupSnapshotsV319Test-1576726587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72d7b266-5fcb-42a2-bfc4-657bd53aaa43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:20:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-190713951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f0cf87f3-7c66-4095-9d5d-6f31f754d3fc,host='devstack@QuobyteHD#QuobyteHD',id=c2ce6719-3778-46a7-b209-c5c32fe5fb06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4d89ffa228447e3b03a53f9cc612286',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:20:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:20:24Z,use_quota=True,user_id='e331bb6ff52540349d149f7bc59cb38a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ecaf259c-19ea-4c71-bd3a-13642097454c),volume_type_id=ecaf259c-19ea-4c71-bd3a-13642097454c)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:20:24 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-440af4da-6232-42ba-be50-89a4ee36d9c8 tempest-GroupSnapshotsV319Test-1576726587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0587c1e-99df-4e42-a635-e1e5e30aab23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:20:24 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-440af4da-6232-42ba-be50-89a4ee36d9c8 tempest-GroupSnapshotsV319Test-1576726587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0587c1e-99df-4e42-a635-e1e5e30aab23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:20:24 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-440af4da-6232-42ba-be50-89a4ee36d9c8 tempest-GroupSnapshotsV319Test-1576726587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f64733d9-ee42-4cab-b181-196666e5341c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:20:24 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-440af4da-6232-42ba-be50-89a4ee36d9c8 tempest-GroupSnapshotsV319Test-1576726587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f64733d9-ee42-4cab-b181-196666e5341c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2ce6719-3778-46a7-b209-c5c32fe5fb06', 'volume_name': 'volume-c2ce6719-3778-46a7-b209-c5c32fe5fb06', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:20:24 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-440af4da-6232-42ba-be50-89a4ee36d9c8 tempest-GroupSnapshotsV319Test-1576726587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6d82a35-f6fb-4430-a50a-61a55a9f4926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:20:24 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-440af4da-6232-42ba-be50-89a4ee36d9c8 tempest-GroupSnapshotsV319Test-1576726587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6d82a35-f6fb-4430-a50a-61a55a9f4926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:20:24 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-440af4da-6232-42ba-be50-89a4ee36d9c8 tempest-GroupSnapshotsV319Test-1576726587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef49eeea-4ff6-4cbc-8676-52f538486cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:20:24 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-440af4da-6232-42ba-be50-89a4ee36d9c8 tempest-GroupSnapshotsV319Test-1576726587 None] Volume c2ce6719-3778-46a7-b209-c5c32fe5fb06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2ce6719-3778-46a7-b209-c5c32fe5fb06', 'volume_size': 1} Sep 16 20:20:24 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-440af4da-6232-42ba-be50-89a4ee36d9c8 tempest-GroupSnapshotsV319Test-1576726587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:20:24 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-440af4da-6232-42ba-be50-89a4ee36d9c8 tempest-GroupSnapshotsV319Test-1576726587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:20:24 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-440af4da-6232-42ba-be50-89a4ee36d9c8 tempest-GroupSnapshotsV319Test-1576726587 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f0cf87f3-7c66-4095-9d5d-6f31f754d3fc,created_at=2026-09-16T18:20:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-190713951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f0cf87f3-7c66-4095-9d5d-6f31f754d3fc,host='devstack@QuobyteHD#QuobyteHD',id=c2ce6719-3778-46a7-b209-c5c32fe5fb06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4d89ffa228447e3b03a53f9cc612286',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:20:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:20:24Z,use_quota=True,user_id='e331bb6ff52540349d149f7bc59cb38a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ecaf259c-19ea-4c71-bd3a-13642097454c),volume_type_id=ecaf259c-19ea-4c71-bd3a-13642097454c)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:20:24 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-440af4da-6232-42ba-be50-89a4ee36d9c8 tempest-GroupSnapshotsV319Test-1576726587 None] Creating volume c2ce6719-3778-46a7-b209-c5c32fe5fb06 {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:20:24 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-440af4da-6232-42ba-be50-89a4ee36d9c8 tempest-GroupSnapshotsV319Test-1576726587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:20:24 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-440af4da-6232-42ba-be50-89a4ee36d9c8 tempest-GroupSnapshotsV319Test-1576726587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:20:24 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-440af4da-6232-42ba-be50-89a4ee36d9c8 tempest-GroupSnapshotsV319Test-1576726587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:20:24 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-440af4da-6232-42ba-be50-89a4ee36d9c8 tempest-GroupSnapshotsV319Test-1576726587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:20:24 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-440af4da-6232-42ba-be50-89a4ee36d9c8 tempest-GroupSnapshotsV319Test-1576726587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:20:24 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-440af4da-6232-42ba-be50-89a4ee36d9c8 tempest-GroupSnapshotsV319Test-1576726587 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:20:24 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-440af4da-6232-42ba-be50-89a4ee36d9c8 tempest-GroupSnapshotsV319Test-1576726587 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:20:24 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-440af4da-6232-42ba-be50-89a4ee36d9c8 tempest-GroupSnapshotsV319Test-1576726587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c2ce6719-3778-46a7-b209-c5c32fe5fb06 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:20:24 devstack sudo[89572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c2ce6719-3778-46a7-b209-c5c32fe5fb06 1073741824 Sep 16 20:20:24 devstack sudo[89572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:20:24 devstack sudo[89572]: pam_unix(sudo:session): session closed for user root Sep 16 20:20:24 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-440af4da-6232-42ba-be50-89a4ee36d9c8 tempest-GroupSnapshotsV319Test-1576726587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c2ce6719-3778-46a7-b209-c5c32fe5fb06 1073741824" returned: 0 in 0.464s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:20:24 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-440af4da-6232-42ba-be50-89a4ee36d9c8 tempest-GroupSnapshotsV319Test-1576726587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c2ce6719-3778-46a7-b209-c5c32fe5fb06 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:20:24 devstack sudo[89590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c2ce6719-3778-46a7-b209-c5c32fe5fb06 Sep 16 20:20:24 devstack sudo[89590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:20:25 devstack sudo[89590]: pam_unix(sudo:session): session closed for user root Sep 16 20:20:25 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-440af4da-6232-42ba-be50-89a4ee36d9c8 tempest-GroupSnapshotsV319Test-1576726587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c2ce6719-3778-46a7-b209-c5c32fe5fb06" returned: 0 in 0.280s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:20:25 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-440af4da-6232-42ba-be50-89a4ee36d9c8 tempest-GroupSnapshotsV319Test-1576726587 None] <== create_volume: return (796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:20:25 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-440af4da-6232-42ba-be50-89a4ee36d9c8 tempest-GroupSnapshotsV319Test-1576726587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.798s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:20:25 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-440af4da-6232-42ba-be50-89a4ee36d9c8 tempest-GroupSnapshotsV319Test-1576726587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef49eeea-4ff6-4cbc-8676-52f538486cba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2ce6719-3778-46a7-b209-c5c32fe5fb06', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:20:25 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-440af4da-6232-42ba-be50-89a4ee36d9c8 tempest-GroupSnapshotsV319Test-1576726587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccd62cd7-d896-4a56-8808-82ec297d5d22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:20:25 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-440af4da-6232-42ba-be50-89a4ee36d9c8 tempest-GroupSnapshotsV319Test-1576726587 None] Volume volume-c2ce6719-3778-46a7-b209-c5c32fe5fb06 (c2ce6719-3778-46a7-b209-c5c32fe5fb06): created successfully Sep 16 20:20:25 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-440af4da-6232-42ba-be50-89a4ee36d9c8 tempest-GroupSnapshotsV319Test-1576726587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccd62cd7-d896-4a56-8808-82ec297d5d22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:20:25 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-440af4da-6232-42ba-be50-89a4ee36d9c8 tempest-GroupSnapshotsV319Test-1576726587 None] Flow 'volume_create_manager' (408036fa-f10b-4189-9040-91ebdf5054a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:20:25 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-440af4da-6232-42ba-be50-89a4ee36d9c8 tempest-GroupSnapshotsV319Test-1576726587 None] Created volume successfully. Sep 16 20:20:25 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-5b9a9077-131e-45e3-b685-9a7d53e4720d tempest-GroupSnapshotsV319Test-1576726587 None] GroupSnapshot b0bc2e20-07f0-4bfb-bda1-cb01961f8a18: creating. Sep 16 20:20:25 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-5b9a9077-131e-45e3-b685-9a7d53e4720d tempest-GroupSnapshotsV319Test-1576726587 None] Group snapshot b0bc2e20-07f0-4bfb-bda1-cb01961f8a18: creating. {{(pid=86188) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 16 20:20:25 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-5b9a9077-131e-45e3-b685-9a7d53e4720d tempest-GroupSnapshotsV319Test-1576726587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:20:25 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-5b9a9077-131e-45e3-b685-9a7d53e4720d tempest-GroupSnapshotsV319Test-1576726587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:20:25 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-5b9a9077-131e-45e3-b685-9a7d53e4720d tempest-GroupSnapshotsV319Test-1576726587 None] Creating offline snapshot b23af387-fcaa-4894-a262-cd5d66bf1dce of volume c2ce6719-3778-46a7-b209-c5c32fe5fb06 {{(pid=86188) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 20:20:25 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[59f54221-3b3a-48b8-abe3-eb9fc76f7613]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:20:25 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-5b9a9077-131e-45e3-b685-9a7d53e4720d tempest-GroupSnapshotsV319Test-1576726587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c2ce6719-3778-46a7-b209-c5c32fe5fb06 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:20:25 devstack sudo[89595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c2ce6719-3778-46a7-b209-c5c32fe5fb06 Sep 16 20:20:25 devstack sudo[89595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:20:26 devstack sudo[89595]: pam_unix(sudo:session): session closed for user root Sep 16 20:20:26 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-5b9a9077-131e-45e3-b685-9a7d53e4720d tempest-GroupSnapshotsV319Test-1576726587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c2ce6719-3778-46a7-b209-c5c32fe5fb06" returned: 0 in 0.507s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:20:26 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-5b9a9077-131e-45e3-b685-9a7d53e4720d tempest-GroupSnapshotsV319Test-1576726587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c2ce6719-3778-46a7-b209-c5c32fe5fb06,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c2ce6719-3778-46a7-b209-c5c32fe5fb06.b23af387-fcaa-4894-a262-cd5d66bf1dce 1G {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:20:26 devstack sudo[89600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c2ce6719-3778-46a7-b209-c5c32fe5fb06,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c2ce6719-3778-46a7-b209-c5c32fe5fb06.b23af387-fcaa-4894-a262-cd5d66bf1dce 1G Sep 16 20:20:26 devstack sudo[89600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:20:26 devstack sudo[89600]: pam_unix(sudo:session): session closed for user root Sep 16 20:20:26 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-5b9a9077-131e-45e3-b685-9a7d53e4720d tempest-GroupSnapshotsV319Test-1576726587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c2ce6719-3778-46a7-b209-c5c32fe5fb06,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c2ce6719-3778-46a7-b209-c5c32fe5fb06.b23af387-fcaa-4894-a262-cd5d66bf1dce 1G" returned: 0 in 0.469s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:20:26 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-5b9a9077-131e-45e3-b685-9a7d53e4720d tempest-GroupSnapshotsV319Test-1576726587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2ce6719-3778-46a7-b209-c5c32fe5fb06 -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c2ce6719-3778-46a7-b209-c5c32fe5fb06.b23af387-fcaa-4894-a262-cd5d66bf1dce {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:20:26 devstack sudo[89606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2ce6719-3778-46a7-b209-c5c32fe5fb06 -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c2ce6719-3778-46a7-b209-c5c32fe5fb06.b23af387-fcaa-4894-a262-cd5d66bf1dce Sep 16 20:20:26 devstack sudo[89606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:20:27 devstack sudo[89606]: pam_unix(sudo:session): session closed for user root Sep 16 20:20:27 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-5b9a9077-131e-45e3-b685-9a7d53e4720d tempest-GroupSnapshotsV319Test-1576726587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2ce6719-3778-46a7-b209-c5c32fe5fb06 -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c2ce6719-3778-46a7-b209-c5c32fe5fb06.b23af387-fcaa-4894-a262-cd5d66bf1dce" returned: 0 in 0.406s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:20:27 devstack cinder-volume[86188]: WARNING cinder.volume.drivers.remotefs [None req-5b9a9077-131e-45e3-b685-9a7d53e4720d tempest-GroupSnapshotsV319Test-1576726587 None] /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c2ce6719-3778-46a7-b209-c5c32fe5fb06.b23af387-fcaa-4894-a262-cd5d66bf1dce is being set with open permissions: ugo+rw: NotImplementedError Sep 16 20:20:27 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-5b9a9077-131e-45e3-b685-9a7d53e4720d tempest-GroupSnapshotsV319Test-1576726587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c2ce6719-3778-46a7-b209-c5c32fe5fb06.b23af387-fcaa-4894-a262-cd5d66bf1dce {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:20:27 devstack sudo[89611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c2ce6719-3778-46a7-b209-c5c32fe5fb06.b23af387-fcaa-4894-a262-cd5d66bf1dce Sep 16 20:20:27 devstack sudo[89611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:20:27 devstack sudo[89611]: pam_unix(sudo:session): session closed for user root Sep 16 20:20:27 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-5b9a9077-131e-45e3-b685-9a7d53e4720d tempest-GroupSnapshotsV319Test-1576726587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c2ce6719-3778-46a7-b209-c5c32fe5fb06.b23af387-fcaa-4894-a262-cd5d66bf1dce" returned: 0 in 0.268s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:20:27 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-5b9a9077-131e-45e3-b685-9a7d53e4720d tempest-GroupSnapshotsV319Test-1576726587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c2ce6719-3778-46a7-b209-c5c32fe5fb06.info {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:20:27 devstack sudo[89614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c2ce6719-3778-46a7-b209-c5c32fe5fb06.info Sep 16 20:20:27 devstack sudo[89614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:20:27 devstack sudo[89614]: pam_unix(sudo:session): session closed for user root Sep 16 20:20:27 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-5b9a9077-131e-45e3-b685-9a7d53e4720d tempest-GroupSnapshotsV319Test-1576726587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c2ce6719-3778-46a7-b209-c5c32fe5fb06.info" returned: 0 in 0.294s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:20:27 devstack cinder-volume[86188]: WARNING cinder.volume.drivers.remotefs [None req-5b9a9077-131e-45e3-b685-9a7d53e4720d tempest-GroupSnapshotsV319Test-1576726587 None] /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c2ce6719-3778-46a7-b209-c5c32fe5fb06.info is being set with open permissions: ugo+rw: NotImplementedError Sep 16 20:20:27 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-5b9a9077-131e-45e3-b685-9a7d53e4720d tempest-GroupSnapshotsV319Test-1576726587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c2ce6719-3778-46a7-b209-c5c32fe5fb06.info {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:20:27 devstack sudo[89619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c2ce6719-3778-46a7-b209-c5c32fe5fb06.info Sep 16 20:20:27 devstack sudo[89619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:20:28 devstack sudo[89619]: pam_unix(sudo:session): session closed for user root Sep 16 20:20:28 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-5b9a9077-131e-45e3-b685-9a7d53e4720d tempest-GroupSnapshotsV319Test-1576726587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c2ce6719-3778-46a7-b209-c5c32fe5fb06.info" returned: 0 in 0.288s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:20:28 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-5b9a9077-131e-45e3-b685-9a7d53e4720d tempest-GroupSnapshotsV319Test-1576726587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.337s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:20:28 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-5b9a9077-131e-45e3-b685-9a7d53e4720d tempest-GroupSnapshotsV319Test-1576726587 None] group_snapshot b0bc2e20-07f0-4bfb-bda1-cb01961f8a18: created successfully Sep 16 20:20:29 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-a83cf4d2-f1ed-4b29-aa50-f174710f79a0 tempest-GroupSnapshotsV319Test-1576726587 None] group_snapshot b0bc2e20-07f0-4bfb-bda1-cb01961f8a18: deleting Sep 16 20:20:29 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a83cf4d2-f1ed-4b29-aa50-f174710f79a0 tempest-GroupSnapshotsV319Test-1576726587 None] group_snapshot b0bc2e20-07f0-4bfb-bda1-cb01961f8a18: deleting {{(pid=86188) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 16 20:20:29 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-a83cf4d2-f1ed-4b29-aa50-f174710f79a0 tempest-GroupSnapshotsV319Test-1576726587 None] Acquiring lock "cinder-quobyte-c2ce6719-3778-46a7-b209-c5c32fe5fb06" by "delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:20:29 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-a83cf4d2-f1ed-4b29-aa50-f174710f79a0 tempest-GroupSnapshotsV319Test-1576726587 None] Lock "cinder-quobyte-c2ce6719-3778-46a7-b209-c5c32fe5fb06" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:20:29 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-a83cf4d2-f1ed-4b29-aa50-f174710f79a0 tempest-GroupSnapshotsV319Test-1576726587 None] Acquiring lock "cinder-quobyte-b23af387-fcaa-4894-a262-cd5d66bf1dce" by "_delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:20:29 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-a83cf4d2-f1ed-4b29-aa50-f174710f79a0 tempest-GroupSnapshotsV319Test-1576726587 None] Lock "cinder-quobyte-b23af387-fcaa-4894-a262-cd5d66bf1dce" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:20:29 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-a83cf4d2-f1ed-4b29-aa50-f174710f79a0 tempest-GroupSnapshotsV319Test-1576726587 None] Deleting offline snapshot b23af387-fcaa-4894-a262-cd5d66bf1dce of volume c2ce6719-3778-46a7-b209-c5c32fe5fb06 {{(pid=86188) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 20:20:29 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-a83cf4d2-f1ed-4b29-aa50-f174710f79a0 tempest-GroupSnapshotsV319Test-1576726587 None] snapshot_file for this snap is: volume-c2ce6719-3778-46a7-b209-c5c32fe5fb06.b23af387-fcaa-4894-a262-cd5d66bf1dce {{(pid=86188) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 20:20:29 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cb91a71-fd5e-42fc-8755-69af587c6ee4]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:20:29 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a83cf4d2-f1ed-4b29-aa50-f174710f79a0 tempest-GroupSnapshotsV319Test-1576726587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c2ce6719-3778-46a7-b209-c5c32fe5fb06.b23af387-fcaa-4894-a262-cd5d66bf1dce {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:20:30 devstack sudo[89663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c2ce6719-3778-46a7-b209-c5c32fe5fb06.b23af387-fcaa-4894-a262-cd5d66bf1dce Sep 16 20:20:30 devstack sudo[89663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:20:30 devstack sudo[89663]: pam_unix(sudo:session): session closed for user root Sep 16 20:20:30 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a83cf4d2-f1ed-4b29-aa50-f174710f79a0 tempest-GroupSnapshotsV319Test-1576726587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c2ce6719-3778-46a7-b209-c5c32fe5fb06.b23af387-fcaa-4894-a262-cd5d66bf1dce" returned: 0 in 0.633s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:20:30 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-a83cf4d2-f1ed-4b29-aa50-f174710f79a0 tempest-GroupSnapshotsV319Test-1576726587 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c2ce6719-3778-46a7-b209-c5c32fe5fb06(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86188) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 20:20:30 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdea7ecf-25b8-4795-9f0b-159794193f70]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:20:30 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a83cf4d2-f1ed-4b29-aa50-f174710f79a0 tempest-GroupSnapshotsV319Test-1576726587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c2ce6719-3778-46a7-b209-c5c32fe5fb06 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:20:30 devstack sudo[89671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c2ce6719-3778-46a7-b209-c5c32fe5fb06 Sep 16 20:20:30 devstack sudo[89671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:20:31 devstack sudo[89671]: pam_unix(sudo:session): session closed for user root Sep 16 20:20:31 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a83cf4d2-f1ed-4b29-aa50-f174710f79a0 tempest-GroupSnapshotsV319Test-1576726587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c2ce6719-3778-46a7-b209-c5c32fe5fb06" returned: 0 in 0.456s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:20:31 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a83cf4d2-f1ed-4b29-aa50-f174710f79a0 tempest-GroupSnapshotsV319Test-1576726587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c2ce6719-3778-46a7-b209-c5c32fe5fb06.b23af387-fcaa-4894-a262-cd5d66bf1dce {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:20:31 devstack sudo[89676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c2ce6719-3778-46a7-b209-c5c32fe5fb06.b23af387-fcaa-4894-a262-cd5d66bf1dce Sep 16 20:20:31 devstack sudo[89676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:20:31 devstack sudo[89676]: pam_unix(sudo:session): session closed for user root Sep 16 20:20:31 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a83cf4d2-f1ed-4b29-aa50-f174710f79a0 tempest-GroupSnapshotsV319Test-1576726587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c2ce6719-3778-46a7-b209-c5c32fe5fb06.b23af387-fcaa-4894-a262-cd5d66bf1dce" returned: 0 in 0.787s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:20:31 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a83cf4d2-f1ed-4b29-aa50-f174710f79a0 tempest-GroupSnapshotsV319Test-1576726587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c2ce6719-3778-46a7-b209-c5c32fe5fb06.b23af387-fcaa-4894-a262-cd5d66bf1dce {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:20:31 devstack sudo[89740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c2ce6719-3778-46a7-b209-c5c32fe5fb06.b23af387-fcaa-4894-a262-cd5d66bf1dce Sep 16 20:20:31 devstack sudo[89740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:20:32 devstack sudo[89740]: pam_unix(sudo:session): session closed for user root Sep 16 20:20:32 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a83cf4d2-f1ed-4b29-aa50-f174710f79a0 tempest-GroupSnapshotsV319Test-1576726587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c2ce6719-3778-46a7-b209-c5c32fe5fb06.b23af387-fcaa-4894-a262-cd5d66bf1dce" returned: 0 in 0.712s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:20:32 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-a83cf4d2-f1ed-4b29-aa50-f174710f79a0 tempest-GroupSnapshotsV319Test-1576726587 None] Lock "cinder-quobyte-b23af387-fcaa-4894-a262-cd5d66bf1dce" released by "_delete_snapshot" :: held 2.797s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:20:32 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-a83cf4d2-f1ed-4b29-aa50-f174710f79a0 tempest-GroupSnapshotsV319Test-1576726587 None] Lock "cinder-quobyte-c2ce6719-3778-46a7-b209-c5c32fe5fb06" released by "delete_snapshot" :: held 2.837s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:20:32 devstack cinder-volume[86188]: WARNING cinder.quota [None req-a83cf4d2-f1ed-4b29-aa50-f174710f79a0 tempest-GroupSnapshotsV319Test-1576726587 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-2591505 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-2591505, it is now deprecated. Please use the default quota class for default quota. Sep 16 20:20:32 devstack cinder-volume[86188]: WARNING cinder.quota [None req-a83cf4d2-f1ed-4b29-aa50-f174710f79a0 tempest-GroupSnapshotsV319Test-1576726587 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-2591505 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-2591505, it is now deprecated. Please use the default quota class for default quota. Sep 16 20:20:32 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-a83cf4d2-f1ed-4b29-aa50-f174710f79a0 tempest-GroupSnapshotsV319Test-1576726587 None] Created reservations ['ff76476e-6687-47e4-9bfa-645d40e9956c', '1bb44f9d-8751-430d-8ed2-c1cf62b643d7', '8d7d5bb6-555c-41b4-bd6c-9497b02ef3f4', '8e9b417a-6cf2-4781-8e5c-8df6414fe8b8'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:20:33 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-a83cf4d2-f1ed-4b29-aa50-f174710f79a0 tempest-GroupSnapshotsV319Test-1576726587 None] group_snapshot b0bc2e20-07f0-4bfb-bda1-cb01961f8a18: deleted successfully Sep 16 20:20:33 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-68b9e3ea-52ff-4f49-8e91-f26c0435eb31 tempest-GroupSnapshotsV319Test-1576726587 None] Acquiring lock "cinder-quobyte-c2ce6719-3778-46a7-b209-c5c32fe5fb06" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:20:34 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-68b9e3ea-52ff-4f49-8e91-f26c0435eb31 tempest-GroupSnapshotsV319Test-1576726587 None] Lock "cinder-quobyte-c2ce6719-3778-46a7-b209-c5c32fe5fb06" acquired by "delete_volume" :: waited 0.035s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:20:34 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[552a2c10-0664-4e6f-84a2-cbba75e58711]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:20:34 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-68b9e3ea-52ff-4f49-8e91-f26c0435eb31 tempest-GroupSnapshotsV319Test-1576726587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c2ce6719-3778-46a7-b209-c5c32fe5fb06 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:20:34 devstack sudo[89754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c2ce6719-3778-46a7-b209-c5c32fe5fb06 Sep 16 20:20:34 devstack sudo[89754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:20:35 devstack sudo[89754]: pam_unix(sudo:session): session closed for user root Sep 16 20:20:35 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-68b9e3ea-52ff-4f49-8e91-f26c0435eb31 tempest-GroupSnapshotsV319Test-1576726587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c2ce6719-3778-46a7-b209-c5c32fe5fb06" returned: 0 in 1.189s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:20:35 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-68b9e3ea-52ff-4f49-8e91-f26c0435eb31 tempest-GroupSnapshotsV319Test-1576726587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c2ce6719-3778-46a7-b209-c5c32fe5fb06 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:20:35 devstack sudo[89762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c2ce6719-3778-46a7-b209-c5c32fe5fb06 Sep 16 20:20:35 devstack sudo[89762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:20:35 devstack sudo[89762]: pam_unix(sudo:session): session closed for user root Sep 16 20:20:35 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-68b9e3ea-52ff-4f49-8e91-f26c0435eb31 tempest-GroupSnapshotsV319Test-1576726587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c2ce6719-3778-46a7-b209-c5c32fe5fb06" returned: 0 in 0.492s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:20:35 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-68b9e3ea-52ff-4f49-8e91-f26c0435eb31 tempest-GroupSnapshotsV319Test-1576726587 None] Lock "cinder-quobyte-c2ce6719-3778-46a7-b209-c5c32fe5fb06" released by "delete_volume" :: held 1.899s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:20:36 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-68b9e3ea-52ff-4f49-8e91-f26c0435eb31 tempest-GroupSnapshotsV319Test-1576726587 None] Created reservations ['2d2c0314-7dee-4225-8dea-9c9e2d404972'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:20:36 devstack cinder-volume[86188]: WARNING cinder.quota [None req-68b9e3ea-52ff-4f49-8e91-f26c0435eb31 tempest-GroupSnapshotsV319Test-1576726587 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-2591505 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-2591505, it is now deprecated. Please use the default quota class for default quota. Sep 16 20:20:36 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-68b9e3ea-52ff-4f49-8e91-f26c0435eb31 tempest-GroupSnapshotsV319Test-1576726587 None] Created reservations ['1a91f71b-c110-4a74-87a5-44f166956df3', '94f84cee-f978-40bc-802b-a422a040d9eb', '79ebb544-d065-4d3c-86e7-d6f09fec72df', '3d82b865-0271-4534-a860-eb74770c40fd'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:20:36 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-68b9e3ea-52ff-4f49-8e91-f26c0435eb31 tempest-GroupSnapshotsV319Test-1576726587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:20:36 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-68b9e3ea-52ff-4f49-8e91-f26c0435eb31 tempest-GroupSnapshotsV319Test-1576726587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:20:36 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-68b9e3ea-52ff-4f49-8e91-f26c0435eb31 tempest-GroupSnapshotsV319Test-1576726587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:20:36 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-68b9e3ea-52ff-4f49-8e91-f26c0435eb31 tempest-GroupSnapshotsV319Test-1576726587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:20:36 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-68b9e3ea-52ff-4f49-8e91-f26c0435eb31 tempest-GroupSnapshotsV319Test-1576726587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:20:36 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-68b9e3ea-52ff-4f49-8e91-f26c0435eb31 tempest-GroupSnapshotsV319Test-1576726587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:20:36 devstack sudo[89766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:20:36 devstack sudo[89766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:20:36 devstack sudo[89766]: pam_unix(sudo:session): session closed for user root Sep 16 20:20:36 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-68b9e3ea-52ff-4f49-8e91-f26c0435eb31 tempest-GroupSnapshotsV319Test-1576726587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.557s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:20:36 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-68b9e3ea-52ff-4f49-8e91-f26c0435eb31 tempest-GroupSnapshotsV319Test-1576726587 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:20:36 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-68b9e3ea-52ff-4f49-8e91-f26c0435eb31 tempest-GroupSnapshotsV319Test-1576726587 None] Delete group completed successfully. Sep 16 20:20:46 devstack cinder-volume[86188]: DEBUG dbcounter [-] [86188] Writing DB stats cinder:SELECT=25,cinder:INSERT=9,cinder:UPDATE=28,cinder:DELETE=1 {{(pid=86188) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 20:20:46 devstack cinder-volume[86188]: DEBUG dbcounter [-] [86188] Writing DB stats cinder:SELECT=27,cinder:UPDATE=23,cinder:INSERT=3,cinder:DELETE=1 {{(pid=86188) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 20:20:52 devstack cinder-volume[86188]: DEBUG oslo_service.periodic_task [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86188) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 20:20:52 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:20:52 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:20:52 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:20:53 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:20:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:20:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:20:53 devstack sudo[89974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:20:53 devstack sudo[89974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:20:53 devstack sudo[89974]: pam_unix(sudo:session): session closed for user root Sep 16 20:20:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.523s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:20:53 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:20:53 devstack cinder-volume[86188]: DEBUG oslo_service.periodic_task [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Running periodic task VolumeManager._thread_info {{(pid=86188) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 20:20:53 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] thread count: 8 {{(pid=86188) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 16 20:20:53 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] thread info: [<_MainThread(MainThread, started 139858124406912)>, , , , , , , ] {{(pid=86188) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 16 20:20:59 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [req-78ee6a66-056d-4da7-83c3-d12b3586fe56 req-a133b22c-e94e-49ae-bac8-f07a50d915da tempest-ServerActionsTestOtherA-1167936048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:20:59 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [req-78ee6a66-056d-4da7-83c3-d12b3586fe56 req-a133b22c-e94e-49ae-bac8-f07a50d915da tempest-ServerActionsTestOtherA-1167936048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:20:59 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [req-78ee6a66-056d-4da7-83c3-d12b3586fe56 req-a133b22c-e94e-49ae-bac8-f07a50d915da tempest-ServerActionsTestOtherA-1167936048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:20:59 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [req-78ee6a66-056d-4da7-83c3-d12b3586fe56 req-a133b22c-e94e-49ae-bac8-f07a50d915da tempest-ServerActionsTestOtherA-1167936048 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81', 'name': 'volume-32516f9b-5697-4c95-9c01-1437f6a72d4f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e6939d50-8da7-473d-bc29-919fb7fe1aa9', 'enforce_multipath': True} {{(pid=86188) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 16 20:20:59 devstack cinder-volume[86188]: INFO cinder.volume.manager [req-78ee6a66-056d-4da7-83c3-d12b3586fe56 req-a133b22c-e94e-49ae-bac8-f07a50d915da tempest-ServerActionsTestOtherA-1167936048 None] attachment_update completed successfully. Sep 16 20:21:01 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2c07de4-47d5-49c6-b819-8421c61e5861 tempest-AttachVolumeNegativeTest-1537838471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:21:01 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e2c07de4-47d5-49c6-b819-8421c61e5861 tempest-AttachVolumeNegativeTest-1537838471 None] Flow 'volume_create_manager' (cd48b07d-e48c-425b-b0e6-8573d0846287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:21:01 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e2c07de4-47d5-49c6-b819-8421c61e5861 tempest-AttachVolumeNegativeTest-1537838471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04745365-cab1-4a01-a7f5-64bce8b6e95b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:21:01 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e2c07de4-47d5-49c6-b819-8421c61e5861 tempest-AttachVolumeNegativeTest-1537838471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04745365-cab1-4a01-a7f5-64bce8b6e95b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:21:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1356291805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad18f387-eef5-4f3b-8d1c-5795ce000a83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3587d449fe5c467ba11ccf39851d1fc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:21:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:21:02Z,use_quota=True,user_id='426ad78a563445bb95108bdfd4bd10e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:21:01 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e2c07de4-47d5-49c6-b819-8421c61e5861 tempest-AttachVolumeNegativeTest-1537838471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a6aa899-cf4c-42b2-9674-9222d3b9ec36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:21:01 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e2c07de4-47d5-49c6-b819-8421c61e5861 tempest-AttachVolumeNegativeTest-1537838471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a6aa899-cf4c-42b2-9674-9222d3b9ec36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:21:01 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e2c07de4-47d5-49c6-b819-8421c61e5861 tempest-AttachVolumeNegativeTest-1537838471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edff6971-c4d2-46c2-b11f-39a81349d3f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:21:01 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e2c07de4-47d5-49c6-b819-8421c61e5861 tempest-AttachVolumeNegativeTest-1537838471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edff6971-c4d2-46c2-b11f-39a81349d3f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad18f387-eef5-4f3b-8d1c-5795ce000a83', 'volume_name': 'volume-ad18f387-eef5-4f3b-8d1c-5795ce000a83', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:21:01 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e2c07de4-47d5-49c6-b819-8421c61e5861 tempest-AttachVolumeNegativeTest-1537838471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90a9309b-54c9-4cdc-bf07-287e371ec40a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:21:01 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e2c07de4-47d5-49c6-b819-8421c61e5861 tempest-AttachVolumeNegativeTest-1537838471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90a9309b-54c9-4cdc-bf07-287e371ec40a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:21:01 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e2c07de4-47d5-49c6-b819-8421c61e5861 tempest-AttachVolumeNegativeTest-1537838471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ab8cbd0-00b7-4241-af13-9bc0ea2a0ec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:21:01 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-e2c07de4-47d5-49c6-b819-8421c61e5861 tempest-AttachVolumeNegativeTest-1537838471 None] Volume ad18f387-eef5-4f3b-8d1c-5795ce000a83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad18f387-eef5-4f3b-8d1c-5795ce000a83', 'volume_size': 1} Sep 16 20:21:01 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-e2c07de4-47d5-49c6-b819-8421c61e5861 tempest-AttachVolumeNegativeTest-1537838471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:21:01 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-e2c07de4-47d5-49c6-b819-8421c61e5861 tempest-AttachVolumeNegativeTest-1537838471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:21:01 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-e2c07de4-47d5-49c6-b819-8421c61e5861 tempest-AttachVolumeNegativeTest-1537838471 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:21:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1356291805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad18f387-eef5-4f3b-8d1c-5795ce000a83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3587d449fe5c467ba11ccf39851d1fc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:21:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:21:02Z,use_quota=True,user_id='426ad78a563445bb95108bdfd4bd10e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:21:01 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-e2c07de4-47d5-49c6-b819-8421c61e5861 tempest-AttachVolumeNegativeTest-1537838471 None] Creating volume ad18f387-eef5-4f3b-8d1c-5795ce000a83 {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:21:01 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-e2c07de4-47d5-49c6-b819-8421c61e5861 tempest-AttachVolumeNegativeTest-1537838471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:21:01 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-e2c07de4-47d5-49c6-b819-8421c61e5861 tempest-AttachVolumeNegativeTest-1537838471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:21:01 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-e2c07de4-47d5-49c6-b819-8421c61e5861 tempest-AttachVolumeNegativeTest-1537838471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:21:01 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-e2c07de4-47d5-49c6-b819-8421c61e5861 tempest-AttachVolumeNegativeTest-1537838471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:21:01 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-e2c07de4-47d5-49c6-b819-8421c61e5861 tempest-AttachVolumeNegativeTest-1537838471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:21:01 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-e2c07de4-47d5-49c6-b819-8421c61e5861 tempest-AttachVolumeNegativeTest-1537838471 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:21:01 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-e2c07de4-47d5-49c6-b819-8421c61e5861 tempest-AttachVolumeNegativeTest-1537838471 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:21:01 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e2c07de4-47d5-49c6-b819-8421c61e5861 tempest-AttachVolumeNegativeTest-1537838471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ad18f387-eef5-4f3b-8d1c-5795ce000a83 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:21:02 devstack sudo[90478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ad18f387-eef5-4f3b-8d1c-5795ce000a83 1073741824 Sep 16 20:21:02 devstack sudo[90478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:21:02 devstack sudo[90478]: pam_unix(sudo:session): session closed for user root Sep 16 20:21:02 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e2c07de4-47d5-49c6-b819-8421c61e5861 tempest-AttachVolumeNegativeTest-1537838471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ad18f387-eef5-4f3b-8d1c-5795ce000a83 1073741824" returned: 0 in 1.048s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:21:03 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e2c07de4-47d5-49c6-b819-8421c61e5861 tempest-AttachVolumeNegativeTest-1537838471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ad18f387-eef5-4f3b-8d1c-5795ce000a83 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:21:03 devstack sudo[90511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ad18f387-eef5-4f3b-8d1c-5795ce000a83 Sep 16 20:21:03 devstack sudo[90511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:21:03 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a18b048-d41b-43c8-9ad1-0421e68af28f tempest-SnapshotsActionsTest-483685712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:21:03 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-1a18b048-d41b-43c8-9ad1-0421e68af28f tempest-SnapshotsActionsTest-483685712 None] Flow 'volume_create_manager' (cc069161-022d-490c-8b79-f34545a16b2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:21:03 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-1a18b048-d41b-43c8-9ad1-0421e68af28f tempest-SnapshotsActionsTest-483685712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d63f0ad1-fe16-4643-8b47-42874d59f2fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:21:03 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-1a18b048-d41b-43c8-9ad1-0421e68af28f tempest-SnapshotsActionsTest-483685712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d63f0ad1-fe16-4643-8b47-42874d59f2fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:21:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1244747301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82a53f25-7404-46c3-a063-5eda0dc0a9a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ea5c70223f94704ac9b761d4ff1bfa7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:21:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:21:03Z,use_quota=True,user_id='9268eadaceb6455d9ba07af0579b0ebd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:21:03 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-1a18b048-d41b-43c8-9ad1-0421e68af28f tempest-SnapshotsActionsTest-483685712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caea759b-ed65-4edd-ad75-b85f145bdbe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:21:03 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-1a18b048-d41b-43c8-9ad1-0421e68af28f tempest-SnapshotsActionsTest-483685712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caea759b-ed65-4edd-ad75-b85f145bdbe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:21:03 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-1a18b048-d41b-43c8-9ad1-0421e68af28f tempest-SnapshotsActionsTest-483685712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ba6d6c7-2392-4c8b-85ee-95c77dc4bfe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:21:03 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-1a18b048-d41b-43c8-9ad1-0421e68af28f tempest-SnapshotsActionsTest-483685712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ba6d6c7-2392-4c8b-85ee-95c77dc4bfe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82a53f25-7404-46c3-a063-5eda0dc0a9a2', 'volume_name': 'volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:21:03 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-1a18b048-d41b-43c8-9ad1-0421e68af28f tempest-SnapshotsActionsTest-483685712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76b57ccf-c732-4553-a25c-bf03a95b900b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:21:03 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-1a18b048-d41b-43c8-9ad1-0421e68af28f tempest-SnapshotsActionsTest-483685712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76b57ccf-c732-4553-a25c-bf03a95b900b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:21:03 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-1a18b048-d41b-43c8-9ad1-0421e68af28f tempest-SnapshotsActionsTest-483685712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f05f92b-fbd1-40ae-b008-87239bfc0a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:21:03 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-1a18b048-d41b-43c8-9ad1-0421e68af28f tempest-SnapshotsActionsTest-483685712 None] Volume 82a53f25-7404-46c3-a063-5eda0dc0a9a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2', 'volume_size': 1} Sep 16 20:21:03 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-1a18b048-d41b-43c8-9ad1-0421e68af28f tempest-SnapshotsActionsTest-483685712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:21:03 devstack sudo[90511]: pam_unix(sudo:session): session closed for user root Sep 16 20:21:03 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e2c07de4-47d5-49c6-b819-8421c61e5861 tempest-AttachVolumeNegativeTest-1537838471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ad18f387-eef5-4f3b-8d1c-5795ce000a83" returned: 0 in 0.444s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:21:03 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-e2c07de4-47d5-49c6-b819-8421c61e5861 tempest-AttachVolumeNegativeTest-1537838471 None] <== create_volume: return (1604ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:21:03 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-e2c07de4-47d5-49c6-b819-8421c61e5861 tempest-AttachVolumeNegativeTest-1537838471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.609s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:21:03 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-1a18b048-d41b-43c8-9ad1-0421e68af28f tempest-SnapshotsActionsTest-483685712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.205s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:21:03 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-1a18b048-d41b-43c8-9ad1-0421e68af28f tempest-SnapshotsActionsTest-483685712 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:21:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1244747301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82a53f25-7404-46c3-a063-5eda0dc0a9a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ea5c70223f94704ac9b761d4ff1bfa7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:21:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:21:03Z,use_quota=True,user_id='9268eadaceb6455d9ba07af0579b0ebd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:21:03 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-1a18b048-d41b-43c8-9ad1-0421e68af28f tempest-SnapshotsActionsTest-483685712 None] Creating volume 82a53f25-7404-46c3-a063-5eda0dc0a9a2 {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:21:03 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-1a18b048-d41b-43c8-9ad1-0421e68af28f tempest-SnapshotsActionsTest-483685712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:21:03 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-1a18b048-d41b-43c8-9ad1-0421e68af28f tempest-SnapshotsActionsTest-483685712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:21:03 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-1a18b048-d41b-43c8-9ad1-0421e68af28f tempest-SnapshotsActionsTest-483685712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:21:03 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-1a18b048-d41b-43c8-9ad1-0421e68af28f tempest-SnapshotsActionsTest-483685712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:21:03 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-1a18b048-d41b-43c8-9ad1-0421e68af28f tempest-SnapshotsActionsTest-483685712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:21:03 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-1a18b048-d41b-43c8-9ad1-0421e68af28f tempest-SnapshotsActionsTest-483685712 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:21:03 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-1a18b048-d41b-43c8-9ad1-0421e68af28f tempest-SnapshotsActionsTest-483685712 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:21:03 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-1a18b048-d41b-43c8-9ad1-0421e68af28f tempest-SnapshotsActionsTest-483685712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:21:03 devstack sudo[90520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2 1073741824 Sep 16 20:21:03 devstack sudo[90520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:21:03 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e2c07de4-47d5-49c6-b819-8421c61e5861 tempest-AttachVolumeNegativeTest-1537838471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ab8cbd0-00b7-4241-af13-9bc0ea2a0ec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad18f387-eef5-4f3b-8d1c-5795ce000a83', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:21:03 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e2c07de4-47d5-49c6-b819-8421c61e5861 tempest-AttachVolumeNegativeTest-1537838471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18d250e1-dbee-4623-bb97-23b6ab4a279a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:21:03 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-e2c07de4-47d5-49c6-b819-8421c61e5861 tempest-AttachVolumeNegativeTest-1537838471 None] Volume volume-ad18f387-eef5-4f3b-8d1c-5795ce000a83 (ad18f387-eef5-4f3b-8d1c-5795ce000a83): created successfully Sep 16 20:21:03 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e2c07de4-47d5-49c6-b819-8421c61e5861 tempest-AttachVolumeNegativeTest-1537838471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18d250e1-dbee-4623-bb97-23b6ab4a279a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:21:03 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e2c07de4-47d5-49c6-b819-8421c61e5861 tempest-AttachVolumeNegativeTest-1537838471 None] Flow 'volume_create_manager' (cd48b07d-e48c-425b-b0e6-8573d0846287) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:21:03 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-e2c07de4-47d5-49c6-b819-8421c61e5861 tempest-AttachVolumeNegativeTest-1537838471 None] Created volume successfully. Sep 16 20:21:04 devstack sudo[90520]: pam_unix(sudo:session): session closed for user root Sep 16 20:21:04 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-1a18b048-d41b-43c8-9ad1-0421e68af28f tempest-SnapshotsActionsTest-483685712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2 1073741824" returned: 0 in 0.761s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:21:04 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-1a18b048-d41b-43c8-9ad1-0421e68af28f tempest-SnapshotsActionsTest-483685712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:21:04 devstack sudo[90554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2 Sep 16 20:21:04 devstack sudo[90554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:21:04 devstack sudo[90554]: pam_unix(sudo:session): session closed for user root Sep 16 20:21:04 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-1a18b048-d41b-43c8-9ad1-0421e68af28f tempest-SnapshotsActionsTest-483685712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2" returned: 0 in 0.290s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:21:04 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-1a18b048-d41b-43c8-9ad1-0421e68af28f tempest-SnapshotsActionsTest-483685712 None] <== create_volume: return (1134ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:21:04 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-1a18b048-d41b-43c8-9ad1-0421e68af28f tempest-SnapshotsActionsTest-483685712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.140s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:21:04 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-1a18b048-d41b-43c8-9ad1-0421e68af28f tempest-SnapshotsActionsTest-483685712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f05f92b-fbd1-40ae-b008-87239bfc0a7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:21:04 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-1a18b048-d41b-43c8-9ad1-0421e68af28f tempest-SnapshotsActionsTest-483685712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8231be0f-a514-4884-9dcb-fd186d71fa3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:21:04 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-1a18b048-d41b-43c8-9ad1-0421e68af28f tempest-SnapshotsActionsTest-483685712 None] Volume volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2 (82a53f25-7404-46c3-a063-5eda0dc0a9a2): created successfully Sep 16 20:21:04 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-1a18b048-d41b-43c8-9ad1-0421e68af28f tempest-SnapshotsActionsTest-483685712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8231be0f-a514-4884-9dcb-fd186d71fa3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:21:04 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-1a18b048-d41b-43c8-9ad1-0421e68af28f tempest-SnapshotsActionsTest-483685712 None] Flow 'volume_create_manager' (cc069161-022d-490c-8b79-f34545a16b2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:21:04 devstack cinder-volume[86188]: INFO cinder.volume.manager [req-c9ea75eb-7e9e-414a-86ff-465269cbf5a9 req-e26e2323-2442-4ec0-b361-145ee3882e8b tempest-ServerActionsTestOtherA-1167936048 None] Terminate volume connection completed successfully. Sep 16 20:21:04 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [req-c9ea75eb-7e9e-414a-86ff-465269cbf5a9 req-e26e2323-2442-4ec0-b361-145ee3882e8b tempest-ServerActionsTestOtherA-1167936048 None] Deleting attachment e6939d50-8da7-473d-bc29-919fb7fe1aa9. {{(pid=86188) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 16 20:21:04 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-1a18b048-d41b-43c8-9ad1-0421e68af28f tempest-SnapshotsActionsTest-483685712 None] Created volume successfully. Sep 16 20:21:05 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-bfbe7f58-6064-482b-b9ae-b912904bb871 tempest-SnapshotsActionsTest-483685712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:21:05 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-bfbe7f58-6064-482b-b9ae-b912904bb871 tempest-SnapshotsActionsTest-483685712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:21:05 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-bfbe7f58-6064-482b-b9ae-b912904bb871 tempest-SnapshotsActionsTest-483685712 None] Creating offline snapshot 1fe70f32-a27c-43ee-a6a0-e87f3758b99d of volume 82a53f25-7404-46c3-a063-5eda0dc0a9a2 {{(pid=86188) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 20:21:05 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7707a4a-effb-4390-a2c0-1bf125b40921]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:21:05 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-bfbe7f58-6064-482b-b9ae-b912904bb871 tempest-SnapshotsActionsTest-483685712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:21:05 devstack sudo[90630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2 Sep 16 20:21:05 devstack sudo[90630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:21:05 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [req-4169932b-294e-49a3-93ea-92935099d8c1 req-bec0a759-a144-435f-a220-78bca6461b3a tempest-AttachVolumeNegativeTest-1537838471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:21:06 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [req-c9ea75eb-7e9e-414a-86ff-465269cbf5a9 req-6d59cb35-96e2-432f-91e1-ada138b1b435 tempest-ServerActionsTestOtherA-1167936048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:21:06 devstack sudo[90630]: pam_unix(sudo:session): session closed for user root Sep 16 20:21:06 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-bfbe7f58-6064-482b-b9ae-b912904bb871 tempest-SnapshotsActionsTest-483685712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2" returned: 0 in 0.491s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:21:06 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-bfbe7f58-6064-482b-b9ae-b912904bb871 tempest-SnapshotsActionsTest-483685712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.1fe70f32-a27c-43ee-a6a0-e87f3758b99d 1G {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:21:06 devstack sudo[90643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.1fe70f32-a27c-43ee-a6a0-e87f3758b99d 1G Sep 16 20:21:06 devstack sudo[90643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:21:06 devstack sudo[90643]: pam_unix(sudo:session): session closed for user root Sep 16 20:21:06 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-bfbe7f58-6064-482b-b9ae-b912904bb871 tempest-SnapshotsActionsTest-483685712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.1fe70f32-a27c-43ee-a6a0-e87f3758b99d 1G" returned: 0 in 0.383s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:21:06 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-bfbe7f58-6064-482b-b9ae-b912904bb871 tempest-SnapshotsActionsTest-483685712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2 -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.1fe70f32-a27c-43ee-a6a0-e87f3758b99d {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:21:06 devstack sudo[90649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2 -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.1fe70f32-a27c-43ee-a6a0-e87f3758b99d Sep 16 20:21:06 devstack sudo[90649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:21:06 devstack sudo[90649]: pam_unix(sudo:session): session closed for user root Sep 16 20:21:06 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-bfbe7f58-6064-482b-b9ae-b912904bb871 tempest-SnapshotsActionsTest-483685712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2 -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.1fe70f32-a27c-43ee-a6a0-e87f3758b99d" returned: 0 in 0.296s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:21:06 devstack cinder-volume[86188]: WARNING cinder.volume.drivers.remotefs [None req-bfbe7f58-6064-482b-b9ae-b912904bb871 tempest-SnapshotsActionsTest-483685712 None] /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.1fe70f32-a27c-43ee-a6a0-e87f3758b99d is being set with open permissions: ugo+rw Sep 16 20:21:06 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-bfbe7f58-6064-482b-b9ae-b912904bb871 tempest-SnapshotsActionsTest-483685712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.1fe70f32-a27c-43ee-a6a0-e87f3758b99d {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:21:06 devstack sudo[90655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.1fe70f32-a27c-43ee-a6a0-e87f3758b99d Sep 16 20:21:06 devstack sudo[90655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:21:07 devstack sudo[90655]: pam_unix(sudo:session): session closed for user root Sep 16 20:21:07 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-bfbe7f58-6064-482b-b9ae-b912904bb871 tempest-SnapshotsActionsTest-483685712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.1fe70f32-a27c-43ee-a6a0-e87f3758b99d" returned: 0 in 0.234s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:21:07 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-bfbe7f58-6064-482b-b9ae-b912904bb871 tempest-SnapshotsActionsTest-483685712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.info {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:21:07 devstack sudo[90660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.info Sep 16 20:21:07 devstack sudo[90660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:21:07 devstack sudo[90660]: pam_unix(sudo:session): session closed for user root Sep 16 20:21:07 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-bfbe7f58-6064-482b-b9ae-b912904bb871 tempest-SnapshotsActionsTest-483685712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.info" returned: 0 in 0.258s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:21:07 devstack cinder-volume[86188]: WARNING cinder.volume.drivers.remotefs [None req-bfbe7f58-6064-482b-b9ae-b912904bb871 tempest-SnapshotsActionsTest-483685712 None] /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.info is being set with open permissions: ugo+rw Sep 16 20:21:07 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-bfbe7f58-6064-482b-b9ae-b912904bb871 tempest-SnapshotsActionsTest-483685712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.info {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:21:07 devstack sudo[90663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.info Sep 16 20:21:07 devstack sudo[90663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:21:07 devstack sudo[90663]: pam_unix(sudo:session): session closed for user root Sep 16 20:21:07 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-bfbe7f58-6064-482b-b9ae-b912904bb871 tempest-SnapshotsActionsTest-483685712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.info" returned: 0 in 0.241s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:21:07 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-bfbe7f58-6064-482b-b9ae-b912904bb871 tempest-SnapshotsActionsTest-483685712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.023s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:21:07 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [req-4169932b-294e-49a3-93ea-92935099d8c1 req-bec0a759-a144-435f-a220-78bca6461b3a tempest-AttachVolumeNegativeTest-1537838471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.698s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:21:07 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [req-4169932b-294e-49a3-93ea-92935099d8c1 req-bec0a759-a144-435f-a220-78bca6461b3a tempest-AttachVolumeNegativeTest-1537838471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:21:07 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [req-c9ea75eb-7e9e-414a-86ff-465269cbf5a9 req-6d59cb35-96e2-432f-91e1-ada138b1b435 tempest-ServerActionsTestOtherA-1167936048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.666s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:21:07 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-bfbe7f58-6064-482b-b9ae-b912904bb871 tempest-SnapshotsActionsTest-483685712 None] Create snapshot completed successfully Sep 16 20:21:07 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [req-c9ea75eb-7e9e-414a-86ff-465269cbf5a9 req-6d59cb35-96e2-432f-91e1-ada138b1b435 tempest-ServerActionsTestOtherA-1167936048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.082s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:21:07 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [req-4169932b-294e-49a3-93ea-92935099d8c1 req-bec0a759-a144-435f-a220-78bca6461b3a tempest-AttachVolumeNegativeTest-1537838471 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81', 'name': 'volume-ad18f387-eef5-4f3b-8d1c-5795ce000a83', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '12c2b053-791b-482f-b5ee-b5735a2d3938', 'enforce_multipath': True} {{(pid=86188) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 16 20:21:07 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [req-c9ea75eb-7e9e-414a-86ff-465269cbf5a9 req-6d59cb35-96e2-432f-91e1-ada138b1b435 tempest-ServerActionsTestOtherA-1167936048 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81', 'name': 'volume-32516f9b-5697-4c95-9c01-1437f6a72d4f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cfe4d728-4270-4beb-9a37-cf41ba1cfaa2', 'enforce_multipath': True} {{(pid=86188) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 16 20:21:07 devstack cinder-volume[86188]: INFO cinder.volume.manager [req-4169932b-294e-49a3-93ea-92935099d8c1 req-bec0a759-a144-435f-a220-78bca6461b3a tempest-AttachVolumeNegativeTest-1537838471 None] attachment_update completed successfully. Sep 16 20:21:07 devstack cinder-volume[86188]: INFO cinder.volume.manager [req-c9ea75eb-7e9e-414a-86ff-465269cbf5a9 req-6d59cb35-96e2-432f-91e1-ada138b1b435 tempest-ServerActionsTestOtherA-1167936048 None] attachment_update completed successfully. Sep 16 20:21:08 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a77421f-cd89-40ac-9781-cdc9f7816e2c tempest-ServersNegativeTestJSON-1618961904 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:21:08 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-1a77421f-cd89-40ac-9781-cdc9f7816e2c tempest-ServersNegativeTestJSON-1618961904 None] Flow 'volume_create_manager' (0ea03cb4-8a85-456a-8658-2f9c66674390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:21:08 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-1a77421f-cd89-40ac-9781-cdc9f7816e2c tempest-ServersNegativeTestJSON-1618961904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78e835b6-af97-4b0b-bdbc-e6891d2e7bb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:21:08 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-1a77421f-cd89-40ac-9781-cdc9f7816e2c tempest-ServersNegativeTestJSON-1618961904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78e835b6-af97-4b0b-bdbc-e6891d2e7bb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:21:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-319642088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca98fb94-0d96-4094-832d-68cf0fd1f19c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d510c5981c7e4a149f54acf443cc8a0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:21:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:21:09Z,use_quota=True,user_id='d96f269b2c6c47be940db723a47cd6dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:21:08 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-1a77421f-cd89-40ac-9781-cdc9f7816e2c tempest-ServersNegativeTestJSON-1618961904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abf52e26-3065-485c-a38d-44feb533422b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:21:08 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-1a77421f-cd89-40ac-9781-cdc9f7816e2c tempest-ServersNegativeTestJSON-1618961904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abf52e26-3065-485c-a38d-44feb533422b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:21:08 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-1a77421f-cd89-40ac-9781-cdc9f7816e2c tempest-ServersNegativeTestJSON-1618961904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1145aa7c-e229-4019-b635-e55bb86cf529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:21:08 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-1a77421f-cd89-40ac-9781-cdc9f7816e2c tempest-ServersNegativeTestJSON-1618961904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1145aa7c-e229-4019-b635-e55bb86cf529) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca98fb94-0d96-4094-832d-68cf0fd1f19c', 'volume_name': 'volume-ca98fb94-0d96-4094-832d-68cf0fd1f19c', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:21:08 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-1a77421f-cd89-40ac-9781-cdc9f7816e2c tempest-ServersNegativeTestJSON-1618961904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ae90b9e-b84a-4401-b99f-967744226cb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:21:08 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-1a77421f-cd89-40ac-9781-cdc9f7816e2c tempest-ServersNegativeTestJSON-1618961904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ae90b9e-b84a-4401-b99f-967744226cb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:21:08 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-1a77421f-cd89-40ac-9781-cdc9f7816e2c tempest-ServersNegativeTestJSON-1618961904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c83ae50d-120a-44f9-be59-03633f44847e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:21:08 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-1a77421f-cd89-40ac-9781-cdc9f7816e2c tempest-ServersNegativeTestJSON-1618961904 None] Volume ca98fb94-0d96-4094-832d-68cf0fd1f19c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca98fb94-0d96-4094-832d-68cf0fd1f19c', 'volume_size': 1} Sep 16 20:21:08 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-1a77421f-cd89-40ac-9781-cdc9f7816e2c tempest-ServersNegativeTestJSON-1618961904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:21:08 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-1a77421f-cd89-40ac-9781-cdc9f7816e2c tempest-ServersNegativeTestJSON-1618961904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:21:08 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-1a77421f-cd89-40ac-9781-cdc9f7816e2c tempest-ServersNegativeTestJSON-1618961904 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:21:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-319642088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca98fb94-0d96-4094-832d-68cf0fd1f19c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d510c5981c7e4a149f54acf443cc8a0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:21:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:21:09Z,use_quota=True,user_id='d96f269b2c6c47be940db723a47cd6dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:21:08 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-1a77421f-cd89-40ac-9781-cdc9f7816e2c tempest-ServersNegativeTestJSON-1618961904 None] Creating volume ca98fb94-0d96-4094-832d-68cf0fd1f19c {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:21:08 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-1a77421f-cd89-40ac-9781-cdc9f7816e2c tempest-ServersNegativeTestJSON-1618961904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:21:08 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-1a77421f-cd89-40ac-9781-cdc9f7816e2c tempest-ServersNegativeTestJSON-1618961904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:21:08 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-1a77421f-cd89-40ac-9781-cdc9f7816e2c tempest-ServersNegativeTestJSON-1618961904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:21:08 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-1a77421f-cd89-40ac-9781-cdc9f7816e2c tempest-ServersNegativeTestJSON-1618961904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:21:08 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-1a77421f-cd89-40ac-9781-cdc9f7816e2c tempest-ServersNegativeTestJSON-1618961904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:21:08 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-1a77421f-cd89-40ac-9781-cdc9f7816e2c tempest-ServersNegativeTestJSON-1618961904 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:21:08 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-1a77421f-cd89-40ac-9781-cdc9f7816e2c tempest-ServersNegativeTestJSON-1618961904 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:21:08 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-1a77421f-cd89-40ac-9781-cdc9f7816e2c tempest-ServersNegativeTestJSON-1618961904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ca98fb94-0d96-4094-832d-68cf0fd1f19c 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:21:08 devstack sudo[91094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ca98fb94-0d96-4094-832d-68cf0fd1f19c 1073741824 Sep 16 20:21:08 devstack sudo[91094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:21:09 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-78c790f9-0bfa-415c-9875-e6c9dad74a41 tempest-SnapshotsActionsTest-483685712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:21:09 devstack sudo[91094]: pam_unix(sudo:session): session closed for user root Sep 16 20:21:09 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-1a77421f-cd89-40ac-9781-cdc9f7816e2c tempest-ServersNegativeTestJSON-1618961904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ca98fb94-0d96-4094-832d-68cf0fd1f19c 1073741824" returned: 0 in 0.761s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:21:09 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-1a77421f-cd89-40ac-9781-cdc9f7816e2c tempest-ServersNegativeTestJSON-1618961904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ca98fb94-0d96-4094-832d-68cf0fd1f19c {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:21:09 devstack sudo[91119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ca98fb94-0d96-4094-832d-68cf0fd1f19c Sep 16 20:21:09 devstack sudo[91119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:21:09 devstack sudo[91119]: pam_unix(sudo:session): session closed for user root Sep 16 20:21:09 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-1a77421f-cd89-40ac-9781-cdc9f7816e2c tempest-ServersNegativeTestJSON-1618961904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ca98fb94-0d96-4094-832d-68cf0fd1f19c" returned: 0 in 0.347s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:21:09 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-1a77421f-cd89-40ac-9781-cdc9f7816e2c tempest-ServersNegativeTestJSON-1618961904 None] <== create_volume: return (1196ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:21:09 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-1a77421f-cd89-40ac-9781-cdc9f7816e2c tempest-ServersNegativeTestJSON-1618961904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.199s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:21:09 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-78c790f9-0bfa-415c-9875-e6c9dad74a41 tempest-SnapshotsActionsTest-483685712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.906s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:21:09 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-1a77421f-cd89-40ac-9781-cdc9f7816e2c tempest-ServersNegativeTestJSON-1618961904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c83ae50d-120a-44f9-be59-03633f44847e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca98fb94-0d96-4094-832d-68cf0fd1f19c', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:21:09 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-1a77421f-cd89-40ac-9781-cdc9f7816e2c tempest-ServersNegativeTestJSON-1618961904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6484340-33a3-41bb-acbd-d5f0fb69b72d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:21:10 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-78c790f9-0bfa-415c-9875-e6c9dad74a41 tempest-SnapshotsActionsTest-483685712 None] Creating offline snapshot f00a62a4-152c-4f9c-9ccb-95299165c82e of volume 82a53f25-7404-46c3-a063-5eda0dc0a9a2 {{(pid=86188) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 20:21:10 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-1a77421f-cd89-40ac-9781-cdc9f7816e2c tempest-ServersNegativeTestJSON-1618961904 None] Volume volume-ca98fb94-0d96-4094-832d-68cf0fd1f19c (ca98fb94-0d96-4094-832d-68cf0fd1f19c): created successfully Sep 16 20:21:10 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-1a77421f-cd89-40ac-9781-cdc9f7816e2c tempest-ServersNegativeTestJSON-1618961904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6484340-33a3-41bb-acbd-d5f0fb69b72d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:21:10 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-1a77421f-cd89-40ac-9781-cdc9f7816e2c tempest-ServersNegativeTestJSON-1618961904 None] Flow 'volume_create_manager' (0ea03cb4-8a85-456a-8658-2f9c66674390) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:21:10 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[13702683-58f3-4ca3-8731-d4be0fb406f8]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:21:10 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-78c790f9-0bfa-415c-9875-e6c9dad74a41 tempest-SnapshotsActionsTest-483685712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.1fe70f32-a27c-43ee-a6a0-e87f3758b99d {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:21:10 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-1a77421f-cd89-40ac-9781-cdc9f7816e2c tempest-ServersNegativeTestJSON-1618961904 None] Created volume successfully. Sep 16 20:21:10 devstack sudo[91147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.1fe70f32-a27c-43ee-a6a0-e87f3758b99d Sep 16 20:21:10 devstack sudo[91147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:21:10 devstack sudo[91147]: pam_unix(sudo:session): session closed for user root Sep 16 20:21:10 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-78c790f9-0bfa-415c-9875-e6c9dad74a41 tempest-SnapshotsActionsTest-483685712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.1fe70f32-a27c-43ee-a6a0-e87f3758b99d" returned: 0 in 0.625s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:21:10 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-78c790f9-0bfa-415c-9875-e6c9dad74a41 tempest-SnapshotsActionsTest-483685712 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86188) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 20:21:10 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-78c790f9-0bfa-415c-9875-e6c9dad74a41 tempest-SnapshotsActionsTest-483685712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.1fe70f32-a27c-43ee-a6a0-e87f3758b99d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.f00a62a4-152c-4f9c-9ccb-95299165c82e 1G {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:21:10 devstack sudo[91155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.1fe70f32-a27c-43ee-a6a0-e87f3758b99d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.f00a62a4-152c-4f9c-9ccb-95299165c82e 1G Sep 16 20:21:10 devstack sudo[91155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:21:11 devstack sudo[91155]: pam_unix(sudo:session): session closed for user root Sep 16 20:21:11 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-78c790f9-0bfa-415c-9875-e6c9dad74a41 tempest-SnapshotsActionsTest-483685712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.1fe70f32-a27c-43ee-a6a0-e87f3758b99d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.f00a62a4-152c-4f9c-9ccb-95299165c82e 1G" returned: 0 in 0.870s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:21:11 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-78c790f9-0bfa-415c-9875-e6c9dad74a41 tempest-SnapshotsActionsTest-483685712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.1fe70f32-a27c-43ee-a6a0-e87f3758b99d -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.f00a62a4-152c-4f9c-9ccb-95299165c82e {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:21:11 devstack sudo[91164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.1fe70f32-a27c-43ee-a6a0-e87f3758b99d -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.f00a62a4-152c-4f9c-9ccb-95299165c82e Sep 16 20:21:11 devstack sudo[91164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:21:12 devstack sudo[91164]: pam_unix(sudo:session): session closed for user root Sep 16 20:21:12 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-78c790f9-0bfa-415c-9875-e6c9dad74a41 tempest-SnapshotsActionsTest-483685712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.1fe70f32-a27c-43ee-a6a0-e87f3758b99d -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.f00a62a4-152c-4f9c-9ccb-95299165c82e" returned: 0 in 0.783s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:21:12 devstack cinder-volume[86188]: WARNING cinder.volume.drivers.remotefs [None req-78c790f9-0bfa-415c-9875-e6c9dad74a41 tempest-SnapshotsActionsTest-483685712 None] /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.f00a62a4-152c-4f9c-9ccb-95299165c82e is being set with open permissions: ugo+rw Sep 16 20:21:12 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-78c790f9-0bfa-415c-9875-e6c9dad74a41 tempest-SnapshotsActionsTest-483685712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.f00a62a4-152c-4f9c-9ccb-95299165c82e {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:21:12 devstack sudo[91170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.f00a62a4-152c-4f9c-9ccb-95299165c82e Sep 16 20:21:12 devstack sudo[91170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:21:12 devstack sudo[91170]: pam_unix(sudo:session): session closed for user root Sep 16 20:21:12 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-78c790f9-0bfa-415c-9875-e6c9dad74a41 tempest-SnapshotsActionsTest-483685712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.f00a62a4-152c-4f9c-9ccb-95299165c82e" returned: 0 in 0.339s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:21:12 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-78c790f9-0bfa-415c-9875-e6c9dad74a41 tempest-SnapshotsActionsTest-483685712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.843s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:21:12 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-78c790f9-0bfa-415c-9875-e6c9dad74a41 tempest-SnapshotsActionsTest-483685712 None] Create snapshot completed successfully Sep 16 20:21:13 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-70e8dd58-25e2-4f20-af37-0c5ec86a72db tempest-ServersNegativeTestJSON-1618961904 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:21:13 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-70e8dd58-25e2-4f20-af37-0c5ec86a72db tempest-ServersNegativeTestJSON-1618961904 None] Flow 'volume_create_manager' (83b71b15-ad3b-4ca8-b709-28e7cad35f22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:21:13 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-70e8dd58-25e2-4f20-af37-0c5ec86a72db tempest-ServersNegativeTestJSON-1618961904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f72d00b-6e2c-4bbd-a5f1-cac8435842f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:21:13 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-70e8dd58-25e2-4f20-af37-0c5ec86a72db tempest-ServersNegativeTestJSON-1618961904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f72d00b-6e2c-4bbd-a5f1-cac8435842f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:21:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-434561810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13849c5e-aec0-4c98-9673-1f8bd2cc50ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d510c5981c7e4a149f54acf443cc8a0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:21:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:21:13Z,use_quota=True,user_id='d96f269b2c6c47be940db723a47cd6dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:21:13 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-70e8dd58-25e2-4f20-af37-0c5ec86a72db tempest-ServersNegativeTestJSON-1618961904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5b08c20-cee3-4ddc-a9c0-d7108811d8e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:21:13 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-70e8dd58-25e2-4f20-af37-0c5ec86a72db tempest-ServersNegativeTestJSON-1618961904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5b08c20-cee3-4ddc-a9c0-d7108811d8e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:21:13 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-70e8dd58-25e2-4f20-af37-0c5ec86a72db tempest-ServersNegativeTestJSON-1618961904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab14f3e7-3a25-4ebd-925a-71176f8b4761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:21:13 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-70e8dd58-25e2-4f20-af37-0c5ec86a72db tempest-ServersNegativeTestJSON-1618961904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab14f3e7-3a25-4ebd-925a-71176f8b4761) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13849c5e-aec0-4c98-9673-1f8bd2cc50ea', 'volume_name': 'volume-13849c5e-aec0-4c98-9673-1f8bd2cc50ea', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:21:13 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-70e8dd58-25e2-4f20-af37-0c5ec86a72db tempest-ServersNegativeTestJSON-1618961904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2484e1c6-4bbd-4de8-93fa-3af7fd8fbaf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:21:13 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-70e8dd58-25e2-4f20-af37-0c5ec86a72db tempest-ServersNegativeTestJSON-1618961904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2484e1c6-4bbd-4de8-93fa-3af7fd8fbaf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:21:13 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-70e8dd58-25e2-4f20-af37-0c5ec86a72db tempest-ServersNegativeTestJSON-1618961904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94f39fcd-ddf2-4d2f-8fd0-f28b6f5be3c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:21:13 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-70e8dd58-25e2-4f20-af37-0c5ec86a72db tempest-ServersNegativeTestJSON-1618961904 None] Volume 13849c5e-aec0-4c98-9673-1f8bd2cc50ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13849c5e-aec0-4c98-9673-1f8bd2cc50ea', 'volume_size': 1} Sep 16 20:21:13 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-70e8dd58-25e2-4f20-af37-0c5ec86a72db tempest-ServersNegativeTestJSON-1618961904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:21:13 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-70e8dd58-25e2-4f20-af37-0c5ec86a72db tempest-ServersNegativeTestJSON-1618961904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:21:13 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-70e8dd58-25e2-4f20-af37-0c5ec86a72db tempest-ServersNegativeTestJSON-1618961904 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:21:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-434561810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13849c5e-aec0-4c98-9673-1f8bd2cc50ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d510c5981c7e4a149f54acf443cc8a0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:21:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:21:13Z,use_quota=True,user_id='d96f269b2c6c47be940db723a47cd6dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:21:13 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-70e8dd58-25e2-4f20-af37-0c5ec86a72db tempest-ServersNegativeTestJSON-1618961904 None] Creating volume 13849c5e-aec0-4c98-9673-1f8bd2cc50ea {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:21:13 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-70e8dd58-25e2-4f20-af37-0c5ec86a72db tempest-ServersNegativeTestJSON-1618961904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:21:13 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-70e8dd58-25e2-4f20-af37-0c5ec86a72db tempest-ServersNegativeTestJSON-1618961904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:21:13 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-70e8dd58-25e2-4f20-af37-0c5ec86a72db tempest-ServersNegativeTestJSON-1618961904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:21:13 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-70e8dd58-25e2-4f20-af37-0c5ec86a72db tempest-ServersNegativeTestJSON-1618961904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:21:13 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-70e8dd58-25e2-4f20-af37-0c5ec86a72db tempest-ServersNegativeTestJSON-1618961904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:21:13 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-70e8dd58-25e2-4f20-af37-0c5ec86a72db tempest-ServersNegativeTestJSON-1618961904 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:21:13 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-70e8dd58-25e2-4f20-af37-0c5ec86a72db tempest-ServersNegativeTestJSON-1618961904 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:21:13 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-70e8dd58-25e2-4f20-af37-0c5ec86a72db tempest-ServersNegativeTestJSON-1618961904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-13849c5e-aec0-4c98-9673-1f8bd2cc50ea 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:21:13 devstack sudo[91173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-13849c5e-aec0-4c98-9673-1f8bd2cc50ea 1073741824 Sep 16 20:21:13 devstack sudo[91173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:21:13 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-edc01052-8606-46ad-b077-820fbecf2c11 tempest-SnapshotsActionsTest-1545171846 None] Acquiring lock "cinder-f00a62a4-152c-4f9c-9ccb-95299165c82e-delete_snapshot" by "delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:21:13 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-edc01052-8606-46ad-b077-820fbecf2c11 tempest-SnapshotsActionsTest-1545171846 None] Lock "cinder-f00a62a4-152c-4f9c-9ccb-95299165c82e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:21:13 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-edc01052-8606-46ad-b077-820fbecf2c11 tempest-SnapshotsActionsTest-1545171846 None] Acquiring lock "cinder-quobyte-82a53f25-7404-46c3-a063-5eda0dc0a9a2" by "delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:21:13 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-edc01052-8606-46ad-b077-820fbecf2c11 tempest-SnapshotsActionsTest-1545171846 None] Lock "cinder-quobyte-82a53f25-7404-46c3-a063-5eda0dc0a9a2" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:21:13 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-edc01052-8606-46ad-b077-820fbecf2c11 tempest-SnapshotsActionsTest-1545171846 None] Acquiring lock "cinder-quobyte-f00a62a4-152c-4f9c-9ccb-95299165c82e" by "_delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:21:13 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-edc01052-8606-46ad-b077-820fbecf2c11 tempest-SnapshotsActionsTest-1545171846 None] Lock "cinder-quobyte-f00a62a4-152c-4f9c-9ccb-95299165c82e" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:21:13 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-edc01052-8606-46ad-b077-820fbecf2c11 tempest-SnapshotsActionsTest-1545171846 None] Deleting offline snapshot f00a62a4-152c-4f9c-9ccb-95299165c82e of volume 82a53f25-7404-46c3-a063-5eda0dc0a9a2 {{(pid=86188) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 20:21:13 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-edc01052-8606-46ad-b077-820fbecf2c11 tempest-SnapshotsActionsTest-1545171846 None] snapshot_file for this snap is: volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.f00a62a4-152c-4f9c-9ccb-95299165c82e {{(pid=86188) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 20:21:13 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6367151-ecbc-4e9a-a216-af1f4cdf4cbe]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:21:13 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-edc01052-8606-46ad-b077-820fbecf2c11 tempest-SnapshotsActionsTest-1545171846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.f00a62a4-152c-4f9c-9ccb-95299165c82e {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:21:13 devstack sudo[91178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.f00a62a4-152c-4f9c-9ccb-95299165c82e Sep 16 20:21:13 devstack sudo[91178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:21:14 devstack sudo[91173]: pam_unix(sudo:session): session closed for user root Sep 16 20:21:14 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-70e8dd58-25e2-4f20-af37-0c5ec86a72db tempest-ServersNegativeTestJSON-1618961904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-13849c5e-aec0-4c98-9673-1f8bd2cc50ea 1073741824" returned: 0 in 0.652s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:21:14 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-70e8dd58-25e2-4f20-af37-0c5ec86a72db tempest-ServersNegativeTestJSON-1618961904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-13849c5e-aec0-4c98-9673-1f8bd2cc50ea {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:21:14 devstack sudo[91181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-13849c5e-aec0-4c98-9673-1f8bd2cc50ea Sep 16 20:21:14 devstack sudo[91181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:21:14 devstack sudo[91178]: pam_unix(sudo:session): session closed for user root Sep 16 20:21:14 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-edc01052-8606-46ad-b077-820fbecf2c11 tempest-SnapshotsActionsTest-1545171846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.f00a62a4-152c-4f9c-9ccb-95299165c82e" returned: 0 in 0.595s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:21:14 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-edc01052-8606-46ad-b077-820fbecf2c11 tempest-SnapshotsActionsTest-1545171846 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86188) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 20:21:14 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[04158c35-2589-43e2-984c-2366c082be21]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:21:14 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-edc01052-8606-46ad-b077-820fbecf2c11 tempest-SnapshotsActionsTest-1545171846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.1fe70f32-a27c-43ee-a6a0-e87f3758b99d {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:21:14 devstack sudo[91188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.1fe70f32-a27c-43ee-a6a0-e87f3758b99d Sep 16 20:21:14 devstack sudo[91188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:21:14 devstack sudo[91181]: pam_unix(sudo:session): session closed for user root Sep 16 20:21:14 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-70e8dd58-25e2-4f20-af37-0c5ec86a72db tempest-ServersNegativeTestJSON-1618961904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-13849c5e-aec0-4c98-9673-1f8bd2cc50ea" returned: 0 in 0.436s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:21:14 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-70e8dd58-25e2-4f20-af37-0c5ec86a72db tempest-ServersNegativeTestJSON-1618961904 None] <== create_volume: return (1188ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:21:14 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-70e8dd58-25e2-4f20-af37-0c5ec86a72db tempest-ServersNegativeTestJSON-1618961904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.193s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:21:14 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-70e8dd58-25e2-4f20-af37-0c5ec86a72db tempest-ServersNegativeTestJSON-1618961904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94f39fcd-ddf2-4d2f-8fd0-f28b6f5be3c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13849c5e-aec0-4c98-9673-1f8bd2cc50ea', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:21:14 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-70e8dd58-25e2-4f20-af37-0c5ec86a72db tempest-ServersNegativeTestJSON-1618961904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (607f5564-95c1-4612-ab97-c6b164e7c344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:21:14 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-70e8dd58-25e2-4f20-af37-0c5ec86a72db tempest-ServersNegativeTestJSON-1618961904 None] Volume volume-13849c5e-aec0-4c98-9673-1f8bd2cc50ea (13849c5e-aec0-4c98-9673-1f8bd2cc50ea): created successfully Sep 16 20:21:14 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-70e8dd58-25e2-4f20-af37-0c5ec86a72db tempest-ServersNegativeTestJSON-1618961904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (607f5564-95c1-4612-ab97-c6b164e7c344) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:21:14 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-70e8dd58-25e2-4f20-af37-0c5ec86a72db tempest-ServersNegativeTestJSON-1618961904 None] Flow 'volume_create_manager' (83b71b15-ad3b-4ca8-b709-28e7cad35f22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:21:14 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-70e8dd58-25e2-4f20-af37-0c5ec86a72db tempest-ServersNegativeTestJSON-1618961904 None] Created volume successfully. Sep 16 20:21:14 devstack sudo[91188]: pam_unix(sudo:session): session closed for user root Sep 16 20:21:14 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-edc01052-8606-46ad-b077-820fbecf2c11 tempest-SnapshotsActionsTest-1545171846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.1fe70f32-a27c-43ee-a6a0-e87f3758b99d" returned: 0 in 0.428s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:21:14 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-edc01052-8606-46ad-b077-820fbecf2c11 tempest-SnapshotsActionsTest-1545171846 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86188) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 20:21:14 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-edc01052-8606-46ad-b077-820fbecf2c11 tempest-SnapshotsActionsTest-1545171846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.f00a62a4-152c-4f9c-9ccb-95299165c82e {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:21:14 devstack sudo[91196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.f00a62a4-152c-4f9c-9ccb-95299165c82e Sep 16 20:21:14 devstack sudo[91196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:21:15 devstack sudo[91196]: pam_unix(sudo:session): session closed for user root Sep 16 20:21:15 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-edc01052-8606-46ad-b077-820fbecf2c11 tempest-SnapshotsActionsTest-1545171846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.f00a62a4-152c-4f9c-9ccb-95299165c82e" returned: 0 in 0.436s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:21:15 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-edc01052-8606-46ad-b077-820fbecf2c11 tempest-SnapshotsActionsTest-1545171846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.f00a62a4-152c-4f9c-9ccb-95299165c82e {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:21:15 devstack sudo[91202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.f00a62a4-152c-4f9c-9ccb-95299165c82e Sep 16 20:21:15 devstack sudo[91202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:21:15 devstack sudo[91202]: pam_unix(sudo:session): session closed for user root Sep 16 20:21:15 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-edc01052-8606-46ad-b077-820fbecf2c11 tempest-SnapshotsActionsTest-1545171846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.f00a62a4-152c-4f9c-9ccb-95299165c82e" returned: 0 in 0.399s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:21:15 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-edc01052-8606-46ad-b077-820fbecf2c11 tempest-SnapshotsActionsTest-1545171846 None] Lock "cinder-quobyte-f00a62a4-152c-4f9c-9ccb-95299165c82e" released by "_delete_snapshot" :: held 2.002s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:21:15 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-edc01052-8606-46ad-b077-820fbecf2c11 tempest-SnapshotsActionsTest-1545171846 None] Lock "cinder-quobyte-82a53f25-7404-46c3-a063-5eda0dc0a9a2" released by "delete_snapshot" :: held 2.036s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:21:15 devstack cinder-volume[86188]: WARNING cinder.quota [None req-edc01052-8606-46ad-b077-820fbecf2c11 tempest-SnapshotsActionsTest-1545171846 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 16 20:21:15 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-edc01052-8606-46ad-b077-820fbecf2c11 tempest-SnapshotsActionsTest-1545171846 None] Created reservations ['a339e635-bd54-4a8c-b132-a9ebd7c45c0e', 'c6e06b7f-42d0-4a99-8830-36ea7e826171', '37205a80-dc05-4d3a-b358-bf28b8185d40', '0fd7b16e-1a76-47eb-9332-bfea1a550cfc'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:21:15 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-7d5e63ff-549a-4bc8-bcf3-626f18d63292 tempest-ServersNegativeTestJSON-1618961904 None] Acquiring lock "cinder-13849c5e-aec0-4c98-9673-1f8bd2cc50ea-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:21:15 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-7d5e63ff-549a-4bc8-bcf3-626f18d63292 tempest-ServersNegativeTestJSON-1618961904 None] Lock "cinder-13849c5e-aec0-4c98-9673-1f8bd2cc50ea-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:21:15 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-edc01052-8606-46ad-b077-820fbecf2c11 tempest-SnapshotsActionsTest-1545171846 None] Delete snapshot completed successfully. Sep 16 20:21:15 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-7d5e63ff-549a-4bc8-bcf3-626f18d63292 tempest-ServersNegativeTestJSON-1618961904 None] Acquiring lock "cinder-quobyte-13849c5e-aec0-4c98-9673-1f8bd2cc50ea" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:21:15 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-edc01052-8606-46ad-b077-820fbecf2c11 tempest-SnapshotsActionsTest-1545171846 None] Lock "cinder-f00a62a4-152c-4f9c-9ccb-95299165c82e-delete_snapshot" released by "delete_snapshot" :: held 2.303s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:21:15 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-7d5e63ff-549a-4bc8-bcf3-626f18d63292 tempest-ServersNegativeTestJSON-1618961904 None] Lock "cinder-quobyte-13849c5e-aec0-4c98-9673-1f8bd2cc50ea" acquired by "delete_volume" :: waited 0.022s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:21:16 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[b809b54e-071d-40b6-99e1-29dc82dead74]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:21:16 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-7d5e63ff-549a-4bc8-bcf3-626f18d63292 tempest-ServersNegativeTestJSON-1618961904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-13849c5e-aec0-4c98-9673-1f8bd2cc50ea {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:21:16 devstack sudo[91205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-13849c5e-aec0-4c98-9673-1f8bd2cc50ea Sep 16 20:21:16 devstack sudo[91205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:21:16 devstack sudo[91205]: pam_unix(sudo:session): session closed for user root Sep 16 20:21:16 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-7d5e63ff-549a-4bc8-bcf3-626f18d63292 tempest-ServersNegativeTestJSON-1618961904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-13849c5e-aec0-4c98-9673-1f8bd2cc50ea" returned: 0 in 0.483s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:21:16 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-7d5e63ff-549a-4bc8-bcf3-626f18d63292 tempest-ServersNegativeTestJSON-1618961904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-13849c5e-aec0-4c98-9673-1f8bd2cc50ea {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:21:16 devstack sudo[91213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-13849c5e-aec0-4c98-9673-1f8bd2cc50ea Sep 16 20:21:16 devstack sudo[91213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:21:16 devstack sudo[91213]: pam_unix(sudo:session): session closed for user root Sep 16 20:21:16 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-7d5e63ff-549a-4bc8-bcf3-626f18d63292 tempest-ServersNegativeTestJSON-1618961904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-13849c5e-aec0-4c98-9673-1f8bd2cc50ea" returned: 0 in 0.312s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:21:16 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-7d5e63ff-549a-4bc8-bcf3-626f18d63292 tempest-ServersNegativeTestJSON-1618961904 None] Lock "cinder-quobyte-13849c5e-aec0-4c98-9673-1f8bd2cc50ea" released by "delete_volume" :: held 0.855s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:21:16 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-7d5e63ff-549a-4bc8-bcf3-626f18d63292 tempest-ServersNegativeTestJSON-1618961904 None] Created reservations ['124c3f85-508b-4203-bd3c-219e569f7e9b', '049511db-90aa-4a99-bf31-c09b60bc002d', '483e794c-580d-4635-b411-4ac0aff03863', 'c089f676-4756-47d6-a690-c6a1748f1303'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:21:17 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-7d5e63ff-549a-4bc8-bcf3-626f18d63292 tempest-ServersNegativeTestJSON-1618961904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:21:17 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-7d5e63ff-549a-4bc8-bcf3-626f18d63292 tempest-ServersNegativeTestJSON-1618961904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:21:17 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-7d5e63ff-549a-4bc8-bcf3-626f18d63292 tempest-ServersNegativeTestJSON-1618961904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:21:17 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-7d5e63ff-549a-4bc8-bcf3-626f18d63292 tempest-ServersNegativeTestJSON-1618961904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:21:17 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-7d5e63ff-549a-4bc8-bcf3-626f18d63292 tempest-ServersNegativeTestJSON-1618961904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:21:17 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-7d5e63ff-549a-4bc8-bcf3-626f18d63292 tempest-ServersNegativeTestJSON-1618961904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:21:17 devstack sudo[91229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:21:17 devstack sudo[91229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:21:17 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-519daacc-c274-4e6c-ae5c-fd21678c3a35 tempest-SnapshotsActionsTest-483685712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:21:17 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-519daacc-c274-4e6c-ae5c-fd21678c3a35 tempest-SnapshotsActionsTest-483685712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:21:17 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-519daacc-c274-4e6c-ae5c-fd21678c3a35 tempest-SnapshotsActionsTest-483685712 None] Creating offline snapshot 211b1a20-44bf-4e31-a88f-bde6e2cacc57 of volume 82a53f25-7404-46c3-a063-5eda0dc0a9a2 {{(pid=86188) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 20:21:17 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[7af3a1c2-0229-4216-b0ee-95b2ca91124c]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:21:17 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-519daacc-c274-4e6c-ae5c-fd21678c3a35 tempest-SnapshotsActionsTest-483685712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.1fe70f32-a27c-43ee-a6a0-e87f3758b99d {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:21:17 devstack sudo[91229]: pam_unix(sudo:session): session closed for user root Sep 16 20:21:17 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-7d5e63ff-549a-4bc8-bcf3-626f18d63292 tempest-ServersNegativeTestJSON-1618961904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.501s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:21:17 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-7d5e63ff-549a-4bc8-bcf3-626f18d63292 tempest-ServersNegativeTestJSON-1618961904 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:21:17 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-7d5e63ff-549a-4bc8-bcf3-626f18d63292 tempest-ServersNegativeTestJSON-1618961904 None] Deleted volume successfully. Sep 16 20:21:17 devstack sudo[91235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.1fe70f32-a27c-43ee-a6a0-e87f3758b99d Sep 16 20:21:17 devstack sudo[91235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:21:17 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-7d5e63ff-549a-4bc8-bcf3-626f18d63292 tempest-ServersNegativeTestJSON-1618961904 None] Lock "cinder-13849c5e-aec0-4c98-9673-1f8bd2cc50ea-delete_volume" released by "delete_volume" :: held 1.877s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:21:18 devstack sudo[91235]: pam_unix(sudo:session): session closed for user root Sep 16 20:21:18 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-519daacc-c274-4e6c-ae5c-fd21678c3a35 tempest-SnapshotsActionsTest-483685712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.1fe70f32-a27c-43ee-a6a0-e87f3758b99d" returned: 0 in 0.404s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:21:18 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-519daacc-c274-4e6c-ae5c-fd21678c3a35 tempest-SnapshotsActionsTest-483685712 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86188) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 20:21:18 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-519daacc-c274-4e6c-ae5c-fd21678c3a35 tempest-SnapshotsActionsTest-483685712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.1fe70f32-a27c-43ee-a6a0-e87f3758b99d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.211b1a20-44bf-4e31-a88f-bde6e2cacc57 1G {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:21:18 devstack sudo[91242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.1fe70f32-a27c-43ee-a6a0-e87f3758b99d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.211b1a20-44bf-4e31-a88f-bde6e2cacc57 1G Sep 16 20:21:18 devstack sudo[91242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:21:18 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-957c77b3-6207-4fe1-b2da-4609a60b0deb tempest-ServersNegativeTestJSON-1618961904 None] Acquiring lock "cinder-ca98fb94-0d96-4094-832d-68cf0fd1f19c-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:21:18 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-957c77b3-6207-4fe1-b2da-4609a60b0deb tempest-ServersNegativeTestJSON-1618961904 None] Lock "cinder-ca98fb94-0d96-4094-832d-68cf0fd1f19c-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:21:18 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-957c77b3-6207-4fe1-b2da-4609a60b0deb tempest-ServersNegativeTestJSON-1618961904 None] Acquiring lock "cinder-quobyte-ca98fb94-0d96-4094-832d-68cf0fd1f19c" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:21:18 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-957c77b3-6207-4fe1-b2da-4609a60b0deb tempest-ServersNegativeTestJSON-1618961904 None] Lock "cinder-quobyte-ca98fb94-0d96-4094-832d-68cf0fd1f19c" acquired by "delete_volume" :: waited 0.032s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:21:18 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[df1f9afc-f252-45be-a61a-8cf420f123c9]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:21:18 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-957c77b3-6207-4fe1-b2da-4609a60b0deb tempest-ServersNegativeTestJSON-1618961904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ca98fb94-0d96-4094-832d-68cf0fd1f19c {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:21:18 devstack sudo[91248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ca98fb94-0d96-4094-832d-68cf0fd1f19c Sep 16 20:21:18 devstack sudo[91248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:21:18 devstack sudo[91242]: pam_unix(sudo:session): session closed for user root Sep 16 20:21:18 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-519daacc-c274-4e6c-ae5c-fd21678c3a35 tempest-SnapshotsActionsTest-483685712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.1fe70f32-a27c-43ee-a6a0-e87f3758b99d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.211b1a20-44bf-4e31-a88f-bde6e2cacc57 1G" returned: 0 in 0.679s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:21:18 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-519daacc-c274-4e6c-ae5c-fd21678c3a35 tempest-SnapshotsActionsTest-483685712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.1fe70f32-a27c-43ee-a6a0-e87f3758b99d -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.211b1a20-44bf-4e31-a88f-bde6e2cacc57 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:21:18 devstack sudo[91251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.1fe70f32-a27c-43ee-a6a0-e87f3758b99d -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.211b1a20-44bf-4e31-a88f-bde6e2cacc57 Sep 16 20:21:18 devstack sudo[91251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:21:18 devstack sudo[91248]: pam_unix(sudo:session): session closed for user root Sep 16 20:21:18 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-957c77b3-6207-4fe1-b2da-4609a60b0deb tempest-ServersNegativeTestJSON-1618961904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ca98fb94-0d96-4094-832d-68cf0fd1f19c" returned: 0 in 0.478s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:21:18 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-957c77b3-6207-4fe1-b2da-4609a60b0deb tempest-ServersNegativeTestJSON-1618961904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ca98fb94-0d96-4094-832d-68cf0fd1f19c {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:21:19 devstack sudo[91258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ca98fb94-0d96-4094-832d-68cf0fd1f19c Sep 16 20:21:19 devstack sudo[91258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:21:19 devstack sudo[91251]: pam_unix(sudo:session): session closed for user root Sep 16 20:21:19 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-519daacc-c274-4e6c-ae5c-fd21678c3a35 tempest-SnapshotsActionsTest-483685712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.1fe70f32-a27c-43ee-a6a0-e87f3758b99d -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.211b1a20-44bf-4e31-a88f-bde6e2cacc57" returned: 0 in 0.439s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:21:19 devstack cinder-volume[86188]: WARNING cinder.volume.drivers.remotefs [None req-519daacc-c274-4e6c-ae5c-fd21678c3a35 tempest-SnapshotsActionsTest-483685712 None] /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.211b1a20-44bf-4e31-a88f-bde6e2cacc57 is being set with open permissions: ugo+rw Sep 16 20:21:19 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-519daacc-c274-4e6c-ae5c-fd21678c3a35 tempest-SnapshotsActionsTest-483685712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.211b1a20-44bf-4e31-a88f-bde6e2cacc57 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:21:19 devstack sudo[91265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.211b1a20-44bf-4e31-a88f-bde6e2cacc57 Sep 16 20:21:19 devstack sudo[91265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:21:19 devstack sudo[91258]: pam_unix(sudo:session): session closed for user root Sep 16 20:21:19 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-957c77b3-6207-4fe1-b2da-4609a60b0deb tempest-ServersNegativeTestJSON-1618961904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ca98fb94-0d96-4094-832d-68cf0fd1f19c" returned: 0 in 0.318s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:21:19 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-957c77b3-6207-4fe1-b2da-4609a60b0deb tempest-ServersNegativeTestJSON-1618961904 None] Lock "cinder-quobyte-ca98fb94-0d96-4094-832d-68cf0fd1f19c" released by "delete_volume" :: held 0.862s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:21:19 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-957c77b3-6207-4fe1-b2da-4609a60b0deb tempest-ServersNegativeTestJSON-1618961904 None] Created reservations ['0e7652b1-8644-4256-a9e1-c89e5a1513d5', '2640ae16-9d28-4b86-b002-9c2cc6ff4a7b', '1366884f-d2c6-4a47-a888-96661fcc355b', 'deb8b1f7-2337-4e5c-9f94-e0fdbbd1d34f'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:21:19 devstack sudo[91265]: pam_unix(sudo:session): session closed for user root Sep 16 20:21:19 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-519daacc-c274-4e6c-ae5c-fd21678c3a35 tempest-SnapshotsActionsTest-483685712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.211b1a20-44bf-4e31-a88f-bde6e2cacc57" returned: 0 in 0.282s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:21:19 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-519daacc-c274-4e6c-ae5c-fd21678c3a35 tempest-SnapshotsActionsTest-483685712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.953s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:21:19 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-957c77b3-6207-4fe1-b2da-4609a60b0deb tempest-ServersNegativeTestJSON-1618961904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:21:19 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-957c77b3-6207-4fe1-b2da-4609a60b0deb tempest-ServersNegativeTestJSON-1618961904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:21:19 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-957c77b3-6207-4fe1-b2da-4609a60b0deb tempest-ServersNegativeTestJSON-1618961904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:21:19 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-957c77b3-6207-4fe1-b2da-4609a60b0deb tempest-ServersNegativeTestJSON-1618961904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:21:19 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-957c77b3-6207-4fe1-b2da-4609a60b0deb tempest-ServersNegativeTestJSON-1618961904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:21:19 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-957c77b3-6207-4fe1-b2da-4609a60b0deb tempest-ServersNegativeTestJSON-1618961904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:21:19 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-519daacc-c274-4e6c-ae5c-fd21678c3a35 tempest-SnapshotsActionsTest-483685712 None] Create snapshot completed successfully Sep 16 20:21:19 devstack sudo[91269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:21:19 devstack sudo[91269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:21:20 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-754c7c1a-d4e0-4e85-9e40-a9ce5624cc81 tempest-SnapshotsActionsTest-1545171846 None] Acquiring lock "cinder-211b1a20-44bf-4e31-a88f-bde6e2cacc57-delete_snapshot" by "delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:21:20 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-754c7c1a-d4e0-4e85-9e40-a9ce5624cc81 tempest-SnapshotsActionsTest-1545171846 None] Lock "cinder-211b1a20-44bf-4e31-a88f-bde6e2cacc57-delete_snapshot" acquired by "delete_snapshot" :: waited 0.096s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:21:20 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-754c7c1a-d4e0-4e85-9e40-a9ce5624cc81 tempest-SnapshotsActionsTest-1545171846 None] Acquiring lock "cinder-quobyte-82a53f25-7404-46c3-a063-5eda0dc0a9a2" by "delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:21:20 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-754c7c1a-d4e0-4e85-9e40-a9ce5624cc81 tempest-SnapshotsActionsTest-1545171846 None] Lock "cinder-quobyte-82a53f25-7404-46c3-a063-5eda0dc0a9a2" acquired by "delete_snapshot" :: waited 0.041s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:21:20 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-754c7c1a-d4e0-4e85-9e40-a9ce5624cc81 tempest-SnapshotsActionsTest-1545171846 None] Acquiring lock "cinder-quobyte-211b1a20-44bf-4e31-a88f-bde6e2cacc57" by "_delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:21:20 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-754c7c1a-d4e0-4e85-9e40-a9ce5624cc81 tempest-SnapshotsActionsTest-1545171846 None] Lock "cinder-quobyte-211b1a20-44bf-4e31-a88f-bde6e2cacc57" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:21:20 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-754c7c1a-d4e0-4e85-9e40-a9ce5624cc81 tempest-SnapshotsActionsTest-1545171846 None] Deleting offline snapshot 211b1a20-44bf-4e31-a88f-bde6e2cacc57 of volume 82a53f25-7404-46c3-a063-5eda0dc0a9a2 {{(pid=86188) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 20:21:20 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-754c7c1a-d4e0-4e85-9e40-a9ce5624cc81 tempest-SnapshotsActionsTest-1545171846 None] snapshot_file for this snap is: volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.211b1a20-44bf-4e31-a88f-bde6e2cacc57 {{(pid=86188) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 20:21:20 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d4e5abf-d582-41a5-b852-837bd5b822b5]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:21:20 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-754c7c1a-d4e0-4e85-9e40-a9ce5624cc81 tempest-SnapshotsActionsTest-1545171846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.211b1a20-44bf-4e31-a88f-bde6e2cacc57 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:21:20 devstack sudo[91269]: pam_unix(sudo:session): session closed for user root Sep 16 20:21:20 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-957c77b3-6207-4fe1-b2da-4609a60b0deb tempest-ServersNegativeTestJSON-1618961904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.923s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:21:20 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-957c77b3-6207-4fe1-b2da-4609a60b0deb tempest-ServersNegativeTestJSON-1618961904 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:21:20 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-957c77b3-6207-4fe1-b2da-4609a60b0deb tempest-ServersNegativeTestJSON-1618961904 None] Deleted volume successfully. Sep 16 20:21:20 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-957c77b3-6207-4fe1-b2da-4609a60b0deb tempest-ServersNegativeTestJSON-1618961904 None] Lock "cinder-ca98fb94-0d96-4094-832d-68cf0fd1f19c-delete_volume" released by "delete_volume" :: held 2.243s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:21:20 devstack sudo[91287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.211b1a20-44bf-4e31-a88f-bde6e2cacc57 Sep 16 20:21:20 devstack sudo[91287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:21:21 devstack sudo[91287]: pam_unix(sudo:session): session closed for user root Sep 16 20:21:21 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-754c7c1a-d4e0-4e85-9e40-a9ce5624cc81 tempest-SnapshotsActionsTest-1545171846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.211b1a20-44bf-4e31-a88f-bde6e2cacc57" returned: 0 in 1.123s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:21:21 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-754c7c1a-d4e0-4e85-9e40-a9ce5624cc81 tempest-SnapshotsActionsTest-1545171846 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86188) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 20:21:21 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5db6d42-9c8a-46b3-aebd-7300b0e6e0f7]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:21:21 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-754c7c1a-d4e0-4e85-9e40-a9ce5624cc81 tempest-SnapshotsActionsTest-1545171846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.1fe70f32-a27c-43ee-a6a0-e87f3758b99d {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:21:21 devstack sudo[91335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.1fe70f32-a27c-43ee-a6a0-e87f3758b99d Sep 16 20:21:21 devstack sudo[91335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:21:22 devstack sudo[91335]: pam_unix(sudo:session): session closed for user root Sep 16 20:21:22 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-754c7c1a-d4e0-4e85-9e40-a9ce5624cc81 tempest-SnapshotsActionsTest-1545171846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.1fe70f32-a27c-43ee-a6a0-e87f3758b99d" returned: 0 in 0.605s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:21:22 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-754c7c1a-d4e0-4e85-9e40-a9ce5624cc81 tempest-SnapshotsActionsTest-1545171846 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86188) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 20:21:22 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-754c7c1a-d4e0-4e85-9e40-a9ce5624cc81 tempest-SnapshotsActionsTest-1545171846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.211b1a20-44bf-4e31-a88f-bde6e2cacc57 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:21:22 devstack sudo[91342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.211b1a20-44bf-4e31-a88f-bde6e2cacc57 Sep 16 20:21:22 devstack sudo[91342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:21:23 devstack sudo[91342]: pam_unix(sudo:session): session closed for user root Sep 16 20:21:23 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-754c7c1a-d4e0-4e85-9e40-a9ce5624cc81 tempest-SnapshotsActionsTest-1545171846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.211b1a20-44bf-4e31-a88f-bde6e2cacc57" returned: 0 in 0.973s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:21:23 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-754c7c1a-d4e0-4e85-9e40-a9ce5624cc81 tempest-SnapshotsActionsTest-1545171846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.211b1a20-44bf-4e31-a88f-bde6e2cacc57 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:21:23 devstack sudo[91352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.211b1a20-44bf-4e31-a88f-bde6e2cacc57 Sep 16 20:21:23 devstack sudo[91352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:21:23 devstack sudo[91352]: pam_unix(sudo:session): session closed for user root Sep 16 20:21:23 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-754c7c1a-d4e0-4e85-9e40-a9ce5624cc81 tempest-SnapshotsActionsTest-1545171846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.211b1a20-44bf-4e31-a88f-bde6e2cacc57" returned: 0 in 0.471s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:21:23 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-754c7c1a-d4e0-4e85-9e40-a9ce5624cc81 tempest-SnapshotsActionsTest-1545171846 None] Lock "cinder-quobyte-211b1a20-44bf-4e31-a88f-bde6e2cacc57" released by "_delete_snapshot" :: held 3.433s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:21:23 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-754c7c1a-d4e0-4e85-9e40-a9ce5624cc81 tempest-SnapshotsActionsTest-1545171846 None] Lock "cinder-quobyte-82a53f25-7404-46c3-a063-5eda0dc0a9a2" released by "delete_snapshot" :: held 3.484s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:21:23 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-754c7c1a-d4e0-4e85-9e40-a9ce5624cc81 tempest-SnapshotsActionsTest-1545171846 None] Created reservations ['746d6458-d688-4a12-a1c6-fa1e6a780eca', 'dbedf9e5-64d6-4276-9e24-c49b6a52430a', '117afcfa-e714-45f4-bb65-ca6320b0acb1', '5f651eb7-90a1-4e2d-a93b-d431bc359803'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:21:23 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-754c7c1a-d4e0-4e85-9e40-a9ce5624cc81 tempest-SnapshotsActionsTest-1545171846 None] Delete snapshot completed successfully. Sep 16 20:21:23 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-754c7c1a-d4e0-4e85-9e40-a9ce5624cc81 tempest-SnapshotsActionsTest-1545171846 None] Lock "cinder-211b1a20-44bf-4e31-a88f-bde6e2cacc57-delete_snapshot" released by "delete_snapshot" :: held 3.699s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:21:25 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-33b03ce6-ac2a-46ad-a8a8-db8c3ca5b865 tempest-SnapshotsActionsTest-483685712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:21:25 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-33b03ce6-ac2a-46ad-a8a8-db8c3ca5b865 tempest-SnapshotsActionsTest-483685712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:21:25 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-33b03ce6-ac2a-46ad-a8a8-db8c3ca5b865 tempest-SnapshotsActionsTest-483685712 None] Creating offline snapshot 166a937a-95db-4d61-8ceb-b62f1fca2ec1 of volume 82a53f25-7404-46c3-a063-5eda0dc0a9a2 {{(pid=86188) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 20:21:25 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[06626197-a678-415a-aca8-482fbd104215]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:21:25 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-33b03ce6-ac2a-46ad-a8a8-db8c3ca5b865 tempest-SnapshotsActionsTest-483685712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.1fe70f32-a27c-43ee-a6a0-e87f3758b99d {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:21:25 devstack sudo[91402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.1fe70f32-a27c-43ee-a6a0-e87f3758b99d Sep 16 20:21:25 devstack sudo[91402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:21:25 devstack sudo[91402]: pam_unix(sudo:session): session closed for user root Sep 16 20:21:25 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-33b03ce6-ac2a-46ad-a8a8-db8c3ca5b865 tempest-SnapshotsActionsTest-483685712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.1fe70f32-a27c-43ee-a6a0-e87f3758b99d" returned: 0 in 0.570s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:21:25 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-33b03ce6-ac2a-46ad-a8a8-db8c3ca5b865 tempest-SnapshotsActionsTest-483685712 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86188) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 20:21:25 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-33b03ce6-ac2a-46ad-a8a8-db8c3ca5b865 tempest-SnapshotsActionsTest-483685712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.1fe70f32-a27c-43ee-a6a0-e87f3758b99d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.166a937a-95db-4d61-8ceb-b62f1fca2ec1 1G {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:21:25 devstack sudo[91408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.1fe70f32-a27c-43ee-a6a0-e87f3758b99d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.166a937a-95db-4d61-8ceb-b62f1fca2ec1 1G Sep 16 20:21:25 devstack sudo[91408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:21:26 devstack sudo[91408]: pam_unix(sudo:session): session closed for user root Sep 16 20:21:26 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-33b03ce6-ac2a-46ad-a8a8-db8c3ca5b865 tempest-SnapshotsActionsTest-483685712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.1fe70f32-a27c-43ee-a6a0-e87f3758b99d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.166a937a-95db-4d61-8ceb-b62f1fca2ec1 1G" returned: 0 in 0.635s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:21:26 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-33b03ce6-ac2a-46ad-a8a8-db8c3ca5b865 tempest-SnapshotsActionsTest-483685712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.1fe70f32-a27c-43ee-a6a0-e87f3758b99d -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.166a937a-95db-4d61-8ceb-b62f1fca2ec1 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:21:26 devstack sudo[91418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.1fe70f32-a27c-43ee-a6a0-e87f3758b99d -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.166a937a-95db-4d61-8ceb-b62f1fca2ec1 Sep 16 20:21:26 devstack sudo[91418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:21:26 devstack sudo[91418]: pam_unix(sudo:session): session closed for user root Sep 16 20:21:26 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-33b03ce6-ac2a-46ad-a8a8-db8c3ca5b865 tempest-SnapshotsActionsTest-483685712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.1fe70f32-a27c-43ee-a6a0-e87f3758b99d -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.166a937a-95db-4d61-8ceb-b62f1fca2ec1" returned: 0 in 0.352s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:21:26 devstack cinder-volume[86188]: WARNING cinder.volume.drivers.remotefs [None req-33b03ce6-ac2a-46ad-a8a8-db8c3ca5b865 tempest-SnapshotsActionsTest-483685712 None] /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.166a937a-95db-4d61-8ceb-b62f1fca2ec1 is being set with open permissions: ugo+rw Sep 16 20:21:26 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-33b03ce6-ac2a-46ad-a8a8-db8c3ca5b865 tempest-SnapshotsActionsTest-483685712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.166a937a-95db-4d61-8ceb-b62f1fca2ec1 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:21:26 devstack sudo[91423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.166a937a-95db-4d61-8ceb-b62f1fca2ec1 Sep 16 20:21:26 devstack sudo[91423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:21:27 devstack sudo[91423]: pam_unix(sudo:session): session closed for user root Sep 16 20:21:27 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-33b03ce6-ac2a-46ad-a8a8-db8c3ca5b865 tempest-SnapshotsActionsTest-483685712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.166a937a-95db-4d61-8ceb-b62f1fca2ec1" returned: 0 in 0.283s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:21:27 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-33b03ce6-ac2a-46ad-a8a8-db8c3ca5b865 tempest-SnapshotsActionsTest-483685712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.071s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:21:27 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-33b03ce6-ac2a-46ad-a8a8-db8c3ca5b865 tempest-SnapshotsActionsTest-483685712 None] Create snapshot completed successfully Sep 16 20:21:28 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-4ae48c23-24e5-462d-83ff-fda37721b43f tempest-SnapshotsActionsTest-1545171846 None] Acquiring lock "cinder-166a937a-95db-4d61-8ceb-b62f1fca2ec1-delete_snapshot" by "delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:21:28 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-4ae48c23-24e5-462d-83ff-fda37721b43f tempest-SnapshotsActionsTest-1545171846 None] Lock "cinder-166a937a-95db-4d61-8ceb-b62f1fca2ec1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:21:28 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-4ae48c23-24e5-462d-83ff-fda37721b43f tempest-SnapshotsActionsTest-1545171846 None] Acquiring lock "cinder-quobyte-82a53f25-7404-46c3-a063-5eda0dc0a9a2" by "delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:21:28 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-4ae48c23-24e5-462d-83ff-fda37721b43f tempest-SnapshotsActionsTest-1545171846 None] Lock "cinder-quobyte-82a53f25-7404-46c3-a063-5eda0dc0a9a2" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:21:28 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-4ae48c23-24e5-462d-83ff-fda37721b43f tempest-SnapshotsActionsTest-1545171846 None] Acquiring lock "cinder-quobyte-166a937a-95db-4d61-8ceb-b62f1fca2ec1" by "_delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:21:28 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-4ae48c23-24e5-462d-83ff-fda37721b43f tempest-SnapshotsActionsTest-1545171846 None] Lock "cinder-quobyte-166a937a-95db-4d61-8ceb-b62f1fca2ec1" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:21:28 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-4ae48c23-24e5-462d-83ff-fda37721b43f tempest-SnapshotsActionsTest-1545171846 None] Deleting offline snapshot 166a937a-95db-4d61-8ceb-b62f1fca2ec1 of volume 82a53f25-7404-46c3-a063-5eda0dc0a9a2 {{(pid=86188) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 20:21:28 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-4ae48c23-24e5-462d-83ff-fda37721b43f tempest-SnapshotsActionsTest-1545171846 None] snapshot_file for this snap is: volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.166a937a-95db-4d61-8ceb-b62f1fca2ec1 {{(pid=86188) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 20:21:28 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[756f6986-745e-4eef-94b6-a0df4717769b]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:21:28 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-4ae48c23-24e5-462d-83ff-fda37721b43f tempest-SnapshotsActionsTest-1545171846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.166a937a-95db-4d61-8ceb-b62f1fca2ec1 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:21:28 devstack sudo[91451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.166a937a-95db-4d61-8ceb-b62f1fca2ec1 Sep 16 20:21:28 devstack sudo[91451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:21:29 devstack sudo[91451]: pam_unix(sudo:session): session closed for user root Sep 16 20:21:29 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-4ae48c23-24e5-462d-83ff-fda37721b43f tempest-SnapshotsActionsTest-1545171846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.166a937a-95db-4d61-8ceb-b62f1fca2ec1" returned: 0 in 0.405s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:21:29 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-4ae48c23-24e5-462d-83ff-fda37721b43f tempest-SnapshotsActionsTest-1545171846 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86188) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 20:21:29 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[7378bd3b-46af-4b5b-9024-a4588094f512]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:21:29 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-4ae48c23-24e5-462d-83ff-fda37721b43f tempest-SnapshotsActionsTest-1545171846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.1fe70f32-a27c-43ee-a6a0-e87f3758b99d {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:21:29 devstack sudo[91456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.1fe70f32-a27c-43ee-a6a0-e87f3758b99d Sep 16 20:21:29 devstack sudo[91456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:21:29 devstack sudo[91456]: pam_unix(sudo:session): session closed for user root Sep 16 20:21:29 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-4ae48c23-24e5-462d-83ff-fda37721b43f tempest-SnapshotsActionsTest-1545171846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.1fe70f32-a27c-43ee-a6a0-e87f3758b99d" returned: 0 in 0.466s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:21:29 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-4ae48c23-24e5-462d-83ff-fda37721b43f tempest-SnapshotsActionsTest-1545171846 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86188) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 20:21:29 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-4ae48c23-24e5-462d-83ff-fda37721b43f tempest-SnapshotsActionsTest-1545171846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.166a937a-95db-4d61-8ceb-b62f1fca2ec1 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:21:29 devstack sudo[91462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.166a937a-95db-4d61-8ceb-b62f1fca2ec1 Sep 16 20:21:29 devstack sudo[91462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:21:29 devstack sudo[91462]: pam_unix(sudo:session): session closed for user root Sep 16 20:21:29 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-4ae48c23-24e5-462d-83ff-fda37721b43f tempest-SnapshotsActionsTest-1545171846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.166a937a-95db-4d61-8ceb-b62f1fca2ec1" returned: 0 in 0.390s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:21:29 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-4ae48c23-24e5-462d-83ff-fda37721b43f tempest-SnapshotsActionsTest-1545171846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.166a937a-95db-4d61-8ceb-b62f1fca2ec1 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:21:29 devstack sudo[91467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.166a937a-95db-4d61-8ceb-b62f1fca2ec1 Sep 16 20:21:29 devstack sudo[91467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:21:30 devstack sudo[91467]: pam_unix(sudo:session): session closed for user root Sep 16 20:21:30 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-4ae48c23-24e5-462d-83ff-fda37721b43f tempest-SnapshotsActionsTest-1545171846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.166a937a-95db-4d61-8ceb-b62f1fca2ec1" returned: 0 in 0.267s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:21:30 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-4ae48c23-24e5-462d-83ff-fda37721b43f tempest-SnapshotsActionsTest-1545171846 None] Lock "cinder-quobyte-166a937a-95db-4d61-8ceb-b62f1fca2ec1" released by "_delete_snapshot" :: held 1.651s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:21:30 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-4ae48c23-24e5-462d-83ff-fda37721b43f tempest-SnapshotsActionsTest-1545171846 None] Lock "cinder-quobyte-82a53f25-7404-46c3-a063-5eda0dc0a9a2" released by "delete_snapshot" :: held 1.677s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:21:30 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-4ae48c23-24e5-462d-83ff-fda37721b43f tempest-SnapshotsActionsTest-1545171846 None] Created reservations ['9d629aa2-c491-4068-b3e8-4cf0ca399be2', '2dc74533-b9f0-4fa2-959b-487860fafd9b', '6cbb4a65-f8ac-47b0-9d68-cc73678be923', '8f4cda4a-38fa-409d-b6eb-c6e4f87d8c17'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:21:30 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-4ae48c23-24e5-462d-83ff-fda37721b43f tempest-SnapshotsActionsTest-1545171846 None] Delete snapshot completed successfully. Sep 16 20:21:30 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-4ae48c23-24e5-462d-83ff-fda37721b43f tempest-SnapshotsActionsTest-1545171846 None] Lock "cinder-166a937a-95db-4d61-8ceb-b62f1fca2ec1-delete_snapshot" released by "delete_snapshot" :: held 1.851s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:21:31 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-f579b61b-1066-44e0-880d-89a3647fc383 tempest-SnapshotsActionsTest-483685712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:21:31 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-f579b61b-1066-44e0-880d-89a3647fc383 tempest-SnapshotsActionsTest-483685712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:21:31 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-f579b61b-1066-44e0-880d-89a3647fc383 tempest-SnapshotsActionsTest-483685712 None] Creating offline snapshot 39efb2be-bdf6-4df8-9804-3940a5ecd1f1 of volume 82a53f25-7404-46c3-a063-5eda0dc0a9a2 {{(pid=86188) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 20:21:31 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e5ddd8c-fe9f-4575-97bf-7eb60c7d01a4]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:21:31 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f579b61b-1066-44e0-880d-89a3647fc383 tempest-SnapshotsActionsTest-483685712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.1fe70f32-a27c-43ee-a6a0-e87f3758b99d {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:21:31 devstack sudo[91471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.1fe70f32-a27c-43ee-a6a0-e87f3758b99d Sep 16 20:21:31 devstack sudo[91471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:21:31 devstack sudo[91471]: pam_unix(sudo:session): session closed for user root Sep 16 20:21:31 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f579b61b-1066-44e0-880d-89a3647fc383 tempest-SnapshotsActionsTest-483685712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.1fe70f32-a27c-43ee-a6a0-e87f3758b99d" returned: 0 in 0.493s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:21:31 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-f579b61b-1066-44e0-880d-89a3647fc383 tempest-SnapshotsActionsTest-483685712 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86188) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 20:21:31 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f579b61b-1066-44e0-880d-89a3647fc383 tempest-SnapshotsActionsTest-483685712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.1fe70f32-a27c-43ee-a6a0-e87f3758b99d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.39efb2be-bdf6-4df8-9804-3940a5ecd1f1 1G {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:21:31 devstack sudo[91476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.1fe70f32-a27c-43ee-a6a0-e87f3758b99d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.39efb2be-bdf6-4df8-9804-3940a5ecd1f1 1G Sep 16 20:21:31 devstack sudo[91476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:21:32 devstack sudo[91476]: pam_unix(sudo:session): session closed for user root Sep 16 20:21:32 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f579b61b-1066-44e0-880d-89a3647fc383 tempest-SnapshotsActionsTest-483685712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.1fe70f32-a27c-43ee-a6a0-e87f3758b99d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.39efb2be-bdf6-4df8-9804-3940a5ecd1f1 1G" returned: 0 in 0.683s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:21:32 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f579b61b-1066-44e0-880d-89a3647fc383 tempest-SnapshotsActionsTest-483685712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.1fe70f32-a27c-43ee-a6a0-e87f3758b99d -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.39efb2be-bdf6-4df8-9804-3940a5ecd1f1 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:21:32 devstack sudo[91482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.1fe70f32-a27c-43ee-a6a0-e87f3758b99d -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.39efb2be-bdf6-4df8-9804-3940a5ecd1f1 Sep 16 20:21:32 devstack sudo[91482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:21:32 devstack sudo[91482]: pam_unix(sudo:session): session closed for user root Sep 16 20:21:32 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f579b61b-1066-44e0-880d-89a3647fc383 tempest-SnapshotsActionsTest-483685712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.1fe70f32-a27c-43ee-a6a0-e87f3758b99d -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.39efb2be-bdf6-4df8-9804-3940a5ecd1f1" returned: 0 in 0.557s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:21:32 devstack cinder-volume[86188]: WARNING cinder.volume.drivers.remotefs [None req-f579b61b-1066-44e0-880d-89a3647fc383 tempest-SnapshotsActionsTest-483685712 None] /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.39efb2be-bdf6-4df8-9804-3940a5ecd1f1 is being set with open permissions: ugo+rw Sep 16 20:21:32 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f579b61b-1066-44e0-880d-89a3647fc383 tempest-SnapshotsActionsTest-483685712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.39efb2be-bdf6-4df8-9804-3940a5ecd1f1 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:21:32 devstack sudo[91488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.39efb2be-bdf6-4df8-9804-3940a5ecd1f1 Sep 16 20:21:32 devstack sudo[91488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:21:33 devstack sudo[91488]: pam_unix(sudo:session): session closed for user root Sep 16 20:21:33 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f579b61b-1066-44e0-880d-89a3647fc383 tempest-SnapshotsActionsTest-483685712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.39efb2be-bdf6-4df8-9804-3940a5ecd1f1" returned: 0 in 0.326s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:21:33 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-f579b61b-1066-44e0-880d-89a3647fc383 tempest-SnapshotsActionsTest-483685712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.240s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:21:33 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-f579b61b-1066-44e0-880d-89a3647fc383 tempest-SnapshotsActionsTest-483685712 None] Create snapshot completed successfully Sep 16 20:21:34 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-cbab86ae-4894-4ac8-90c0-5f6bd6894f22 tempest-SnapshotsActionsTest-1545171846 None] Acquiring lock "cinder-39efb2be-bdf6-4df8-9804-3940a5ecd1f1-delete_snapshot" by "delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:21:34 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-cbab86ae-4894-4ac8-90c0-5f6bd6894f22 tempest-SnapshotsActionsTest-1545171846 None] Lock "cinder-39efb2be-bdf6-4df8-9804-3940a5ecd1f1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:21:34 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-cbab86ae-4894-4ac8-90c0-5f6bd6894f22 tempest-SnapshotsActionsTest-1545171846 None] Acquiring lock "cinder-quobyte-82a53f25-7404-46c3-a063-5eda0dc0a9a2" by "delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:21:34 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-cbab86ae-4894-4ac8-90c0-5f6bd6894f22 tempest-SnapshotsActionsTest-1545171846 None] Lock "cinder-quobyte-82a53f25-7404-46c3-a063-5eda0dc0a9a2" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:21:34 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-cbab86ae-4894-4ac8-90c0-5f6bd6894f22 tempest-SnapshotsActionsTest-1545171846 None] Acquiring lock "cinder-quobyte-39efb2be-bdf6-4df8-9804-3940a5ecd1f1" by "_delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:21:34 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-cbab86ae-4894-4ac8-90c0-5f6bd6894f22 tempest-SnapshotsActionsTest-1545171846 None] Lock "cinder-quobyte-39efb2be-bdf6-4df8-9804-3940a5ecd1f1" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:21:34 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-cbab86ae-4894-4ac8-90c0-5f6bd6894f22 tempest-SnapshotsActionsTest-1545171846 None] Deleting offline snapshot 39efb2be-bdf6-4df8-9804-3940a5ecd1f1 of volume 82a53f25-7404-46c3-a063-5eda0dc0a9a2 {{(pid=86188) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 20:21:34 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-cbab86ae-4894-4ac8-90c0-5f6bd6894f22 tempest-SnapshotsActionsTest-1545171846 None] snapshot_file for this snap is: volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.39efb2be-bdf6-4df8-9804-3940a5ecd1f1 {{(pid=86188) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 20:21:34 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[430fe544-12a2-4bbd-8f31-e959c62eb142]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:21:34 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-cbab86ae-4894-4ac8-90c0-5f6bd6894f22 tempest-SnapshotsActionsTest-1545171846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.39efb2be-bdf6-4df8-9804-3940a5ecd1f1 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:21:34 devstack sudo[91494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.39efb2be-bdf6-4df8-9804-3940a5ecd1f1 Sep 16 20:21:34 devstack sudo[91494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:21:34 devstack cinder-volume[86188]: INFO cinder.volume.manager [req-001ef1ed-50e2-49ab-ba75-314e5f763702 req-871d9373-2032-44a0-b9d1-1227a2c7666a tempest-ServerActionsTestOtherA-1167936048 None] Terminate volume connection completed successfully. Sep 16 20:21:34 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [req-001ef1ed-50e2-49ab-ba75-314e5f763702 req-871d9373-2032-44a0-b9d1-1227a2c7666a tempest-ServerActionsTestOtherA-1167936048 None] Deleting attachment cfe4d728-4270-4beb-9a37-cf41ba1cfaa2. {{(pid=86188) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 16 20:21:35 devstack sudo[91494]: pam_unix(sudo:session): session closed for user root Sep 16 20:21:35 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-cbab86ae-4894-4ac8-90c0-5f6bd6894f22 tempest-SnapshotsActionsTest-1545171846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.39efb2be-bdf6-4df8-9804-3940a5ecd1f1" returned: 0 in 0.535s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:21:35 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-cbab86ae-4894-4ac8-90c0-5f6bd6894f22 tempest-SnapshotsActionsTest-1545171846 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86188) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 20:21:35 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7a0b9bb-0a0f-4440-93da-c4cf2435b286]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:21:35 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-cbab86ae-4894-4ac8-90c0-5f6bd6894f22 tempest-SnapshotsActionsTest-1545171846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.1fe70f32-a27c-43ee-a6a0-e87f3758b99d {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:21:35 devstack sudo[91502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.1fe70f32-a27c-43ee-a6a0-e87f3758b99d Sep 16 20:21:35 devstack sudo[91502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:21:35 devstack sudo[91502]: pam_unix(sudo:session): session closed for user root Sep 16 20:21:35 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-cbab86ae-4894-4ac8-90c0-5f6bd6894f22 tempest-SnapshotsActionsTest-1545171846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.1fe70f32-a27c-43ee-a6a0-e87f3758b99d" returned: 0 in 0.466s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:21:35 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-cbab86ae-4894-4ac8-90c0-5f6bd6894f22 tempest-SnapshotsActionsTest-1545171846 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86188) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 20:21:35 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-cbab86ae-4894-4ac8-90c0-5f6bd6894f22 tempest-SnapshotsActionsTest-1545171846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.39efb2be-bdf6-4df8-9804-3940a5ecd1f1 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:21:35 devstack sudo[91540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.39efb2be-bdf6-4df8-9804-3940a5ecd1f1 Sep 16 20:21:35 devstack sudo[91540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:21:36 devstack sudo[91540]: pam_unix(sudo:session): session closed for user root Sep 16 20:21:36 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-cbab86ae-4894-4ac8-90c0-5f6bd6894f22 tempest-SnapshotsActionsTest-1545171846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.39efb2be-bdf6-4df8-9804-3940a5ecd1f1" returned: 0 in 0.549s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:21:36 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-cbab86ae-4894-4ac8-90c0-5f6bd6894f22 tempest-SnapshotsActionsTest-1545171846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.39efb2be-bdf6-4df8-9804-3940a5ecd1f1 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:21:36 devstack sudo[91550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.39efb2be-bdf6-4df8-9804-3940a5ecd1f1 Sep 16 20:21:36 devstack sudo[91550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:21:36 devstack sudo[91550]: pam_unix(sudo:session): session closed for user root Sep 16 20:21:36 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-cbab86ae-4894-4ac8-90c0-5f6bd6894f22 tempest-SnapshotsActionsTest-1545171846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.39efb2be-bdf6-4df8-9804-3940a5ecd1f1" returned: 0 in 0.416s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:21:36 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-cbab86ae-4894-4ac8-90c0-5f6bd6894f22 tempest-SnapshotsActionsTest-1545171846 None] Lock "cinder-quobyte-39efb2be-bdf6-4df8-9804-3940a5ecd1f1" released by "_delete_snapshot" :: held 2.081s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:21:36 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-cbab86ae-4894-4ac8-90c0-5f6bd6894f22 tempest-SnapshotsActionsTest-1545171846 None] Lock "cinder-quobyte-82a53f25-7404-46c3-a063-5eda0dc0a9a2" released by "delete_snapshot" :: held 2.112s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:21:36 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-cbab86ae-4894-4ac8-90c0-5f6bd6894f22 tempest-SnapshotsActionsTest-1545171846 None] Created reservations ['ab4d54ae-9bd9-43fe-917e-b0dc3b9606b7', '1d26cf60-818f-4025-baa9-7beefa6e9655', '915d196d-bad0-43b7-ac82-316b62eb5d21', '8e52c26a-3e3b-47a0-8270-58de86841de4'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:21:36 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-cbab86ae-4894-4ac8-90c0-5f6bd6894f22 tempest-SnapshotsActionsTest-1545171846 None] Delete snapshot completed successfully. Sep 16 20:21:36 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-cbab86ae-4894-4ac8-90c0-5f6bd6894f22 tempest-SnapshotsActionsTest-1545171846 None] Lock "cinder-39efb2be-bdf6-4df8-9804-3940a5ecd1f1-delete_snapshot" released by "delete_snapshot" :: held 2.285s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:21:38 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-93e3f98c-3b51-433a-9a4a-390364c8786e tempest-SnapshotsActionsTest-483685712 None] Acquiring lock "cinder-1fe70f32-a27c-43ee-a6a0-e87f3758b99d-delete_snapshot" by "delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:21:38 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-93e3f98c-3b51-433a-9a4a-390364c8786e tempest-SnapshotsActionsTest-483685712 None] Lock "cinder-1fe70f32-a27c-43ee-a6a0-e87f3758b99d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:21:38 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-93e3f98c-3b51-433a-9a4a-390364c8786e tempest-SnapshotsActionsTest-483685712 None] Acquiring lock "cinder-quobyte-82a53f25-7404-46c3-a063-5eda0dc0a9a2" by "delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:21:38 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-93e3f98c-3b51-433a-9a4a-390364c8786e tempest-SnapshotsActionsTest-483685712 None] Lock "cinder-quobyte-82a53f25-7404-46c3-a063-5eda0dc0a9a2" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:21:38 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-93e3f98c-3b51-433a-9a4a-390364c8786e tempest-SnapshotsActionsTest-483685712 None] Acquiring lock "cinder-quobyte-1fe70f32-a27c-43ee-a6a0-e87f3758b99d" by "_delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:21:38 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-93e3f98c-3b51-433a-9a4a-390364c8786e tempest-SnapshotsActionsTest-483685712 None] Lock "cinder-quobyte-1fe70f32-a27c-43ee-a6a0-e87f3758b99d" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:21:38 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-93e3f98c-3b51-433a-9a4a-390364c8786e tempest-SnapshotsActionsTest-483685712 None] Deleting offline snapshot 1fe70f32-a27c-43ee-a6a0-e87f3758b99d of volume 82a53f25-7404-46c3-a063-5eda0dc0a9a2 {{(pid=86188) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 20:21:38 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-93e3f98c-3b51-433a-9a4a-390364c8786e tempest-SnapshotsActionsTest-483685712 None] snapshot_file for this snap is: volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.1fe70f32-a27c-43ee-a6a0-e87f3758b99d {{(pid=86188) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 20:21:38 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[48c0dc8a-bbaf-4d83-8f5d-839602f5a04e]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:21:38 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-93e3f98c-3b51-433a-9a4a-390364c8786e tempest-SnapshotsActionsTest-483685712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.1fe70f32-a27c-43ee-a6a0-e87f3758b99d {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:21:38 devstack sudo[91577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.1fe70f32-a27c-43ee-a6a0-e87f3758b99d Sep 16 20:21:38 devstack sudo[91577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:21:38 devstack sudo[91577]: pam_unix(sudo:session): session closed for user root Sep 16 20:21:38 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-93e3f98c-3b51-433a-9a4a-390364c8786e tempest-SnapshotsActionsTest-483685712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.1fe70f32-a27c-43ee-a6a0-e87f3758b99d" returned: 0 in 0.423s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:21:38 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-93e3f98c-3b51-433a-9a4a-390364c8786e tempest-SnapshotsActionsTest-483685712 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86188) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 20:21:38 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ee118a5-0339-4a2f-a029-8b07a86cac32]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:21:38 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-93e3f98c-3b51-433a-9a4a-390364c8786e tempest-SnapshotsActionsTest-483685712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:21:39 devstack sudo[91583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2 Sep 16 20:21:39 devstack sudo[91583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:21:39 devstack sudo[91583]: pam_unix(sudo:session): session closed for user root Sep 16 20:21:39 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-93e3f98c-3b51-433a-9a4a-390364c8786e tempest-SnapshotsActionsTest-483685712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2" returned: 0 in 0.541s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:21:39 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-93e3f98c-3b51-433a-9a4a-390364c8786e tempest-SnapshotsActionsTest-483685712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.1fe70f32-a27c-43ee-a6a0-e87f3758b99d {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:21:39 devstack sudo[91592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.1fe70f32-a27c-43ee-a6a0-e87f3758b99d Sep 16 20:21:39 devstack sudo[91592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:21:39 devstack sudo[91592]: pam_unix(sudo:session): session closed for user root Sep 16 20:21:39 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-93e3f98c-3b51-433a-9a4a-390364c8786e tempest-SnapshotsActionsTest-483685712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.1fe70f32-a27c-43ee-a6a0-e87f3758b99d" returned: 0 in 0.479s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:21:39 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-93e3f98c-3b51-433a-9a4a-390364c8786e tempest-SnapshotsActionsTest-483685712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.1fe70f32-a27c-43ee-a6a0-e87f3758b99d {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:21:39 devstack sudo[91598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.1fe70f32-a27c-43ee-a6a0-e87f3758b99d Sep 16 20:21:39 devstack sudo[91598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:21:40 devstack sudo[91598]: pam_unix(sudo:session): session closed for user root Sep 16 20:21:40 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-93e3f98c-3b51-433a-9a4a-390364c8786e tempest-SnapshotsActionsTest-483685712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2.1fe70f32-a27c-43ee-a6a0-e87f3758b99d" returned: 0 in 0.301s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:21:40 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-93e3f98c-3b51-433a-9a4a-390364c8786e tempest-SnapshotsActionsTest-483685712 None] Lock "cinder-quobyte-1fe70f32-a27c-43ee-a6a0-e87f3758b99d" released by "_delete_snapshot" :: held 1.882s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:21:40 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-93e3f98c-3b51-433a-9a4a-390364c8786e tempest-SnapshotsActionsTest-483685712 None] Lock "cinder-quobyte-82a53f25-7404-46c3-a063-5eda0dc0a9a2" released by "delete_snapshot" :: held 1.908s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:21:40 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-93e3f98c-3b51-433a-9a4a-390364c8786e tempest-SnapshotsActionsTest-483685712 None] Created reservations ['fa25d2a1-e0bc-41a5-9f30-52c3abe1d8d2', 'b373827b-363b-41e0-80f4-5bb5a0c6f35a', '735f2afc-07af-4a6c-bc17-02f220f61e67', '3b43e630-954e-45a2-b1c8-621f987cc93e'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:21:40 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-93e3f98c-3b51-433a-9a4a-390364c8786e tempest-SnapshotsActionsTest-483685712 None] Delete snapshot completed successfully. Sep 16 20:21:40 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-93e3f98c-3b51-433a-9a4a-390364c8786e tempest-SnapshotsActionsTest-483685712 None] Lock "cinder-1fe70f32-a27c-43ee-a6a0-e87f3758b99d-delete_snapshot" released by "delete_snapshot" :: held 2.070s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:21:40 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-f398f8f9-e628-4758-b258-ae0f541ad4e0 tempest-SnapshotsActionsTest-483685712 None] Acquiring lock "cinder-82a53f25-7404-46c3-a063-5eda0dc0a9a2-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:21:40 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-f398f8f9-e628-4758-b258-ae0f541ad4e0 tempest-SnapshotsActionsTest-483685712 None] Lock "cinder-82a53f25-7404-46c3-a063-5eda0dc0a9a2-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:21:40 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-f398f8f9-e628-4758-b258-ae0f541ad4e0 tempest-SnapshotsActionsTest-483685712 None] Acquiring lock "cinder-quobyte-82a53f25-7404-46c3-a063-5eda0dc0a9a2" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:21:40 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-f398f8f9-e628-4758-b258-ae0f541ad4e0 tempest-SnapshotsActionsTest-483685712 None] Lock "cinder-quobyte-82a53f25-7404-46c3-a063-5eda0dc0a9a2" acquired by "delete_volume" :: waited 0.019s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:21:40 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae266f93-379b-4fd6-a4c5-dbbefce5d969]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:21:40 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f398f8f9-e628-4758-b258-ae0f541ad4e0 tempest-SnapshotsActionsTest-483685712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:21:40 devstack sudo[91608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2 Sep 16 20:21:40 devstack sudo[91608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:21:41 devstack sudo[91608]: pam_unix(sudo:session): session closed for user root Sep 16 20:21:41 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f398f8f9-e628-4758-b258-ae0f541ad4e0 tempest-SnapshotsActionsTest-483685712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2" returned: 0 in 0.462s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:21:41 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f398f8f9-e628-4758-b258-ae0f541ad4e0 tempest-SnapshotsActionsTest-483685712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:21:41 devstack sudo[91613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2 Sep 16 20:21:41 devstack sudo[91613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:21:41 devstack sudo[91613]: pam_unix(sudo:session): session closed for user root Sep 16 20:21:41 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f398f8f9-e628-4758-b258-ae0f541ad4e0 tempest-SnapshotsActionsTest-483685712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82a53f25-7404-46c3-a063-5eda0dc0a9a2" returned: 0 in 0.270s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:21:41 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-f398f8f9-e628-4758-b258-ae0f541ad4e0 tempest-SnapshotsActionsTest-483685712 None] Lock "cinder-quobyte-82a53f25-7404-46c3-a063-5eda0dc0a9a2" released by "delete_volume" :: held 0.835s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:21:41 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-f398f8f9-e628-4758-b258-ae0f541ad4e0 tempest-SnapshotsActionsTest-483685712 None] Created reservations ['8918cd7c-5bcc-4553-b734-d8499a7c153f', '5ba6d2e8-a8c7-4a89-9846-953afcc241ad', '8b9a7d49-6d3b-44ec-be6a-a382651ebb7e', '9c8c44bd-9d42-451c-aa45-9c141b46779d'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:21:41 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-f398f8f9-e628-4758-b258-ae0f541ad4e0 tempest-SnapshotsActionsTest-483685712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:21:41 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-f398f8f9-e628-4758-b258-ae0f541ad4e0 tempest-SnapshotsActionsTest-483685712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:21:41 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-f398f8f9-e628-4758-b258-ae0f541ad4e0 tempest-SnapshotsActionsTest-483685712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:21:41 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-f398f8f9-e628-4758-b258-ae0f541ad4e0 tempest-SnapshotsActionsTest-483685712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:21:41 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-f398f8f9-e628-4758-b258-ae0f541ad4e0 tempest-SnapshotsActionsTest-483685712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:21:41 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f398f8f9-e628-4758-b258-ae0f541ad4e0 tempest-SnapshotsActionsTest-483685712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:21:41 devstack sudo[91616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:21:41 devstack sudo[91616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:21:42 devstack sudo[91616]: pam_unix(sudo:session): session closed for user root Sep 16 20:21:42 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f398f8f9-e628-4758-b258-ae0f541ad4e0 tempest-SnapshotsActionsTest-483685712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.396s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:21:42 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-f398f8f9-e628-4758-b258-ae0f541ad4e0 tempest-SnapshotsActionsTest-483685712 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:21:42 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-f398f8f9-e628-4758-b258-ae0f541ad4e0 tempest-SnapshotsActionsTest-483685712 None] Deleted volume successfully. Sep 16 20:21:42 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-f398f8f9-e628-4758-b258-ae0f541ad4e0 tempest-SnapshotsActionsTest-483685712 None] Lock "cinder-82a53f25-7404-46c3-a063-5eda0dc0a9a2-delete_volume" released by "delete_volume" :: held 1.503s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:21:45 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-19577fc8-2136-4e7d-a38f-068334c6f454 tempest-ServerActionsTestOtherA-1167936048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:21:45 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-19577fc8-2136-4e7d-a38f-068334c6f454 tempest-ServerActionsTestOtherA-1167936048 None] Flow 'volume_create_manager' (256ce288-bd1c-4c7b-ae9b-4f90673d9f9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:21:45 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-19577fc8-2136-4e7d-a38f-068334c6f454 tempest-ServerActionsTestOtherA-1167936048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81f2d86a-9656-404e-9570-b91b3a5c4dba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:21:45 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-19577fc8-2136-4e7d-a38f-068334c6f454 tempest-ServerActionsTestOtherA-1167936048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81f2d86a-9656-404e-9570-b91b3a5c4dba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:21:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-29529351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3570f169-4b45-4f1a-9476-11e57e5b87d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ac72cf9371045bbaa95ae2b7fe651ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:21:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:21:46Z,use_quota=True,user_id='4b61169517484204b4db2b68cf8000c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:21:45 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-19577fc8-2136-4e7d-a38f-068334c6f454 tempest-ServerActionsTestOtherA-1167936048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bedf323c-163b-4656-bf75-26cbeeb113e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:21:45 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-19577fc8-2136-4e7d-a38f-068334c6f454 tempest-ServerActionsTestOtherA-1167936048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bedf323c-163b-4656-bf75-26cbeeb113e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:21:45 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-19577fc8-2136-4e7d-a38f-068334c6f454 tempest-ServerActionsTestOtherA-1167936048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dcb1130-d5e4-4230-99e1-cbc90cb89e4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:21:45 devstack cinder-volume[86188]: DEBUG cinder.image.glance [None req-19577fc8-2136-4e7d-a38f-068334c6f454 tempest-ServerActionsTestOtherA-1167936048 None] Creating Keystone auth plugin from conf {{(pid=86188) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 16 20:21:46 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-19577fc8-2136-4e7d-a38f-068334c6f454 tempest-ServerActionsTestOtherA-1167936048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dcb1130-d5e4-4230-99e1-cbc90cb89e4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3570f169-4b45-4f1a-9476-11e57e5b87d4', 'volume_name': 'volume-3570f169-4b45-4f1a-9476-11e57e5b87d4', 'volume_size': 1, 'image_id': 'b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5c9c8eab814247029b6d508a74a1d19e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e', 'created_at': datetime.datetime(2026, 9, 16, 18, 12, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 18, 12, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:21:46 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-19577fc8-2136-4e7d-a38f-068334c6f454 tempest-ServerActionsTestOtherA-1167936048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a21a816-b538-4fd7-86d5-3d2f9f16640e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:21:46 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-19577fc8-2136-4e7d-a38f-068334c6f454 tempest-ServerActionsTestOtherA-1167936048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a21a816-b538-4fd7-86d5-3d2f9f16640e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:21:46 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-19577fc8-2136-4e7d-a38f-068334c6f454 tempest-ServerActionsTestOtherA-1167936048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10dc2b16-bbac-407b-8348-0cd531be7437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:21:46 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-19577fc8-2136-4e7d-a38f-068334c6f454 tempest-ServerActionsTestOtherA-1167936048 None] Volume 3570f169-4b45-4f1a-9476-11e57e5b87d4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3570f169-4b45-4f1a-9476-11e57e5b87d4', 'volume_size': 1, 'image_id': 'b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5c9c8eab814247029b6d508a74a1d19e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e', 'created_at': datetime.datetime(2026, 9, 16, 18, 12, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 18, 12, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 16 20:21:46 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-19577fc8-2136-4e7d-a38f-068334c6f454 tempest-ServerActionsTestOtherA-1167936048 None] Trying to clone 3570f169-4b45-4f1a-9476-11e57e5b87d4 from image b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e at location (None, [{'url': 'file:///opt/stack/data/glance/images/b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e', 'metadata': {}}]). {{(pid=86188) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 16 20:21:47 devstack cinder-volume[86188]: DEBUG cinder.image.image_utils [None req-19577fc8-2136-4e7d-a38f-068334c6f454 tempest-ServerActionsTestOtherA-1167936048 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e__ovzu4hudevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86188) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 16 20:21:47 devstack cinder-volume[86188]: INFO cinder.image.image_utils [None req-19577fc8-2136-4e7d-a38f-068334c6f454 tempest-ServerActionsTestOtherA-1167936048 None] Image download 20.69 MB at 20.69 MB/s Sep 16 20:21:47 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[db82cd8a-ca7c-44d7-86ee-43867bec5e07]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:21:47 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-19577fc8-2136-4e7d-a38f-068334c6f454 tempest-ServerActionsTestOtherA-1167936048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e__ovzu4hudevstack@QuobyteHD {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:21:47 devstack sudo[91662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e__ovzu4hudevstack@QuobyteHD Sep 16 20:21:47 devstack sudo[91662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:21:47 devstack sudo[91662]: pam_unix(sudo:session): session closed for user root Sep 16 20:21:47 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-19577fc8-2136-4e7d-a38f-068334c6f454 tempest-ServerActionsTestOtherA-1167936048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e__ovzu4hudevstack@QuobyteHD" returned: 0 in 0.582s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:21:47 devstack cinder-volume[86188]: DEBUG cinder.image.image_utils [None req-19577fc8-2136-4e7d-a38f-068334c6f454 tempest-ServerActionsTestOtherA-1167936048 None] Temporary image b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e is fetched for user 4b61169517484204b4db2b68cf8000c6. {{(pid=86188) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 16 20:21:48 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0aca3ee-a3ae-4738-ab96-e27d330af45e]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:21:48 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-19577fc8-2136-4e7d-a38f-068334c6f454 tempest-ServerActionsTestOtherA-1167936048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e__ovzu4hudevstack@QuobyteHD {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:21:48 devstack sudo[91676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e__ovzu4hudevstack@QuobyteHD Sep 16 20:21:48 devstack sudo[91676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:21:48 devstack sudo[91676]: pam_unix(sudo:session): session closed for user root Sep 16 20:21:48 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-19577fc8-2136-4e7d-a38f-068334c6f454 tempest-ServerActionsTestOtherA-1167936048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e__ovzu4hudevstack@QuobyteHD" returned: 0 in 0.502s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:21:48 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-19577fc8-2136-4e7d-a38f-068334c6f454 tempest-ServerActionsTestOtherA-1167936048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:21:48 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-19577fc8-2136-4e7d-a38f-068334c6f454 tempest-ServerActionsTestOtherA-1167936048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:21:48 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-19577fc8-2136-4e7d-a38f-068334c6f454 tempest-ServerActionsTestOtherA-1167936048 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:21:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-29529351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3570f169-4b45-4f1a-9476-11e57e5b87d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ac72cf9371045bbaa95ae2b7fe651ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:21:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:21:46Z,use_quota=True,user_id='4b61169517484204b4db2b68cf8000c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:21:48 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-19577fc8-2136-4e7d-a38f-068334c6f454 tempest-ServerActionsTestOtherA-1167936048 None] Creating volume 3570f169-4b45-4f1a-9476-11e57e5b87d4 {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:21:48 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-19577fc8-2136-4e7d-a38f-068334c6f454 tempest-ServerActionsTestOtherA-1167936048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:21:48 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-19577fc8-2136-4e7d-a38f-068334c6f454 tempest-ServerActionsTestOtherA-1167936048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:21:48 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-19577fc8-2136-4e7d-a38f-068334c6f454 tempest-ServerActionsTestOtherA-1167936048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:21:48 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-19577fc8-2136-4e7d-a38f-068334c6f454 tempest-ServerActionsTestOtherA-1167936048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:21:48 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-19577fc8-2136-4e7d-a38f-068334c6f454 tempest-ServerActionsTestOtherA-1167936048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:21:48 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-19577fc8-2136-4e7d-a38f-068334c6f454 tempest-ServerActionsTestOtherA-1167936048 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:21:48 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-19577fc8-2136-4e7d-a38f-068334c6f454 tempest-ServerActionsTestOtherA-1167936048 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:21:48 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-19577fc8-2136-4e7d-a38f-068334c6f454 tempest-ServerActionsTestOtherA-1167936048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-3570f169-4b45-4f1a-9476-11e57e5b87d4 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:21:48 devstack sudo[91685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-3570f169-4b45-4f1a-9476-11e57e5b87d4 1073741824 Sep 16 20:21:48 devstack sudo[91685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:21:49 devstack sudo[91685]: pam_unix(sudo:session): session closed for user root Sep 16 20:21:49 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-19577fc8-2136-4e7d-a38f-068334c6f454 tempest-ServerActionsTestOtherA-1167936048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-3570f169-4b45-4f1a-9476-11e57e5b87d4 1073741824" returned: 0 in 0.714s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:21:49 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-19577fc8-2136-4e7d-a38f-068334c6f454 tempest-ServerActionsTestOtherA-1167936048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-3570f169-4b45-4f1a-9476-11e57e5b87d4 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:21:49 devstack sudo[91693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-3570f169-4b45-4f1a-9476-11e57e5b87d4 Sep 16 20:21:49 devstack sudo[91693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:21:49 devstack sudo[91693]: pam_unix(sudo:session): session closed for user root Sep 16 20:21:49 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-19577fc8-2136-4e7d-a38f-068334c6f454 tempest-ServerActionsTestOtherA-1167936048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-3570f169-4b45-4f1a-9476-11e57e5b87d4" returned: 0 in 0.340s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:21:49 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-19577fc8-2136-4e7d-a38f-068334c6f454 tempest-ServerActionsTestOtherA-1167936048 None] <== create_volume: return (1114ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:21:49 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-19577fc8-2136-4e7d-a38f-068334c6f454 tempest-ServerActionsTestOtherA-1167936048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.129s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:21:49 devstack cinder-volume[86188]: DEBUG cinder.volume.volume_utils [None req-19577fc8-2136-4e7d-a38f-068334c6f454 tempest-ServerActionsTestOtherA-1167936048 None] Attempting download of b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e ((None, [{'url': 'file:///opt/stack/data/glance/images/b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e', 'metadata': {}}])) to volume 3570f169-4b45-4f1a-9476-11e57e5b87d4. {{(pid=86188) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 16 20:21:49 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcbb8f1c-00e1-4a36-9e6f-a693854eb0b0]: (4, 'raw') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:21:49 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-19577fc8-2136-4e7d-a38f-068334c6f454 tempest-ServerActionsTestOtherA-1167936048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e_psm8wok4 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:21:50 devstack sudo[91696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e_psm8wok4 Sep 16 20:21:50 devstack sudo[91696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:21:50 devstack sudo[91696]: pam_unix(sudo:session): session closed for user root Sep 16 20:21:50 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-19577fc8-2136-4e7d-a38f-068334c6f454 tempest-ServerActionsTestOtherA-1167936048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e_psm8wok4" returned: 0 in 0.563s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:21:50 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-19577fc8-2136-4e7d-a38f-068334c6f454 tempest-ServerActionsTestOtherA-1167936048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e_psm8wok4 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:21:50 devstack sudo[91706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e_psm8wok4 Sep 16 20:21:50 devstack sudo[91706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:21:50 devstack sudo[91706]: pam_unix(sudo:session): session closed for user root Sep 16 20:21:50 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-19577fc8-2136-4e7d-a38f-068334c6f454 tempest-ServerActionsTestOtherA-1167936048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e_psm8wok4" returned: 1 in 0.384s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:21:50 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-19577fc8-2136-4e7d-a38f-068334c6f454 tempest-ServerActionsTestOtherA-1167936048 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e_psm8wok4' failed. Not Retrying. {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 16 20:21:50 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a9cd584-fb9a-4267-97d5-0613e9a33027]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:21:50 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-19577fc8-2136-4e7d-a38f-068334c6f454 tempest-ServerActionsTestOtherA-1167936048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e__ovzu4hudevstack@QuobyteHD {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:21:51 devstack sudo[91752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e__ovzu4hudevstack@QuobyteHD Sep 16 20:21:51 devstack sudo[91752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:21:51 devstack sudo[91752]: pam_unix(sudo:session): session closed for user root Sep 16 20:21:51 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-19577fc8-2136-4e7d-a38f-068334c6f454 tempest-ServerActionsTestOtherA-1167936048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e__ovzu4hudevstack@QuobyteHD" returned: 0 in 0.607s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:21:51 devstack cinder-volume[86188]: DEBUG cinder.image.image_utils [None req-19577fc8-2136-4e7d-a38f-068334c6f454 tempest-ServerActionsTestOtherA-1167936048 None] b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e was qcow2, converting to qcow2 {{(pid=86188) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 16 20:21:51 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-19577fc8-2136-4e7d-a38f-068334c6f454 tempest-ServerActionsTestOtherA-1167936048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e__ovzu4hudevstack@QuobyteHD /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-3570f169-4b45-4f1a-9476-11e57e5b87d4 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:21:51 devstack sudo[91761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e__ovzu4hudevstack@QuobyteHD /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-3570f169-4b45-4f1a-9476-11e57e5b87d4 Sep 16 20:21:51 devstack sudo[91761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:21:52 devstack cinder-volume[86188]: DEBUG oslo_service.periodic_task [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86188) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 20:21:52 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:21:52 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:21:52 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:21:53 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:21:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:21:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:21:53 devstack sudo[91772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:21:53 devstack sudo[91772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:21:53 devstack sudo[91772]: pam_unix(sudo:session): session closed for user root Sep 16 20:21:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.472s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:21:53 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:21:53 devstack cinder-volume[86188]: DEBUG oslo_service.periodic_task [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Running periodic task VolumeManager._thread_info {{(pid=86188) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 20:21:53 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] thread count: 28 {{(pid=86188) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 16 20:21:53 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] thread info: [<_MainThread(MainThread, started 139858124406912)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86188) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 16 20:21:53 devstack cinder-volume[86188]: INFO cinder.volume.manager [req-0ebd7660-5dc9-4c60-9ba4-22521b68a48e req-5e0cc735-8c94-4f20-9e66-351423ce7d4d tempest-AttachVolumeNegativeTest-1537838471 None] Terminate volume connection completed successfully. Sep 16 20:21:53 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [req-0ebd7660-5dc9-4c60-9ba4-22521b68a48e req-5e0cc735-8c94-4f20-9e66-351423ce7d4d tempest-AttachVolumeNegativeTest-1537838471 None] Deleting attachment 12c2b053-791b-482f-b5ee-b5735a2d3938. {{(pid=86188) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 16 20:21:54 devstack sudo[91761]: pam_unix(sudo:session): session closed for user root Sep 16 20:21:54 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-19577fc8-2136-4e7d-a38f-068334c6f454 tempest-ServerActionsTestOtherA-1167936048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e__ovzu4hudevstack@QuobyteHD /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-3570f169-4b45-4f1a-9476-11e57e5b87d4" returned: 0 in 2.951s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:21:54 devstack cinder-volume[86188]: DEBUG cinder.image.image_utils [None req-19577fc8-2136-4e7d-a38f-068334c6f454 tempest-ServerActionsTestOtherA-1167936048 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e__ovzu4hudevstack@QuobyteHD, size 112.00 MB, duration 2.95 sec, destination /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-3570f169-4b45-4f1a-9476-11e57e5b87d4 {{(pid=86188) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 16 20:21:54 devstack cinder-volume[86188]: INFO cinder.image.image_utils [None req-19577fc8-2136-4e7d-a38f-068334c6f454 tempest-ServerActionsTestOtherA-1167936048 None] Converted 112.00 MB image at 37.92 MB/s Sep 16 20:21:54 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-19577fc8-2136-4e7d-a38f-068334c6f454 tempest-ServerActionsTestOtherA-1167936048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-3570f169-4b45-4f1a-9476-11e57e5b87d4 1G {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:21:54 devstack sudo[91832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-3570f169-4b45-4f1a-9476-11e57e5b87d4 1G Sep 16 20:21:54 devstack sudo[91832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:21:55 devstack sudo[91832]: pam_unix(sudo:session): session closed for user root Sep 16 20:21:55 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-19577fc8-2136-4e7d-a38f-068334c6f454 tempest-ServerActionsTestOtherA-1167936048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-3570f169-4b45-4f1a-9476-11e57e5b87d4 1G" returned: 0 in 1.005s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:21:55 devstack cinder-volume[86188]: DEBUG cinder.volume.volume_utils [None req-19577fc8-2136-4e7d-a38f-068334c6f454 tempest-ServerActionsTestOtherA-1167936048 None] Downloaded image b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e ((None, [{'url': 'file:///opt/stack/data/glance/images/b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e', 'metadata': {}}])) to volume 3570f169-4b45-4f1a-9476-11e57e5b87d4 successfully. {{(pid=86188) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 16 20:21:55 devstack cinder-volume[86188]: DEBUG cinder.image.image_utils [None req-19577fc8-2136-4e7d-a38f-068334c6f454 tempest-ServerActionsTestOtherA-1167936048 None] Temporary image b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e for user 4b61169517484204b4db2b68cf8000c6 is deleted. {{(pid=86188) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 16 20:21:55 devstack cinder-volume[86188]: DEBUG cinder.volume.volume_utils [None req-19577fc8-2136-4e7d-a38f-068334c6f454 tempest-ServerActionsTestOtherA-1167936048 None] Marking volume 3570f169-4b45-4f1a-9476-11e57e5b87d4 as bootable. {{(pid=86188) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 16 20:21:55 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-19577fc8-2136-4e7d-a38f-068334c6f454 tempest-ServerActionsTestOtherA-1167936048 None] Copying metadata from image b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e to 3570f169-4b45-4f1a-9476-11e57e5b87d4. {{(pid=86188) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 16 20:21:55 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-19577fc8-2136-4e7d-a38f-068334c6f454 tempest-ServerActionsTestOtherA-1167936048 None] Creating volume glance metadata for volume 3570f169-4b45-4f1a-9476-11e57e5b87d4 backed by image b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86188) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 16 20:21:55 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-19577fc8-2136-4e7d-a38f-068334c6f454 tempest-ServerActionsTestOtherA-1167936048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10dc2b16-bbac-407b-8348-0cd531be7437) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3570f169-4b45-4f1a-9476-11e57e5b87d4', 'volume_size': 1, 'image_id': 'b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5c9c8eab814247029b6d508a74a1d19e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e', 'created_at': datetime.datetime(2026, 9, 16, 18, 12, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 18, 12, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:21:55 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-19577fc8-2136-4e7d-a38f-068334c6f454 tempest-ServerActionsTestOtherA-1167936048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e65637aa-4bde-4263-841a-9c0fb17505fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:21:55 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-19577fc8-2136-4e7d-a38f-068334c6f454 tempest-ServerActionsTestOtherA-1167936048 None] Volume volume-3570f169-4b45-4f1a-9476-11e57e5b87d4 (3570f169-4b45-4f1a-9476-11e57e5b87d4): created successfully Sep 16 20:21:55 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-19577fc8-2136-4e7d-a38f-068334c6f454 tempest-ServerActionsTestOtherA-1167936048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e65637aa-4bde-4263-841a-9c0fb17505fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:21:55 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-19577fc8-2136-4e7d-a38f-068334c6f454 tempest-ServerActionsTestOtherA-1167936048 None] Flow 'volume_create_manager' (256ce288-bd1c-4c7b-ae9b-4f90673d9f9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:21:55 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-19577fc8-2136-4e7d-a38f-068334c6f454 tempest-ServerActionsTestOtherA-1167936048 None] Created volume successfully. Sep 16 20:22:01 devstack cinder-volume[86188]: DEBUG dbcounter [-] [86188] Writing DB stats cinder:SELECT=90,cinder:UPDATE=82,cinder:INSERT=27,cinder:DELETE=5 {{(pid=86188) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 20:22:01 devstack cinder-volume[86188]: DEBUG dbcounter [-] [86188] Writing DB stats cinder:SELECT=97,cinder:UPDATE=75,cinder:DELETE=8,cinder:INSERT=24 {{(pid=86188) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 20:22:01 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [req-cda50cee-1da0-4594-8f1b-dde7f4b326fa req-169fd31b-edc3-48b3-868f-67b5476edc53 tempest-ServerActionsTestOtherA-1167936048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:22:01 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [req-cda50cee-1da0-4594-8f1b-dde7f4b326fa req-169fd31b-edc3-48b3-868f-67b5476edc53 tempest-ServerActionsTestOtherA-1167936048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:22:01 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [req-cda50cee-1da0-4594-8f1b-dde7f4b326fa req-169fd31b-edc3-48b3-868f-67b5476edc53 tempest-ServerActionsTestOtherA-1167936048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.040s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:22:01 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [req-cda50cee-1da0-4594-8f1b-dde7f4b326fa req-169fd31b-edc3-48b3-868f-67b5476edc53 tempest-ServerActionsTestOtherA-1167936048 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81', 'name': 'volume-3570f169-4b45-4f1a-9476-11e57e5b87d4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd0385b18-91a4-4ecc-aeef-4a9655803745', 'enforce_multipath': True} {{(pid=86188) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 16 20:22:01 devstack cinder-volume[86188]: INFO cinder.volume.manager [req-cda50cee-1da0-4594-8f1b-dde7f4b326fa req-169fd31b-edc3-48b3-868f-67b5476edc53 tempest-ServerActionsTestOtherA-1167936048 None] attachment_update completed successfully. Sep 16 20:22:05 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-80b8e326-3203-4fa3-a24d-1af83cf8deb0 tempest-VolumeQuotasAdminTestJSON-1690681741 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:22:05 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-80b8e326-3203-4fa3-a24d-1af83cf8deb0 tempest-VolumeQuotasAdminTestJSON-1690681741 None] Flow 'volume_create_manager' (164ed6e9-d8fe-4395-bf6b-30f3e5176a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:22:05 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-80b8e326-3203-4fa3-a24d-1af83cf8deb0 tempest-VolumeQuotasAdminTestJSON-1690681741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d63eb48b-3ed8-4742-9b57-69ca23099a8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:22:05 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-80b8e326-3203-4fa3-a24d-1af83cf8deb0 tempest-VolumeQuotasAdminTestJSON-1690681741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d63eb48b-3ed8-4742-9b57-69ca23099a8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:22:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1875500665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b2bf864-a6d9-43b7-b81e-4e99fb08b145,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0695adcb4eef4eb19d6988450140deca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:22:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:22:06Z,use_quota=True,user_id='d3fbe3c9e13e41d1ae04f9230d9e3432',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:22:05 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-80b8e326-3203-4fa3-a24d-1af83cf8deb0 tempest-VolumeQuotasAdminTestJSON-1690681741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5eed0c66-0387-42c0-9557-b6410bc0b78f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:22:05 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-80b8e326-3203-4fa3-a24d-1af83cf8deb0 tempest-VolumeQuotasAdminTestJSON-1690681741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5eed0c66-0387-42c0-9557-b6410bc0b78f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:22:05 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-80b8e326-3203-4fa3-a24d-1af83cf8deb0 tempest-VolumeQuotasAdminTestJSON-1690681741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94b97b81-f331-4268-b55b-a4289cbfb55a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:22:05 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-80b8e326-3203-4fa3-a24d-1af83cf8deb0 tempest-VolumeQuotasAdminTestJSON-1690681741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94b97b81-f331-4268-b55b-a4289cbfb55a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b2bf864-a6d9-43b7-b81e-4e99fb08b145', 'volume_name': 'volume-8b2bf864-a6d9-43b7-b81e-4e99fb08b145', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:22:05 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-80b8e326-3203-4fa3-a24d-1af83cf8deb0 tempest-VolumeQuotasAdminTestJSON-1690681741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8f114ee-3794-4470-b781-7a2a87699517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:22:05 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-80b8e326-3203-4fa3-a24d-1af83cf8deb0 tempest-VolumeQuotasAdminTestJSON-1690681741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8f114ee-3794-4470-b781-7a2a87699517) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:22:05 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-80b8e326-3203-4fa3-a24d-1af83cf8deb0 tempest-VolumeQuotasAdminTestJSON-1690681741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2adafbe1-ebed-4b65-8717-1a1418e403a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:22:05 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-80b8e326-3203-4fa3-a24d-1af83cf8deb0 tempest-VolumeQuotasAdminTestJSON-1690681741 None] Volume 8b2bf864-a6d9-43b7-b81e-4e99fb08b145: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b2bf864-a6d9-43b7-b81e-4e99fb08b145', 'volume_size': 1} Sep 16 20:22:05 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-80b8e326-3203-4fa3-a24d-1af83cf8deb0 tempest-VolumeQuotasAdminTestJSON-1690681741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:22:05 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-80b8e326-3203-4fa3-a24d-1af83cf8deb0 tempest-VolumeQuotasAdminTestJSON-1690681741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:22:05 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-80b8e326-3203-4fa3-a24d-1af83cf8deb0 tempest-VolumeQuotasAdminTestJSON-1690681741 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:22:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1875500665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b2bf864-a6d9-43b7-b81e-4e99fb08b145,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0695adcb4eef4eb19d6988450140deca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:22:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:22:06Z,use_quota=True,user_id='d3fbe3c9e13e41d1ae04f9230d9e3432',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:22:05 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-80b8e326-3203-4fa3-a24d-1af83cf8deb0 tempest-VolumeQuotasAdminTestJSON-1690681741 None] Creating volume 8b2bf864-a6d9-43b7-b81e-4e99fb08b145 {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:22:05 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-80b8e326-3203-4fa3-a24d-1af83cf8deb0 tempest-VolumeQuotasAdminTestJSON-1690681741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:22:05 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-80b8e326-3203-4fa3-a24d-1af83cf8deb0 tempest-VolumeQuotasAdminTestJSON-1690681741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:22:05 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-80b8e326-3203-4fa3-a24d-1af83cf8deb0 tempest-VolumeQuotasAdminTestJSON-1690681741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:22:05 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-80b8e326-3203-4fa3-a24d-1af83cf8deb0 tempest-VolumeQuotasAdminTestJSON-1690681741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:22:05 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-80b8e326-3203-4fa3-a24d-1af83cf8deb0 tempest-VolumeQuotasAdminTestJSON-1690681741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:22:05 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-80b8e326-3203-4fa3-a24d-1af83cf8deb0 tempest-VolumeQuotasAdminTestJSON-1690681741 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:22:05 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-80b8e326-3203-4fa3-a24d-1af83cf8deb0 tempest-VolumeQuotasAdminTestJSON-1690681741 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:22:05 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-80b8e326-3203-4fa3-a24d-1af83cf8deb0 tempest-VolumeQuotasAdminTestJSON-1690681741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-8b2bf864-a6d9-43b7-b81e-4e99fb08b145 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:22:05 devstack sudo[91914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-8b2bf864-a6d9-43b7-b81e-4e99fb08b145 1073741824 Sep 16 20:22:05 devstack sudo[91914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:22:06 devstack sudo[91914]: pam_unix(sudo:session): session closed for user root Sep 16 20:22:06 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-80b8e326-3203-4fa3-a24d-1af83cf8deb0 tempest-VolumeQuotasAdminTestJSON-1690681741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-8b2bf864-a6d9-43b7-b81e-4e99fb08b145 1073741824" returned: 0 in 0.856s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:22:06 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-80b8e326-3203-4fa3-a24d-1af83cf8deb0 tempest-VolumeQuotasAdminTestJSON-1690681741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-8b2bf864-a6d9-43b7-b81e-4e99fb08b145 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:22:06 devstack sudo[92029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-8b2bf864-a6d9-43b7-b81e-4e99fb08b145 Sep 16 20:22:06 devstack sudo[92029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:22:07 devstack sudo[92029]: pam_unix(sudo:session): session closed for user root Sep 16 20:22:07 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-80b8e326-3203-4fa3-a24d-1af83cf8deb0 tempest-VolumeQuotasAdminTestJSON-1690681741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-8b2bf864-a6d9-43b7-b81e-4e99fb08b145" returned: 0 in 0.489s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:22:07 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-80b8e326-3203-4fa3-a24d-1af83cf8deb0 tempest-VolumeQuotasAdminTestJSON-1690681741 None] <== create_volume: return (1470ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:22:07 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-80b8e326-3203-4fa3-a24d-1af83cf8deb0 tempest-VolumeQuotasAdminTestJSON-1690681741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.476s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:22:07 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-80b8e326-3203-4fa3-a24d-1af83cf8deb0 tempest-VolumeQuotasAdminTestJSON-1690681741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2adafbe1-ebed-4b65-8717-1a1418e403a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b2bf864-a6d9-43b7-b81e-4e99fb08b145', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:22:07 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-80b8e326-3203-4fa3-a24d-1af83cf8deb0 tempest-VolumeQuotasAdminTestJSON-1690681741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f4b413d-8c8c-4115-a480-b192262bb1c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:22:07 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-80b8e326-3203-4fa3-a24d-1af83cf8deb0 tempest-VolumeQuotasAdminTestJSON-1690681741 None] Volume volume-8b2bf864-a6d9-43b7-b81e-4e99fb08b145 (8b2bf864-a6d9-43b7-b81e-4e99fb08b145): created successfully Sep 16 20:22:07 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-80b8e326-3203-4fa3-a24d-1af83cf8deb0 tempest-VolumeQuotasAdminTestJSON-1690681741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f4b413d-8c8c-4115-a480-b192262bb1c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:22:07 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-80b8e326-3203-4fa3-a24d-1af83cf8deb0 tempest-VolumeQuotasAdminTestJSON-1690681741 None] Flow 'volume_create_manager' (164ed6e9-d8fe-4395-bf6b-30f3e5176a59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:22:07 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-80b8e326-3203-4fa3-a24d-1af83cf8deb0 tempest-VolumeQuotasAdminTestJSON-1690681741 None] Created volume successfully. Sep 16 20:22:07 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-8b13798f-1b90-46dd-a2f2-2922d69117f1 tempest-VolumeQuotasAdminTestJSON-1690681741 None] Acquiring lock "cinder-8b2bf864-a6d9-43b7-b81e-4e99fb08b145-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:22:07 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-8b13798f-1b90-46dd-a2f2-2922d69117f1 tempest-VolumeQuotasAdminTestJSON-1690681741 None] Lock "cinder-8b2bf864-a6d9-43b7-b81e-4e99fb08b145-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:22:07 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-8b13798f-1b90-46dd-a2f2-2922d69117f1 tempest-VolumeQuotasAdminTestJSON-1690681741 None] Acquiring lock "cinder-quobyte-8b2bf864-a6d9-43b7-b81e-4e99fb08b145" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:22:08 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-8b13798f-1b90-46dd-a2f2-2922d69117f1 tempest-VolumeQuotasAdminTestJSON-1690681741 None] Lock "cinder-quobyte-8b2bf864-a6d9-43b7-b81e-4e99fb08b145" acquired by "delete_volume" :: waited 0.039s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:22:08 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[24d52971-e559-4d6c-a38a-b5d80eb4e693]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:22:08 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-8b13798f-1b90-46dd-a2f2-2922d69117f1 tempest-VolumeQuotasAdminTestJSON-1690681741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-8b2bf864-a6d9-43b7-b81e-4e99fb08b145 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:22:08 devstack sudo[92406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-8b2bf864-a6d9-43b7-b81e-4e99fb08b145 Sep 16 20:22:08 devstack sudo[92406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:22:08 devstack sudo[92406]: pam_unix(sudo:session): session closed for user root Sep 16 20:22:08 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-8b13798f-1b90-46dd-a2f2-2922d69117f1 tempest-VolumeQuotasAdminTestJSON-1690681741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-8b2bf864-a6d9-43b7-b81e-4e99fb08b145" returned: 0 in 0.551s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:22:08 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-8b13798f-1b90-46dd-a2f2-2922d69117f1 tempest-VolumeQuotasAdminTestJSON-1690681741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-8b2bf864-a6d9-43b7-b81e-4e99fb08b145 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:22:08 devstack sudo[92413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-8b2bf864-a6d9-43b7-b81e-4e99fb08b145 Sep 16 20:22:08 devstack sudo[92413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:22:08 devstack sudo[92413]: pam_unix(sudo:session): session closed for user root Sep 16 20:22:08 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-8b13798f-1b90-46dd-a2f2-2922d69117f1 tempest-VolumeQuotasAdminTestJSON-1690681741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-8b2bf864-a6d9-43b7-b81e-4e99fb08b145" returned: 0 in 0.303s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:22:08 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-8b13798f-1b90-46dd-a2f2-2922d69117f1 tempest-VolumeQuotasAdminTestJSON-1690681741 None] Lock "cinder-quobyte-8b2bf864-a6d9-43b7-b81e-4e99fb08b145" released by "delete_volume" :: held 0.944s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:22:09 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-8b13798f-1b90-46dd-a2f2-2922d69117f1 tempest-VolumeQuotasAdminTestJSON-1690681741 None] Created reservations ['56ec7783-7aa5-490f-83d7-868eed551f82', '9783d6f1-9ccc-4507-a767-5dde5c93d28a', '91f7a218-89b9-4e58-a182-d0a782cf0fa6', '4fbf5095-c4a1-416c-ab68-fcdea70526ff'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:22:09 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-8b13798f-1b90-46dd-a2f2-2922d69117f1 tempest-VolumeQuotasAdminTestJSON-1690681741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:22:09 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-8b13798f-1b90-46dd-a2f2-2922d69117f1 tempest-VolumeQuotasAdminTestJSON-1690681741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:22:09 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-8b13798f-1b90-46dd-a2f2-2922d69117f1 tempest-VolumeQuotasAdminTestJSON-1690681741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:22:09 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-8b13798f-1b90-46dd-a2f2-2922d69117f1 tempest-VolumeQuotasAdminTestJSON-1690681741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:22:09 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-8b13798f-1b90-46dd-a2f2-2922d69117f1 tempest-VolumeQuotasAdminTestJSON-1690681741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:22:09 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-8b13798f-1b90-46dd-a2f2-2922d69117f1 tempest-VolumeQuotasAdminTestJSON-1690681741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:22:09 devstack sudo[92418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:22:09 devstack sudo[92418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:22:09 devstack sudo[92418]: pam_unix(sudo:session): session closed for user root Sep 16 20:22:09 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-8b13798f-1b90-46dd-a2f2-2922d69117f1 tempest-VolumeQuotasAdminTestJSON-1690681741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.513s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:22:09 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-8b13798f-1b90-46dd-a2f2-2922d69117f1 tempest-VolumeQuotasAdminTestJSON-1690681741 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:22:09 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-8b13798f-1b90-46dd-a2f2-2922d69117f1 tempest-VolumeQuotasAdminTestJSON-1690681741 None] Deleted volume successfully. Sep 16 20:22:09 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-8b13798f-1b90-46dd-a2f2-2922d69117f1 tempest-VolumeQuotasAdminTestJSON-1690681741 None] Lock "cinder-8b2bf864-a6d9-43b7-b81e-4e99fb08b145-delete_volume" released by "delete_volume" :: held 1.837s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:22:11 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-e88d5361-b789-4d2a-b052-d46256fc0406 tempest-VolumeQuotasAdminTestJSON-1690681741 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:22:11 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e88d5361-b789-4d2a-b052-d46256fc0406 tempest-VolumeQuotasAdminTestJSON-1690681741 None] Flow 'volume_create_manager' (2232da3f-b443-4084-a532-a89f6fe13742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:22:11 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e88d5361-b789-4d2a-b052-d46256fc0406 tempest-VolumeQuotasAdminTestJSON-1690681741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87a66c8b-49e2-425c-9a2a-1680ecc123de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:22:11 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e88d5361-b789-4d2a-b052-d46256fc0406 tempest-VolumeQuotasAdminTestJSON-1690681741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87a66c8b-49e2-425c-9a2a-1680ecc123de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:22:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-903695120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1b88101-5f27-449a-90dc-a6cd1cb73d39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0695adcb4eef4eb19d6988450140deca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:22:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:22:11Z,use_quota=True,user_id='d3fbe3c9e13e41d1ae04f9230d9e3432',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:22:11 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e88d5361-b789-4d2a-b052-d46256fc0406 tempest-VolumeQuotasAdminTestJSON-1690681741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ea31e12-b6dc-42f9-8566-d94c6a626ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:22:11 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e88d5361-b789-4d2a-b052-d46256fc0406 tempest-VolumeQuotasAdminTestJSON-1690681741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ea31e12-b6dc-42f9-8566-d94c6a626ff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:22:11 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e88d5361-b789-4d2a-b052-d46256fc0406 tempest-VolumeQuotasAdminTestJSON-1690681741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99664e27-9d64-4ffe-9706-27aaafc82e81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:22:11 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e88d5361-b789-4d2a-b052-d46256fc0406 tempest-VolumeQuotasAdminTestJSON-1690681741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99664e27-9d64-4ffe-9706-27aaafc82e81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1b88101-5f27-449a-90dc-a6cd1cb73d39', 'volume_name': 'volume-d1b88101-5f27-449a-90dc-a6cd1cb73d39', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:22:11 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e88d5361-b789-4d2a-b052-d46256fc0406 tempest-VolumeQuotasAdminTestJSON-1690681741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0504dd6-34a8-4256-a5de-fd6b56371d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:22:11 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e88d5361-b789-4d2a-b052-d46256fc0406 tempest-VolumeQuotasAdminTestJSON-1690681741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0504dd6-34a8-4256-a5de-fd6b56371d50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:22:11 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e88d5361-b789-4d2a-b052-d46256fc0406 tempest-VolumeQuotasAdminTestJSON-1690681741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe38f1c7-c066-40cb-9769-f41c9040157a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:22:11 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-e88d5361-b789-4d2a-b052-d46256fc0406 tempest-VolumeQuotasAdminTestJSON-1690681741 None] Volume d1b88101-5f27-449a-90dc-a6cd1cb73d39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1b88101-5f27-449a-90dc-a6cd1cb73d39', 'volume_size': 1} Sep 16 20:22:11 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-e88d5361-b789-4d2a-b052-d46256fc0406 tempest-VolumeQuotasAdminTestJSON-1690681741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:22:11 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-e88d5361-b789-4d2a-b052-d46256fc0406 tempest-VolumeQuotasAdminTestJSON-1690681741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:22:11 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-e88d5361-b789-4d2a-b052-d46256fc0406 tempest-VolumeQuotasAdminTestJSON-1690681741 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:22:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-903695120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1b88101-5f27-449a-90dc-a6cd1cb73d39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0695adcb4eef4eb19d6988450140deca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:22:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:22:11Z,use_quota=True,user_id='d3fbe3c9e13e41d1ae04f9230d9e3432',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:22:11 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-e88d5361-b789-4d2a-b052-d46256fc0406 tempest-VolumeQuotasAdminTestJSON-1690681741 None] Creating volume d1b88101-5f27-449a-90dc-a6cd1cb73d39 {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:22:11 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-e88d5361-b789-4d2a-b052-d46256fc0406 tempest-VolumeQuotasAdminTestJSON-1690681741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:22:11 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-e88d5361-b789-4d2a-b052-d46256fc0406 tempest-VolumeQuotasAdminTestJSON-1690681741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:22:11 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-e88d5361-b789-4d2a-b052-d46256fc0406 tempest-VolumeQuotasAdminTestJSON-1690681741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:22:11 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-e88d5361-b789-4d2a-b052-d46256fc0406 tempest-VolumeQuotasAdminTestJSON-1690681741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:22:11 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-e88d5361-b789-4d2a-b052-d46256fc0406 tempest-VolumeQuotasAdminTestJSON-1690681741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:22:11 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-e88d5361-b789-4d2a-b052-d46256fc0406 tempest-VolumeQuotasAdminTestJSON-1690681741 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:22:11 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-e88d5361-b789-4d2a-b052-d46256fc0406 tempest-VolumeQuotasAdminTestJSON-1690681741 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:22:11 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e88d5361-b789-4d2a-b052-d46256fc0406 tempest-VolumeQuotasAdminTestJSON-1690681741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d1b88101-5f27-449a-90dc-a6cd1cb73d39 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:22:11 devstack sudo[92438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d1b88101-5f27-449a-90dc-a6cd1cb73d39 1073741824 Sep 16 20:22:11 devstack sudo[92438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:22:11 devstack sudo[92438]: pam_unix(sudo:session): session closed for user root Sep 16 20:22:11 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e88d5361-b789-4d2a-b052-d46256fc0406 tempest-VolumeQuotasAdminTestJSON-1690681741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d1b88101-5f27-449a-90dc-a6cd1cb73d39 1073741824" returned: 0 in 0.496s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:22:11 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e88d5361-b789-4d2a-b052-d46256fc0406 tempest-VolumeQuotasAdminTestJSON-1690681741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d1b88101-5f27-449a-90dc-a6cd1cb73d39 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:22:11 devstack sudo[92443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d1b88101-5f27-449a-90dc-a6cd1cb73d39 Sep 16 20:22:11 devstack sudo[92443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:22:12 devstack sudo[92443]: pam_unix(sudo:session): session closed for user root Sep 16 20:22:12 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e88d5361-b789-4d2a-b052-d46256fc0406 tempest-VolumeQuotasAdminTestJSON-1690681741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d1b88101-5f27-449a-90dc-a6cd1cb73d39" returned: 0 in 0.359s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:22:12 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-e88d5361-b789-4d2a-b052-d46256fc0406 tempest-VolumeQuotasAdminTestJSON-1690681741 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:22:12 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-e88d5361-b789-4d2a-b052-d46256fc0406 tempest-VolumeQuotasAdminTestJSON-1690681741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:22:12 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e88d5361-b789-4d2a-b052-d46256fc0406 tempest-VolumeQuotasAdminTestJSON-1690681741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe38f1c7-c066-40cb-9769-f41c9040157a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1b88101-5f27-449a-90dc-a6cd1cb73d39', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:22:12 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e88d5361-b789-4d2a-b052-d46256fc0406 tempest-VolumeQuotasAdminTestJSON-1690681741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3bc29d9-cb6a-4629-9645-9551af41a564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:22:12 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-e88d5361-b789-4d2a-b052-d46256fc0406 tempest-VolumeQuotasAdminTestJSON-1690681741 None] Volume volume-d1b88101-5f27-449a-90dc-a6cd1cb73d39 (d1b88101-5f27-449a-90dc-a6cd1cb73d39): created successfully Sep 16 20:22:12 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e88d5361-b789-4d2a-b052-d46256fc0406 tempest-VolumeQuotasAdminTestJSON-1690681741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3bc29d9-cb6a-4629-9645-9551af41a564) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:22:12 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e88d5361-b789-4d2a-b052-d46256fc0406 tempest-VolumeQuotasAdminTestJSON-1690681741 None] Flow 'volume_create_manager' (2232da3f-b443-4084-a532-a89f6fe13742) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:22:12 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-e88d5361-b789-4d2a-b052-d46256fc0406 tempest-VolumeQuotasAdminTestJSON-1690681741 None] Created volume successfully. Sep 16 20:22:15 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-d99005d7-4ec9-4171-8aa6-b0f1a6c90df8 tempest-VolumeQuotasAdminTestJSON-1244420728 None] Transfer volume completed successfully. Sep 16 20:22:16 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-4c489697-a52a-43b4-bd4a-a6fbb7effedb tempest-VolumeQuotasAdminTestJSON-403462321 None] Acquiring lock "cinder-d1b88101-5f27-449a-90dc-a6cd1cb73d39-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:22:16 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-4c489697-a52a-43b4-bd4a-a6fbb7effedb tempest-VolumeQuotasAdminTestJSON-403462321 None] Lock "cinder-d1b88101-5f27-449a-90dc-a6cd1cb73d39-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:22:16 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-4c489697-a52a-43b4-bd4a-a6fbb7effedb tempest-VolumeQuotasAdminTestJSON-403462321 None] Acquiring lock "cinder-quobyte-d1b88101-5f27-449a-90dc-a6cd1cb73d39" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:22:16 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-4c489697-a52a-43b4-bd4a-a6fbb7effedb tempest-VolumeQuotasAdminTestJSON-403462321 None] Lock "cinder-quobyte-d1b88101-5f27-449a-90dc-a6cd1cb73d39" acquired by "delete_volume" :: waited 0.029s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:22:16 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[35a236a1-8bf8-44f5-8494-921889ffb163]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:22:16 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-4c489697-a52a-43b4-bd4a-a6fbb7effedb tempest-VolumeQuotasAdminTestJSON-403462321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d1b88101-5f27-449a-90dc-a6cd1cb73d39 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:22:17 devstack sudo[92521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d1b88101-5f27-449a-90dc-a6cd1cb73d39 Sep 16 20:22:17 devstack sudo[92521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:22:17 devstack sudo[92521]: pam_unix(sudo:session): session closed for user root Sep 16 20:22:17 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-4c489697-a52a-43b4-bd4a-a6fbb7effedb tempest-VolumeQuotasAdminTestJSON-403462321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d1b88101-5f27-449a-90dc-a6cd1cb73d39" returned: 0 in 0.671s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:22:17 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-4c489697-a52a-43b4-bd4a-a6fbb7effedb tempest-VolumeQuotasAdminTestJSON-403462321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d1b88101-5f27-449a-90dc-a6cd1cb73d39 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:22:17 devstack sudo[92526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d1b88101-5f27-449a-90dc-a6cd1cb73d39 Sep 16 20:22:17 devstack sudo[92526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:22:18 devstack sudo[92526]: pam_unix(sudo:session): session closed for user root Sep 16 20:22:18 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-4c489697-a52a-43b4-bd4a-a6fbb7effedb tempest-VolumeQuotasAdminTestJSON-403462321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d1b88101-5f27-449a-90dc-a6cd1cb73d39" returned: 0 in 0.739s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:22:18 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-4c489697-a52a-43b4-bd4a-a6fbb7effedb tempest-VolumeQuotasAdminTestJSON-403462321 None] Lock "cinder-quobyte-d1b88101-5f27-449a-90dc-a6cd1cb73d39" released by "delete_volume" :: held 1.508s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:22:18 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-4c489697-a52a-43b4-bd4a-a6fbb7effedb tempest-VolumeQuotasAdminTestJSON-403462321 None] Created reservations ['838628cb-5a31-44c1-a8ee-0a9205df0f40', '644f5ebf-7845-4a49-86c9-f342ddb73cf0', '47480334-3dfd-4e88-be78-3ea0d84feae5', '5cffed87-40e2-4f5b-b899-1b755343bbad'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:22:18 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-4c489697-a52a-43b4-bd4a-a6fbb7effedb tempest-VolumeQuotasAdminTestJSON-403462321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:22:18 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-4c489697-a52a-43b4-bd4a-a6fbb7effedb tempest-VolumeQuotasAdminTestJSON-403462321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:22:18 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-4c489697-a52a-43b4-bd4a-a6fbb7effedb tempest-VolumeQuotasAdminTestJSON-403462321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:22:18 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-4c489697-a52a-43b4-bd4a-a6fbb7effedb tempest-VolumeQuotasAdminTestJSON-403462321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:22:18 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-4c489697-a52a-43b4-bd4a-a6fbb7effedb tempest-VolumeQuotasAdminTestJSON-403462321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:22:18 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-4c489697-a52a-43b4-bd4a-a6fbb7effedb tempest-VolumeQuotasAdminTestJSON-403462321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:22:18 devstack sudo[92530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:22:18 devstack sudo[92530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:22:18 devstack sudo[92530]: pam_unix(sudo:session): session closed for user root Sep 16 20:22:18 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-4c489697-a52a-43b4-bd4a-a6fbb7effedb tempest-VolumeQuotasAdminTestJSON-403462321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.403s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:22:18 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-4c489697-a52a-43b4-bd4a-a6fbb7effedb tempest-VolumeQuotasAdminTestJSON-403462321 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:22:18 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-4c489697-a52a-43b4-bd4a-a6fbb7effedb tempest-VolumeQuotasAdminTestJSON-403462321 None] Deleted volume successfully. Sep 16 20:22:19 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-4c489697-a52a-43b4-bd4a-a6fbb7effedb tempest-VolumeQuotasAdminTestJSON-403462321 None] Lock "cinder-d1b88101-5f27-449a-90dc-a6cd1cb73d39-delete_volume" released by "delete_volume" :: held 2.262s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:22:21 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd691743-c68a-47ca-ac00-520e934c702d tempest-AttachVolumeTestJSON-1467622944 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:22:21 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-cd691743-c68a-47ca-ac00-520e934c702d tempest-AttachVolumeTestJSON-1467622944 None] Flow 'volume_create_manager' (f2de176a-d697-4384-b7f4-dc61c21aaddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:22:21 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-cd691743-c68a-47ca-ac00-520e934c702d tempest-AttachVolumeTestJSON-1467622944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74e6f724-9339-4eec-b027-7acc19d73f14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:22:22 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-cd691743-c68a-47ca-ac00-520e934c702d tempest-AttachVolumeTestJSON-1467622944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74e6f724-9339-4eec-b027-7acc19d73f14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:22:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1248573305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b08c9997-5fb7-46a2-8a70-f69a3c6fc470,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60ff89b3e3eb4e7285068cffd56e1463',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:22:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:22:22Z,use_quota=True,user_id='1f5bea0dd7ad4abdb4916eaf9bf51306',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:22:22 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-cd691743-c68a-47ca-ac00-520e934c702d tempest-AttachVolumeTestJSON-1467622944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a870cfa8-7f06-4a51-9056-8347de62a016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:22:22 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-cd691743-c68a-47ca-ac00-520e934c702d tempest-AttachVolumeTestJSON-1467622944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a870cfa8-7f06-4a51-9056-8347de62a016) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:22:22 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-cd691743-c68a-47ca-ac00-520e934c702d tempest-AttachVolumeTestJSON-1467622944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59aa63e6-8367-4654-8a77-d26d5fa14dc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:22:22 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-cd691743-c68a-47ca-ac00-520e934c702d tempest-AttachVolumeTestJSON-1467622944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59aa63e6-8367-4654-8a77-d26d5fa14dc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b08c9997-5fb7-46a2-8a70-f69a3c6fc470', 'volume_name': 'volume-b08c9997-5fb7-46a2-8a70-f69a3c6fc470', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:22:22 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-cd691743-c68a-47ca-ac00-520e934c702d tempest-AttachVolumeTestJSON-1467622944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4336dd3-d190-4954-9f4d-8caa9c74d9e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:22:22 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-cd691743-c68a-47ca-ac00-520e934c702d tempest-AttachVolumeTestJSON-1467622944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4336dd3-d190-4954-9f4d-8caa9c74d9e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:22:22 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-cd691743-c68a-47ca-ac00-520e934c702d tempest-AttachVolumeTestJSON-1467622944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b840944c-b922-4b0a-8bff-6d71c2f0dc98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:22:22 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-cd691743-c68a-47ca-ac00-520e934c702d tempest-AttachVolumeTestJSON-1467622944 None] Volume b08c9997-5fb7-46a2-8a70-f69a3c6fc470: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b08c9997-5fb7-46a2-8a70-f69a3c6fc470', 'volume_size': 1} Sep 16 20:22:22 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-cd691743-c68a-47ca-ac00-520e934c702d tempest-AttachVolumeTestJSON-1467622944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:22:22 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-cd691743-c68a-47ca-ac00-520e934c702d tempest-AttachVolumeTestJSON-1467622944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:22:22 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-cd691743-c68a-47ca-ac00-520e934c702d tempest-AttachVolumeTestJSON-1467622944 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:22:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1248573305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b08c9997-5fb7-46a2-8a70-f69a3c6fc470,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60ff89b3e3eb4e7285068cffd56e1463',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:22:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:22:22Z,use_quota=True,user_id='1f5bea0dd7ad4abdb4916eaf9bf51306',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:22:22 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-cd691743-c68a-47ca-ac00-520e934c702d tempest-AttachVolumeTestJSON-1467622944 None] Creating volume b08c9997-5fb7-46a2-8a70-f69a3c6fc470 {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:22:22 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-cd691743-c68a-47ca-ac00-520e934c702d tempest-AttachVolumeTestJSON-1467622944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:22:22 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-cd691743-c68a-47ca-ac00-520e934c702d tempest-AttachVolumeTestJSON-1467622944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:22:22 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-cd691743-c68a-47ca-ac00-520e934c702d tempest-AttachVolumeTestJSON-1467622944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:22:22 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-cd691743-c68a-47ca-ac00-520e934c702d tempest-AttachVolumeTestJSON-1467622944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:22:22 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-cd691743-c68a-47ca-ac00-520e934c702d tempest-AttachVolumeTestJSON-1467622944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:22:22 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-cd691743-c68a-47ca-ac00-520e934c702d tempest-AttachVolumeTestJSON-1467622944 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:22:22 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-cd691743-c68a-47ca-ac00-520e934c702d tempest-AttachVolumeTestJSON-1467622944 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:22:22 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-cd691743-c68a-47ca-ac00-520e934c702d tempest-AttachVolumeTestJSON-1467622944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b08c9997-5fb7-46a2-8a70-f69a3c6fc470 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:22:22 devstack sudo[92544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b08c9997-5fb7-46a2-8a70-f69a3c6fc470 1073741824 Sep 16 20:22:22 devstack sudo[92544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:22:23 devstack sudo[92544]: pam_unix(sudo:session): session closed for user root Sep 16 20:22:23 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-cd691743-c68a-47ca-ac00-520e934c702d tempest-AttachVolumeTestJSON-1467622944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b08c9997-5fb7-46a2-8a70-f69a3c6fc470 1073741824" returned: 0 in 1.247s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:22:23 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-cd691743-c68a-47ca-ac00-520e934c702d tempest-AttachVolumeTestJSON-1467622944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b08c9997-5fb7-46a2-8a70-f69a3c6fc470 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:22:23 devstack sudo[92551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b08c9997-5fb7-46a2-8a70-f69a3c6fc470 Sep 16 20:22:23 devstack sudo[92551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:22:24 devstack sudo[92551]: pam_unix(sudo:session): session closed for user root Sep 16 20:22:24 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-cd691743-c68a-47ca-ac00-520e934c702d tempest-AttachVolumeTestJSON-1467622944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b08c9997-5fb7-46a2-8a70-f69a3c6fc470" returned: 0 in 0.693s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:22:24 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-cd691743-c68a-47ca-ac00-520e934c702d tempest-AttachVolumeTestJSON-1467622944 None] <== create_volume: return (2049ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:22:24 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-cd691743-c68a-47ca-ac00-520e934c702d tempest-AttachVolumeTestJSON-1467622944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.058s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:22:24 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-cd691743-c68a-47ca-ac00-520e934c702d tempest-AttachVolumeTestJSON-1467622944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b840944c-b922-4b0a-8bff-6d71c2f0dc98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b08c9997-5fb7-46a2-8a70-f69a3c6fc470', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:22:24 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-cd691743-c68a-47ca-ac00-520e934c702d tempest-AttachVolumeTestJSON-1467622944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5cd6699-9322-4468-8b10-726ba589c7d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:22:24 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-cd691743-c68a-47ca-ac00-520e934c702d tempest-AttachVolumeTestJSON-1467622944 None] Volume volume-b08c9997-5fb7-46a2-8a70-f69a3c6fc470 (b08c9997-5fb7-46a2-8a70-f69a3c6fc470): created successfully Sep 16 20:22:24 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-cd691743-c68a-47ca-ac00-520e934c702d tempest-AttachVolumeTestJSON-1467622944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5cd6699-9322-4468-8b10-726ba589c7d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:22:24 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-cd691743-c68a-47ca-ac00-520e934c702d tempest-AttachVolumeTestJSON-1467622944 None] Flow 'volume_create_manager' (f2de176a-d697-4384-b7f4-dc61c21aaddc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:22:24 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-cd691743-c68a-47ca-ac00-520e934c702d tempest-AttachVolumeTestJSON-1467622944 None] Created volume successfully. Sep 16 20:22:26 devstack cinder-volume[86188]: INFO cinder.volume.manager [req-1ee58484-670a-442d-add1-920e25e8b009 req-2226b5d7-5807-41a3-b37b-6cfab8a95361 tempest-ServerActionsTestOtherA-1167936048 None] Terminate volume connection completed successfully. Sep 16 20:22:26 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [req-1ee58484-670a-442d-add1-920e25e8b009 req-2226b5d7-5807-41a3-b37b-6cfab8a95361 tempest-ServerActionsTestOtherA-1167936048 None] Deleting attachment d0385b18-91a4-4ecc-aeef-4a9655803745. {{(pid=86188) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 16 20:22:26 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [req-c6db0962-78e1-4bea-a9de-d11d0f902908 req-a6aab1d2-1ffb-49d8-aa08-5b09c140e885 tempest-AttachVolumeTestJSON-1467622944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:22:26 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [req-c6db0962-78e1-4bea-a9de-d11d0f902908 req-a6aab1d2-1ffb-49d8-aa08-5b09c140e885 tempest-AttachVolumeTestJSON-1467622944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:22:26 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [req-c6db0962-78e1-4bea-a9de-d11d0f902908 req-a6aab1d2-1ffb-49d8-aa08-5b09c140e885 tempest-AttachVolumeTestJSON-1467622944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.047s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:22:26 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [req-c6db0962-78e1-4bea-a9de-d11d0f902908 req-a6aab1d2-1ffb-49d8-aa08-5b09c140e885 tempest-AttachVolumeTestJSON-1467622944 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81', 'name': 'volume-b08c9997-5fb7-46a2-8a70-f69a3c6fc470', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f9e0c1db-d2a4-4d73-b238-d973fcd3b5f9', 'enforce_multipath': True} {{(pid=86188) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 16 20:22:27 devstack cinder-volume[86188]: INFO cinder.volume.manager [req-c6db0962-78e1-4bea-a9de-d11d0f902908 req-a6aab1d2-1ffb-49d8-aa08-5b09c140e885 tempest-AttachVolumeTestJSON-1467622944 None] attachment_update completed successfully. Sep 16 20:22:29 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [req-1ee58484-670a-442d-add1-920e25e8b009 req-9a192ac8-9643-4eec-907f-454bc5eea2a2 tempest-ServerActionsTestOtherA-1167936048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:22:29 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [req-1ee58484-670a-442d-add1-920e25e8b009 req-9a192ac8-9643-4eec-907f-454bc5eea2a2 tempest-ServerActionsTestOtherA-1167936048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:22:29 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [req-1ee58484-670a-442d-add1-920e25e8b009 req-9a192ac8-9643-4eec-907f-454bc5eea2a2 tempest-ServerActionsTestOtherA-1167936048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:22:29 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [req-1ee58484-670a-442d-add1-920e25e8b009 req-9a192ac8-9643-4eec-907f-454bc5eea2a2 tempest-ServerActionsTestOtherA-1167936048 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81', 'name': 'volume-3570f169-4b45-4f1a-9476-11e57e5b87d4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2d84a4e4-0b1f-49fd-84e0-fa5bc7228ade', 'enforce_multipath': True} {{(pid=86188) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 16 20:22:29 devstack cinder-volume[86188]: INFO cinder.volume.manager [req-1ee58484-670a-442d-add1-920e25e8b009 req-9a192ac8-9643-4eec-907f-454bc5eea2a2 tempest-ServerActionsTestOtherA-1167936048 None] attachment_update completed successfully. Sep 16 20:22:39 devstack cinder-volume[86188]: DEBUG dbcounter [-] [86188] Writing DB stats cinder:SELECT=40,cinder:UPDATE=26,cinder:INSERT=7,cinder:DELETE=4 {{(pid=86188) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 20:22:39 devstack cinder-volume[86188]: DEBUG dbcounter [-] [86188] Writing DB stats cinder:UPDATE=33,cinder:SELECT=32,cinder:INSERT=4,cinder:DELETE=1 {{(pid=86188) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 20:22:40 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b680b64-f57b-423e-981c-e2d03efe1be4 tempest-AttachVolumeNegativeTest-1537838471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:22:40 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-6b680b64-f57b-423e-981c-e2d03efe1be4 tempest-AttachVolumeNegativeTest-1537838471 None] Flow 'volume_create_manager' (2f193d57-d70b-4c6c-9906-65f2b65d601a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:22:40 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-6b680b64-f57b-423e-981c-e2d03efe1be4 tempest-AttachVolumeNegativeTest-1537838471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19dfe0ea-9153-4a3f-bfc6-214bd769f74a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:22:40 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-6b680b64-f57b-423e-981c-e2d03efe1be4 tempest-AttachVolumeNegativeTest-1537838471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19dfe0ea-9153-4a3f-bfc6-214bd769f74a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:22:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-955688082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23a91cd7-74d7-494e-a735-4d4cb4714a9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3587d449fe5c467ba11ccf39851d1fc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:22:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:22:41Z,use_quota=True,user_id='426ad78a563445bb95108bdfd4bd10e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:22:40 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-6b680b64-f57b-423e-981c-e2d03efe1be4 tempest-AttachVolumeNegativeTest-1537838471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24a82b8f-4046-4200-9a18-135e53d23415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:22:40 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-6b680b64-f57b-423e-981c-e2d03efe1be4 tempest-AttachVolumeNegativeTest-1537838471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24a82b8f-4046-4200-9a18-135e53d23415) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:22:40 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-6b680b64-f57b-423e-981c-e2d03efe1be4 tempest-AttachVolumeNegativeTest-1537838471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a451f65-03aa-472c-9ac4-adef8679446f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:22:40 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-6b680b64-f57b-423e-981c-e2d03efe1be4 tempest-AttachVolumeNegativeTest-1537838471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a451f65-03aa-472c-9ac4-adef8679446f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23a91cd7-74d7-494e-a735-4d4cb4714a9c', 'volume_name': 'volume-23a91cd7-74d7-494e-a735-4d4cb4714a9c', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:22:40 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-6b680b64-f57b-423e-981c-e2d03efe1be4 tempest-AttachVolumeNegativeTest-1537838471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97c1377a-0374-4da0-a7c7-277e4d87bf5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:22:40 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-6b680b64-f57b-423e-981c-e2d03efe1be4 tempest-AttachVolumeNegativeTest-1537838471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97c1377a-0374-4da0-a7c7-277e4d87bf5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:22:40 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-6b680b64-f57b-423e-981c-e2d03efe1be4 tempest-AttachVolumeNegativeTest-1537838471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1dcec08-44c3-417f-ac71-be8dcd7bffd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:22:40 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-6b680b64-f57b-423e-981c-e2d03efe1be4 tempest-AttachVolumeNegativeTest-1537838471 None] Volume 23a91cd7-74d7-494e-a735-4d4cb4714a9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23a91cd7-74d7-494e-a735-4d4cb4714a9c', 'volume_size': 1} Sep 16 20:22:40 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-6b680b64-f57b-423e-981c-e2d03efe1be4 tempest-AttachVolumeNegativeTest-1537838471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:22:40 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-6b680b64-f57b-423e-981c-e2d03efe1be4 tempest-AttachVolumeNegativeTest-1537838471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:22:40 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-6b680b64-f57b-423e-981c-e2d03efe1be4 tempest-AttachVolumeNegativeTest-1537838471 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:22:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-955688082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23a91cd7-74d7-494e-a735-4d4cb4714a9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3587d449fe5c467ba11ccf39851d1fc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:22:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:22:41Z,use_quota=True,user_id='426ad78a563445bb95108bdfd4bd10e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:22:40 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-6b680b64-f57b-423e-981c-e2d03efe1be4 tempest-AttachVolumeNegativeTest-1537838471 None] Creating volume 23a91cd7-74d7-494e-a735-4d4cb4714a9c {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:22:40 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-6b680b64-f57b-423e-981c-e2d03efe1be4 tempest-AttachVolumeNegativeTest-1537838471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:22:40 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-6b680b64-f57b-423e-981c-e2d03efe1be4 tempest-AttachVolumeNegativeTest-1537838471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:22:40 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-6b680b64-f57b-423e-981c-e2d03efe1be4 tempest-AttachVolumeNegativeTest-1537838471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:22:40 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-6b680b64-f57b-423e-981c-e2d03efe1be4 tempest-AttachVolumeNegativeTest-1537838471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:22:40 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-6b680b64-f57b-423e-981c-e2d03efe1be4 tempest-AttachVolumeNegativeTest-1537838471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:22:40 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-6b680b64-f57b-423e-981c-e2d03efe1be4 tempest-AttachVolumeNegativeTest-1537838471 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:22:40 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-6b680b64-f57b-423e-981c-e2d03efe1be4 tempest-AttachVolumeNegativeTest-1537838471 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:22:40 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-6b680b64-f57b-423e-981c-e2d03efe1be4 tempest-AttachVolumeNegativeTest-1537838471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-23a91cd7-74d7-494e-a735-4d4cb4714a9c 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:22:40 devstack sudo[93211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-23a91cd7-74d7-494e-a735-4d4cb4714a9c 1073741824 Sep 16 20:22:40 devstack sudo[93211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:22:41 devstack sudo[93211]: pam_unix(sudo:session): session closed for user root Sep 16 20:22:41 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-6b680b64-f57b-423e-981c-e2d03efe1be4 tempest-AttachVolumeNegativeTest-1537838471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-23a91cd7-74d7-494e-a735-4d4cb4714a9c 1073741824" returned: 0 in 0.497s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:22:41 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-6b680b64-f57b-423e-981c-e2d03efe1be4 tempest-AttachVolumeNegativeTest-1537838471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-23a91cd7-74d7-494e-a735-4d4cb4714a9c {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:22:41 devstack sudo[93217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-23a91cd7-74d7-494e-a735-4d4cb4714a9c Sep 16 20:22:41 devstack sudo[93217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:22:41 devstack sudo[93217]: pam_unix(sudo:session): session closed for user root Sep 16 20:22:41 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-6b680b64-f57b-423e-981c-e2d03efe1be4 tempest-AttachVolumeNegativeTest-1537838471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-23a91cd7-74d7-494e-a735-4d4cb4714a9c" returned: 0 in 0.334s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:22:41 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-6b680b64-f57b-423e-981c-e2d03efe1be4 tempest-AttachVolumeNegativeTest-1537838471 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:22:41 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-6b680b64-f57b-423e-981c-e2d03efe1be4 tempest-AttachVolumeNegativeTest-1537838471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:22:41 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-6b680b64-f57b-423e-981c-e2d03efe1be4 tempest-AttachVolumeNegativeTest-1537838471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1dcec08-44c3-417f-ac71-be8dcd7bffd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23a91cd7-74d7-494e-a735-4d4cb4714a9c', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:22:41 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-6b680b64-f57b-423e-981c-e2d03efe1be4 tempest-AttachVolumeNegativeTest-1537838471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba717597-36c2-4f8a-8ab9-117ead34dad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:22:41 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-6b680b64-f57b-423e-981c-e2d03efe1be4 tempest-AttachVolumeNegativeTest-1537838471 None] Volume volume-23a91cd7-74d7-494e-a735-4d4cb4714a9c (23a91cd7-74d7-494e-a735-4d4cb4714a9c): created successfully Sep 16 20:22:41 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-6b680b64-f57b-423e-981c-e2d03efe1be4 tempest-AttachVolumeNegativeTest-1537838471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba717597-36c2-4f8a-8ab9-117ead34dad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:22:41 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-6b680b64-f57b-423e-981c-e2d03efe1be4 tempest-AttachVolumeNegativeTest-1537838471 None] Flow 'volume_create_manager' (2f193d57-d70b-4c6c-9906-65f2b65d601a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:22:41 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-6b680b64-f57b-423e-981c-e2d03efe1be4 tempest-AttachVolumeNegativeTest-1537838471 None] Created volume successfully. Sep 16 20:22:42 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3d8e0d8-ff57-43a4-b313-b1da927cb934 tempest-VolumeSnapshotQuotasNegativeTestJSON-1072206583 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:22:42 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f3d8e0d8-ff57-43a4-b313-b1da927cb934 tempest-VolumeSnapshotQuotasNegativeTestJSON-1072206583 None] Flow 'volume_create_manager' (c1dccd2b-1c48-4d3e-8f77-c4bb4724aeb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:22:42 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f3d8e0d8-ff57-43a4-b313-b1da927cb934 tempest-VolumeSnapshotQuotasNegativeTestJSON-1072206583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a84d10b3-16b9-440c-83c8-06a4fcd7ada3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:22:42 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f3d8e0d8-ff57-43a4-b313-b1da927cb934 tempest-VolumeSnapshotQuotasNegativeTestJSON-1072206583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a84d10b3-16b9-440c-83c8-06a4fcd7ada3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:22:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1109938145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5906ff7-7970-4e30-bcc2-6e954520b209,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b175f3021aa24fc5afc24c42a0f19e59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:22:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:22:43Z,use_quota=True,user_id='9a900a365e89431e8ca6375ece59aae0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:22:42 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f3d8e0d8-ff57-43a4-b313-b1da927cb934 tempest-VolumeSnapshotQuotasNegativeTestJSON-1072206583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b36e5a15-726e-4663-9041-97539415d1f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:22:42 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f3d8e0d8-ff57-43a4-b313-b1da927cb934 tempest-VolumeSnapshotQuotasNegativeTestJSON-1072206583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b36e5a15-726e-4663-9041-97539415d1f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:22:42 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f3d8e0d8-ff57-43a4-b313-b1da927cb934 tempest-VolumeSnapshotQuotasNegativeTestJSON-1072206583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07d50748-2560-4d92-bb65-5b5f55b2d35d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:22:42 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f3d8e0d8-ff57-43a4-b313-b1da927cb934 tempest-VolumeSnapshotQuotasNegativeTestJSON-1072206583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07d50748-2560-4d92-bb65-5b5f55b2d35d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5906ff7-7970-4e30-bcc2-6e954520b209', 'volume_name': 'volume-e5906ff7-7970-4e30-bcc2-6e954520b209', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:22:42 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f3d8e0d8-ff57-43a4-b313-b1da927cb934 tempest-VolumeSnapshotQuotasNegativeTestJSON-1072206583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47cb47eb-c5e6-43e5-9dea-e3e44ce61c9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:22:42 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f3d8e0d8-ff57-43a4-b313-b1da927cb934 tempest-VolumeSnapshotQuotasNegativeTestJSON-1072206583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47cb47eb-c5e6-43e5-9dea-e3e44ce61c9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:22:42 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f3d8e0d8-ff57-43a4-b313-b1da927cb934 tempest-VolumeSnapshotQuotasNegativeTestJSON-1072206583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdca2b93-09e9-49f0-b79a-d0250f0e5c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:22:42 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-f3d8e0d8-ff57-43a4-b313-b1da927cb934 tempest-VolumeSnapshotQuotasNegativeTestJSON-1072206583 None] Volume e5906ff7-7970-4e30-bcc2-6e954520b209: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5906ff7-7970-4e30-bcc2-6e954520b209', 'volume_size': 1} Sep 16 20:22:42 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-f3d8e0d8-ff57-43a4-b313-b1da927cb934 tempest-VolumeSnapshotQuotasNegativeTestJSON-1072206583 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:22:42 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-f3d8e0d8-ff57-43a4-b313-b1da927cb934 tempest-VolumeSnapshotQuotasNegativeTestJSON-1072206583 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:22:42 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-f3d8e0d8-ff57-43a4-b313-b1da927cb934 tempest-VolumeSnapshotQuotasNegativeTestJSON-1072206583 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:22:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1109938145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5906ff7-7970-4e30-bcc2-6e954520b209,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b175f3021aa24fc5afc24c42a0f19e59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:22:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:22:43Z,use_quota=True,user_id='9a900a365e89431e8ca6375ece59aae0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:22:42 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-f3d8e0d8-ff57-43a4-b313-b1da927cb934 tempest-VolumeSnapshotQuotasNegativeTestJSON-1072206583 None] Creating volume e5906ff7-7970-4e30-bcc2-6e954520b209 {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:22:42 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-f3d8e0d8-ff57-43a4-b313-b1da927cb934 tempest-VolumeSnapshotQuotasNegativeTestJSON-1072206583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:22:42 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-f3d8e0d8-ff57-43a4-b313-b1da927cb934 tempest-VolumeSnapshotQuotasNegativeTestJSON-1072206583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:22:42 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-f3d8e0d8-ff57-43a4-b313-b1da927cb934 tempest-VolumeSnapshotQuotasNegativeTestJSON-1072206583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:22:42 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-f3d8e0d8-ff57-43a4-b313-b1da927cb934 tempest-VolumeSnapshotQuotasNegativeTestJSON-1072206583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:22:42 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-f3d8e0d8-ff57-43a4-b313-b1da927cb934 tempest-VolumeSnapshotQuotasNegativeTestJSON-1072206583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:22:42 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-f3d8e0d8-ff57-43a4-b313-b1da927cb934 tempest-VolumeSnapshotQuotasNegativeTestJSON-1072206583 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:22:42 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-f3d8e0d8-ff57-43a4-b313-b1da927cb934 tempest-VolumeSnapshotQuotasNegativeTestJSON-1072206583 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:22:42 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f3d8e0d8-ff57-43a4-b313-b1da927cb934 tempest-VolumeSnapshotQuotasNegativeTestJSON-1072206583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e5906ff7-7970-4e30-bcc2-6e954520b209 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:22:43 devstack sudo[93220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e5906ff7-7970-4e30-bcc2-6e954520b209 1073741824 Sep 16 20:22:43 devstack sudo[93220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:22:43 devstack sudo[93220]: pam_unix(sudo:session): session closed for user root Sep 16 20:22:43 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f3d8e0d8-ff57-43a4-b313-b1da927cb934 tempest-VolumeSnapshotQuotasNegativeTestJSON-1072206583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e5906ff7-7970-4e30-bcc2-6e954520b209 1073741824" returned: 0 in 0.586s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:22:43 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f3d8e0d8-ff57-43a4-b313-b1da927cb934 tempest-VolumeSnapshotQuotasNegativeTestJSON-1072206583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e5906ff7-7970-4e30-bcc2-6e954520b209 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:22:43 devstack sudo[93232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e5906ff7-7970-4e30-bcc2-6e954520b209 Sep 16 20:22:43 devstack sudo[93232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:22:43 devstack sudo[93232]: pam_unix(sudo:session): session closed for user root Sep 16 20:22:43 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f3d8e0d8-ff57-43a4-b313-b1da927cb934 tempest-VolumeSnapshotQuotasNegativeTestJSON-1072206583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e5906ff7-7970-4e30-bcc2-6e954520b209" returned: 0 in 0.304s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:22:43 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-f3d8e0d8-ff57-43a4-b313-b1da927cb934 tempest-VolumeSnapshotQuotasNegativeTestJSON-1072206583 None] <== create_volume: return (945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:22:43 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-f3d8e0d8-ff57-43a4-b313-b1da927cb934 tempest-VolumeSnapshotQuotasNegativeTestJSON-1072206583 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:22:43 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f3d8e0d8-ff57-43a4-b313-b1da927cb934 tempest-VolumeSnapshotQuotasNegativeTestJSON-1072206583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdca2b93-09e9-49f0-b79a-d0250f0e5c5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5906ff7-7970-4e30-bcc2-6e954520b209', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:22:43 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f3d8e0d8-ff57-43a4-b313-b1da927cb934 tempest-VolumeSnapshotQuotasNegativeTestJSON-1072206583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c516b91-89f4-47fe-b6cc-a39e22afd128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:22:43 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-f3d8e0d8-ff57-43a4-b313-b1da927cb934 tempest-VolumeSnapshotQuotasNegativeTestJSON-1072206583 None] Volume volume-e5906ff7-7970-4e30-bcc2-6e954520b209 (e5906ff7-7970-4e30-bcc2-6e954520b209): created successfully Sep 16 20:22:43 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f3d8e0d8-ff57-43a4-b313-b1da927cb934 tempest-VolumeSnapshotQuotasNegativeTestJSON-1072206583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c516b91-89f4-47fe-b6cc-a39e22afd128) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:22:43 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f3d8e0d8-ff57-43a4-b313-b1da927cb934 tempest-VolumeSnapshotQuotasNegativeTestJSON-1072206583 None] Flow 'volume_create_manager' (c1dccd2b-1c48-4d3e-8f77-c4bb4724aeb6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:22:43 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-f3d8e0d8-ff57-43a4-b313-b1da927cb934 tempest-VolumeSnapshotQuotasNegativeTestJSON-1072206583 None] Created volume successfully. Sep 16 20:22:44 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [req-bb2013d4-1e37-4986-96a3-c2ab3a46ec95 req-c6100261-576a-4f50-ae86-a283e7086bbe tempest-AttachVolumeNegativeTest-1537838471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:22:44 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [req-bb2013d4-1e37-4986-96a3-c2ab3a46ec95 req-c6100261-576a-4f50-ae86-a283e7086bbe tempest-AttachVolumeNegativeTest-1537838471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:22:44 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [req-bb2013d4-1e37-4986-96a3-c2ab3a46ec95 req-c6100261-576a-4f50-ae86-a283e7086bbe tempest-AttachVolumeNegativeTest-1537838471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:22:44 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [req-bb2013d4-1e37-4986-96a3-c2ab3a46ec95 req-c6100261-576a-4f50-ae86-a283e7086bbe tempest-AttachVolumeNegativeTest-1537838471 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81', 'name': 'volume-23a91cd7-74d7-494e-a735-4d4cb4714a9c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '496d8d09-1676-4fc0-99f9-4250032a4e88', 'enforce_multipath': True} {{(pid=86188) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 16 20:22:44 devstack cinder-volume[86188]: INFO cinder.volume.manager [req-bb2013d4-1e37-4986-96a3-c2ab3a46ec95 req-c6100261-576a-4f50-ae86-a283e7086bbe tempest-AttachVolumeNegativeTest-1537838471 None] attachment_update completed successfully. Sep 16 20:22:45 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-b36881ce-ec8f-4e50-b93e-8fd3a09690bd tempest-VolumeSnapshotQuotasNegativeTestJSON-1072206583 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:22:45 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-b36881ce-ec8f-4e50-b93e-8fd3a09690bd tempest-VolumeSnapshotQuotasNegativeTestJSON-1072206583 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:22:45 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-b36881ce-ec8f-4e50-b93e-8fd3a09690bd tempest-VolumeSnapshotQuotasNegativeTestJSON-1072206583 None] Creating offline snapshot 945848fc-6ba4-4430-a612-dd869718cd7b of volume e5906ff7-7970-4e30-bcc2-6e954520b209 {{(pid=86188) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 20:22:45 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d48d65f-bac2-4978-80cc-69c01e87aed7]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:22:45 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b36881ce-ec8f-4e50-b93e-8fd3a09690bd tempest-VolumeSnapshotQuotasNegativeTestJSON-1072206583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e5906ff7-7970-4e30-bcc2-6e954520b209 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:22:45 devstack sudo[93245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e5906ff7-7970-4e30-bcc2-6e954520b209 Sep 16 20:22:45 devstack sudo[93245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:22:46 devstack sudo[93245]: pam_unix(sudo:session): session closed for user root Sep 16 20:22:46 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b36881ce-ec8f-4e50-b93e-8fd3a09690bd tempest-VolumeSnapshotQuotasNegativeTestJSON-1072206583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e5906ff7-7970-4e30-bcc2-6e954520b209" returned: 0 in 0.614s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:22:46 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b36881ce-ec8f-4e50-b93e-8fd3a09690bd tempest-VolumeSnapshotQuotasNegativeTestJSON-1072206583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e5906ff7-7970-4e30-bcc2-6e954520b209,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e5906ff7-7970-4e30-bcc2-6e954520b209.945848fc-6ba4-4430-a612-dd869718cd7b 1G {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:22:46 devstack sudo[93255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e5906ff7-7970-4e30-bcc2-6e954520b209,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e5906ff7-7970-4e30-bcc2-6e954520b209.945848fc-6ba4-4430-a612-dd869718cd7b 1G Sep 16 20:22:46 devstack sudo[93255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:22:46 devstack cinder-volume[86188]: INFO cinder.volume.manager [req-01859109-1ee7-468a-a138-85c499c0b16f req-cd2c4181-3516-4049-b2e2-633b50477d9a tempest-AttachVolumeNegativeTest-1537838471 None] Terminate volume connection completed successfully. Sep 16 20:22:46 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [req-01859109-1ee7-468a-a138-85c499c0b16f req-cd2c4181-3516-4049-b2e2-633b50477d9a tempest-AttachVolumeNegativeTest-1537838471 None] Deleting attachment 496d8d09-1676-4fc0-99f9-4250032a4e88. {{(pid=86188) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 16 20:22:46 devstack sudo[93255]: pam_unix(sudo:session): session closed for user root Sep 16 20:22:46 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b36881ce-ec8f-4e50-b93e-8fd3a09690bd tempest-VolumeSnapshotQuotasNegativeTestJSON-1072206583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e5906ff7-7970-4e30-bcc2-6e954520b209,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e5906ff7-7970-4e30-bcc2-6e954520b209.945848fc-6ba4-4430-a612-dd869718cd7b 1G" returned: 0 in 0.500s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:22:46 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b36881ce-ec8f-4e50-b93e-8fd3a09690bd tempest-VolumeSnapshotQuotasNegativeTestJSON-1072206583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5906ff7-7970-4e30-bcc2-6e954520b209 -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e5906ff7-7970-4e30-bcc2-6e954520b209.945848fc-6ba4-4430-a612-dd869718cd7b {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:22:46 devstack sudo[93260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5906ff7-7970-4e30-bcc2-6e954520b209 -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e5906ff7-7970-4e30-bcc2-6e954520b209.945848fc-6ba4-4430-a612-dd869718cd7b Sep 16 20:22:46 devstack sudo[93260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:22:47 devstack sudo[93260]: pam_unix(sudo:session): session closed for user root Sep 16 20:22:47 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b36881ce-ec8f-4e50-b93e-8fd3a09690bd tempest-VolumeSnapshotQuotasNegativeTestJSON-1072206583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5906ff7-7970-4e30-bcc2-6e954520b209 -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e5906ff7-7970-4e30-bcc2-6e954520b209.945848fc-6ba4-4430-a612-dd869718cd7b" returned: 0 in 0.452s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:22:47 devstack cinder-volume[86188]: WARNING cinder.volume.drivers.remotefs [None req-b36881ce-ec8f-4e50-b93e-8fd3a09690bd tempest-VolumeSnapshotQuotasNegativeTestJSON-1072206583 None] /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e5906ff7-7970-4e30-bcc2-6e954520b209.945848fc-6ba4-4430-a612-dd869718cd7b is being set with open permissions: ugo+rw Sep 16 20:22:47 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b36881ce-ec8f-4e50-b93e-8fd3a09690bd tempest-VolumeSnapshotQuotasNegativeTestJSON-1072206583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e5906ff7-7970-4e30-bcc2-6e954520b209.945848fc-6ba4-4430-a612-dd869718cd7b {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:22:47 devstack sudo[93267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e5906ff7-7970-4e30-bcc2-6e954520b209.945848fc-6ba4-4430-a612-dd869718cd7b Sep 16 20:22:47 devstack sudo[93267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:22:47 devstack sudo[93267]: pam_unix(sudo:session): session closed for user root Sep 16 20:22:47 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b36881ce-ec8f-4e50-b93e-8fd3a09690bd tempest-VolumeSnapshotQuotasNegativeTestJSON-1072206583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e5906ff7-7970-4e30-bcc2-6e954520b209.945848fc-6ba4-4430-a612-dd869718cd7b" returned: 0 in 0.568s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:22:47 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b36881ce-ec8f-4e50-b93e-8fd3a09690bd tempest-VolumeSnapshotQuotasNegativeTestJSON-1072206583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e5906ff7-7970-4e30-bcc2-6e954520b209.info {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:22:47 devstack sudo[93308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e5906ff7-7970-4e30-bcc2-6e954520b209.info Sep 16 20:22:47 devstack sudo[93308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:22:48 devstack sudo[93308]: pam_unix(sudo:session): session closed for user root Sep 16 20:22:48 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b36881ce-ec8f-4e50-b93e-8fd3a09690bd tempest-VolumeSnapshotQuotasNegativeTestJSON-1072206583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e5906ff7-7970-4e30-bcc2-6e954520b209.info" returned: 0 in 0.504s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:22:48 devstack cinder-volume[86188]: WARNING cinder.volume.drivers.remotefs [None req-b36881ce-ec8f-4e50-b93e-8fd3a09690bd tempest-VolumeSnapshotQuotasNegativeTestJSON-1072206583 None] /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e5906ff7-7970-4e30-bcc2-6e954520b209.info is being set with open permissions: ugo+rw Sep 16 20:22:48 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b36881ce-ec8f-4e50-b93e-8fd3a09690bd tempest-VolumeSnapshotQuotasNegativeTestJSON-1072206583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e5906ff7-7970-4e30-bcc2-6e954520b209.info {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:22:48 devstack sudo[93319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e5906ff7-7970-4e30-bcc2-6e954520b209.info Sep 16 20:22:48 devstack sudo[93319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:22:48 devstack sudo[93319]: pam_unix(sudo:session): session closed for user root Sep 16 20:22:48 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b36881ce-ec8f-4e50-b93e-8fd3a09690bd tempest-VolumeSnapshotQuotasNegativeTestJSON-1072206583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e5906ff7-7970-4e30-bcc2-6e954520b209.info" returned: 0 in 0.506s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:22:48 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-b36881ce-ec8f-4e50-b93e-8fd3a09690bd tempest-VolumeSnapshotQuotasNegativeTestJSON-1072206583 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.439s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:22:48 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-b36881ce-ec8f-4e50-b93e-8fd3a09690bd tempest-VolumeSnapshotQuotasNegativeTestJSON-1072206583 None] Create snapshot completed successfully Sep 16 20:22:50 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-6f6ad11e-c989-4be6-85d8-f3b14e239276 tempest-VolumeSnapshotQuotasNegativeTestJSON-1072206583 None] Acquiring lock "cinder-945848fc-6ba4-4430-a612-dd869718cd7b-delete_snapshot" by "delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:22:50 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-6f6ad11e-c989-4be6-85d8-f3b14e239276 tempest-VolumeSnapshotQuotasNegativeTestJSON-1072206583 None] Lock "cinder-945848fc-6ba4-4430-a612-dd869718cd7b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:22:50 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-6f6ad11e-c989-4be6-85d8-f3b14e239276 tempest-VolumeSnapshotQuotasNegativeTestJSON-1072206583 None] Acquiring lock "cinder-quobyte-e5906ff7-7970-4e30-bcc2-6e954520b209" by "delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:22:50 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-6f6ad11e-c989-4be6-85d8-f3b14e239276 tempest-VolumeSnapshotQuotasNegativeTestJSON-1072206583 None] Lock "cinder-quobyte-e5906ff7-7970-4e30-bcc2-6e954520b209" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:22:50 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-6f6ad11e-c989-4be6-85d8-f3b14e239276 tempest-VolumeSnapshotQuotasNegativeTestJSON-1072206583 None] Acquiring lock "cinder-quobyte-945848fc-6ba4-4430-a612-dd869718cd7b" by "_delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:22:50 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-6f6ad11e-c989-4be6-85d8-f3b14e239276 tempest-VolumeSnapshotQuotasNegativeTestJSON-1072206583 None] Lock "cinder-quobyte-945848fc-6ba4-4430-a612-dd869718cd7b" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:22:50 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-6f6ad11e-c989-4be6-85d8-f3b14e239276 tempest-VolumeSnapshotQuotasNegativeTestJSON-1072206583 None] Deleting offline snapshot 945848fc-6ba4-4430-a612-dd869718cd7b of volume e5906ff7-7970-4e30-bcc2-6e954520b209 {{(pid=86188) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 20:22:50 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-6f6ad11e-c989-4be6-85d8-f3b14e239276 tempest-VolumeSnapshotQuotasNegativeTestJSON-1072206583 None] snapshot_file for this snap is: volume-e5906ff7-7970-4e30-bcc2-6e954520b209.945848fc-6ba4-4430-a612-dd869718cd7b {{(pid=86188) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 20:22:50 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[df16247d-5b19-4270-9ebe-aea662ff9730]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:22:50 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-6f6ad11e-c989-4be6-85d8-f3b14e239276 tempest-VolumeSnapshotQuotasNegativeTestJSON-1072206583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e5906ff7-7970-4e30-bcc2-6e954520b209.945848fc-6ba4-4430-a612-dd869718cd7b {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:22:50 devstack sudo[93326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e5906ff7-7970-4e30-bcc2-6e954520b209.945848fc-6ba4-4430-a612-dd869718cd7b Sep 16 20:22:50 devstack sudo[93326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:22:50 devstack sudo[93326]: pam_unix(sudo:session): session closed for user root Sep 16 20:22:50 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-6f6ad11e-c989-4be6-85d8-f3b14e239276 tempest-VolumeSnapshotQuotasNegativeTestJSON-1072206583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e5906ff7-7970-4e30-bcc2-6e954520b209.945848fc-6ba4-4430-a612-dd869718cd7b" returned: 0 in 0.539s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:22:50 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-6f6ad11e-c989-4be6-85d8-f3b14e239276 tempest-VolumeSnapshotQuotasNegativeTestJSON-1072206583 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e5906ff7-7970-4e30-bcc2-6e954520b209(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86188) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 20:22:50 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[f536e356-a94f-40de-bfed-2cfa462da6ca]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:22:50 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-6f6ad11e-c989-4be6-85d8-f3b14e239276 tempest-VolumeSnapshotQuotasNegativeTestJSON-1072206583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e5906ff7-7970-4e30-bcc2-6e954520b209 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:22:50 devstack sudo[93341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e5906ff7-7970-4e30-bcc2-6e954520b209 Sep 16 20:22:50 devstack sudo[93341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:22:51 devstack sudo[93341]: pam_unix(sudo:session): session closed for user root Sep 16 20:22:51 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-6f6ad11e-c989-4be6-85d8-f3b14e239276 tempest-VolumeSnapshotQuotasNegativeTestJSON-1072206583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e5906ff7-7970-4e30-bcc2-6e954520b209" returned: 0 in 0.433s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:22:51 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-6f6ad11e-c989-4be6-85d8-f3b14e239276 tempest-VolumeSnapshotQuotasNegativeTestJSON-1072206583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e5906ff7-7970-4e30-bcc2-6e954520b209.945848fc-6ba4-4430-a612-dd869718cd7b {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:22:51 devstack sudo[93346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e5906ff7-7970-4e30-bcc2-6e954520b209.945848fc-6ba4-4430-a612-dd869718cd7b Sep 16 20:22:51 devstack sudo[93346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:22:51 devstack sudo[93346]: pam_unix(sudo:session): session closed for user root Sep 16 20:22:51 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-6f6ad11e-c989-4be6-85d8-f3b14e239276 tempest-VolumeSnapshotQuotasNegativeTestJSON-1072206583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e5906ff7-7970-4e30-bcc2-6e954520b209.945848fc-6ba4-4430-a612-dd869718cd7b" returned: 0 in 0.417s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:22:51 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-6f6ad11e-c989-4be6-85d8-f3b14e239276 tempest-VolumeSnapshotQuotasNegativeTestJSON-1072206583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e5906ff7-7970-4e30-bcc2-6e954520b209.945848fc-6ba4-4430-a612-dd869718cd7b {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:22:51 devstack sudo[93360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e5906ff7-7970-4e30-bcc2-6e954520b209.945848fc-6ba4-4430-a612-dd869718cd7b Sep 16 20:22:51 devstack sudo[93360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:22:52 devstack sudo[93360]: pam_unix(sudo:session): session closed for user root Sep 16 20:22:52 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-6f6ad11e-c989-4be6-85d8-f3b14e239276 tempest-VolumeSnapshotQuotasNegativeTestJSON-1072206583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e5906ff7-7970-4e30-bcc2-6e954520b209.945848fc-6ba4-4430-a612-dd869718cd7b" returned: 0 in 0.358s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:22:52 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-6f6ad11e-c989-4be6-85d8-f3b14e239276 tempest-VolumeSnapshotQuotasNegativeTestJSON-1072206583 None] Lock "cinder-quobyte-945848fc-6ba4-4430-a612-dd869718cd7b" released by "_delete_snapshot" :: held 1.957s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:22:52 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-6f6ad11e-c989-4be6-85d8-f3b14e239276 tempest-VolumeSnapshotQuotasNegativeTestJSON-1072206583 None] Lock "cinder-quobyte-e5906ff7-7970-4e30-bcc2-6e954520b209" released by "delete_snapshot" :: held 2.008s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:22:52 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-6f6ad11e-c989-4be6-85d8-f3b14e239276 tempest-VolumeSnapshotQuotasNegativeTestJSON-1072206583 None] Created reservations ['e3dbf7fd-3bba-41cf-a7a1-5a6016eab416', '73021d87-ab78-4d4a-8302-a2666a9fa7a6', '224a5ab8-dc62-4ed2-8f9d-b2a3c163db68', 'b6e238bb-756c-4333-bf07-109a13db3a83'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:22:52 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-6f6ad11e-c989-4be6-85d8-f3b14e239276 tempest-VolumeSnapshotQuotasNegativeTestJSON-1072206583 None] Delete snapshot completed successfully. Sep 16 20:22:52 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-6f6ad11e-c989-4be6-85d8-f3b14e239276 tempest-VolumeSnapshotQuotasNegativeTestJSON-1072206583 None] Lock "cinder-945848fc-6ba4-4430-a612-dd869718cd7b-delete_snapshot" released by "delete_snapshot" :: held 2.253s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:22:52 devstack cinder-volume[86188]: DEBUG oslo_service.periodic_task [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86188) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 20:22:52 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:22:52 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:22:52 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:22:52 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:22:52 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:22:52 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:22:53 devstack sudo[93395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:22:53 devstack sudo[93395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:22:53 devstack sudo[93395]: pam_unix(sudo:session): session closed for user root Sep 16 20:22:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.264s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:22:53 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:22:53 devstack cinder-volume[86188]: DEBUG oslo_service.periodic_task [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Running periodic task VolumeManager._thread_info {{(pid=86188) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 20:22:53 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] thread count: 28 {{(pid=86188) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 16 20:22:53 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] thread info: [<_MainThread(MainThread, started 139858124406912)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86188) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 16 20:22:53 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-80776d7a-9b9f-4acf-b2e5-2c697260a51d tempest-VolumeSnapshotQuotasNegativeTestJSON-1072206583 None] Acquiring lock "cinder-e5906ff7-7970-4e30-bcc2-6e954520b209-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:22:53 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-80776d7a-9b9f-4acf-b2e5-2c697260a51d tempest-VolumeSnapshotQuotasNegativeTestJSON-1072206583 None] Lock "cinder-e5906ff7-7970-4e30-bcc2-6e954520b209-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:22:53 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-80776d7a-9b9f-4acf-b2e5-2c697260a51d tempest-VolumeSnapshotQuotasNegativeTestJSON-1072206583 None] Acquiring lock "cinder-quobyte-e5906ff7-7970-4e30-bcc2-6e954520b209" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:22:53 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-80776d7a-9b9f-4acf-b2e5-2c697260a51d tempest-VolumeSnapshotQuotasNegativeTestJSON-1072206583 None] Lock "cinder-quobyte-e5906ff7-7970-4e30-bcc2-6e954520b209" acquired by "delete_volume" :: waited 0.014s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:22:53 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b15232c-a295-421a-8b4a-64528aa02242]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:22:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-80776d7a-9b9f-4acf-b2e5-2c697260a51d tempest-VolumeSnapshotQuotasNegativeTestJSON-1072206583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e5906ff7-7970-4e30-bcc2-6e954520b209 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:22:53 devstack sudo[93398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e5906ff7-7970-4e30-bcc2-6e954520b209 Sep 16 20:22:53 devstack sudo[93398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:22:53 devstack sudo[93398]: pam_unix(sudo:session): session closed for user root Sep 16 20:22:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-80776d7a-9b9f-4acf-b2e5-2c697260a51d tempest-VolumeSnapshotQuotasNegativeTestJSON-1072206583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e5906ff7-7970-4e30-bcc2-6e954520b209" returned: 0 in 0.359s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:22:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-80776d7a-9b9f-4acf-b2e5-2c697260a51d tempest-VolumeSnapshotQuotasNegativeTestJSON-1072206583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e5906ff7-7970-4e30-bcc2-6e954520b209 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:22:53 devstack sudo[93403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e5906ff7-7970-4e30-bcc2-6e954520b209 Sep 16 20:22:53 devstack sudo[93403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:22:54 devstack sudo[93403]: pam_unix(sudo:session): session closed for user root Sep 16 20:22:54 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-80776d7a-9b9f-4acf-b2e5-2c697260a51d tempest-VolumeSnapshotQuotasNegativeTestJSON-1072206583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e5906ff7-7970-4e30-bcc2-6e954520b209" returned: 0 in 0.254s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:22:54 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-80776d7a-9b9f-4acf-b2e5-2c697260a51d tempest-VolumeSnapshotQuotasNegativeTestJSON-1072206583 None] Lock "cinder-quobyte-e5906ff7-7970-4e30-bcc2-6e954520b209" released by "delete_volume" :: held 0.679s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:22:54 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-80776d7a-9b9f-4acf-b2e5-2c697260a51d tempest-VolumeSnapshotQuotasNegativeTestJSON-1072206583 None] Created reservations ['24b24d4b-acdc-4d68-81ec-f6bb54eaba9e', '09b1a9fe-c72c-4c47-9ad2-034f088c6b39', 'ff48037a-1ec4-42ef-9793-183800dfe7dc', 'faa134c3-b70a-4200-9f72-1c123edd848f'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:22:54 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-80776d7a-9b9f-4acf-b2e5-2c697260a51d tempest-VolumeSnapshotQuotasNegativeTestJSON-1072206583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:22:54 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-80776d7a-9b9f-4acf-b2e5-2c697260a51d tempest-VolumeSnapshotQuotasNegativeTestJSON-1072206583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:22:54 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-80776d7a-9b9f-4acf-b2e5-2c697260a51d tempest-VolumeSnapshotQuotasNegativeTestJSON-1072206583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:22:54 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-80776d7a-9b9f-4acf-b2e5-2c697260a51d tempest-VolumeSnapshotQuotasNegativeTestJSON-1072206583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:22:54 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-80776d7a-9b9f-4acf-b2e5-2c697260a51d tempest-VolumeSnapshotQuotasNegativeTestJSON-1072206583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:22:54 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-80776d7a-9b9f-4acf-b2e5-2c697260a51d tempest-VolumeSnapshotQuotasNegativeTestJSON-1072206583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:22:54 devstack sudo[93406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:22:54 devstack sudo[93406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:22:54 devstack sudo[93406]: pam_unix(sudo:session): session closed for user root Sep 16 20:22:54 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-80776d7a-9b9f-4acf-b2e5-2c697260a51d tempest-VolumeSnapshotQuotasNegativeTestJSON-1072206583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.255s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:22:54 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-80776d7a-9b9f-4acf-b2e5-2c697260a51d tempest-VolumeSnapshotQuotasNegativeTestJSON-1072206583 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:22:54 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-80776d7a-9b9f-4acf-b2e5-2c697260a51d tempest-VolumeSnapshotQuotasNegativeTestJSON-1072206583 None] Deleted volume successfully. Sep 16 20:22:54 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-80776d7a-9b9f-4acf-b2e5-2c697260a51d tempest-VolumeSnapshotQuotasNegativeTestJSON-1072206583 None] Lock "cinder-e5906ff7-7970-4e30-bcc2-6e954520b209-delete_volume" released by "delete_volume" :: held 1.172s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:23:02 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ad0fe5c-ad95-458d-b960-a8cfe43be2e0 tempest-VolumeTypesAccessTest-62828296 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:23:02 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-2ad0fe5c-ad95-458d-b960-a8cfe43be2e0 tempest-VolumeTypesAccessTest-62828296 None] Flow 'volume_create_manager' (0906a567-3348-4c6a-a2ab-a248882dd3b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:23:02 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-2ad0fe5c-ad95-458d-b960-a8cfe43be2e0 tempest-VolumeTypesAccessTest-62828296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36b73765-5e29-4cff-b861-058c89afbae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:23:02 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-2ad0fe5c-ad95-458d-b960-a8cfe43be2e0 tempest-VolumeTypesAccessTest-62828296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36b73765-5e29-4cff-b861-058c89afbae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:23:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-397986579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e15d0406-1211-4814-94ac-82f4db2427ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7181291df78b4651b2e45a45bb151e79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:23:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:23:03Z,use_quota=True,user_id='542c52a0ad9b48cf8892a9cbfd8c5c3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b8dbb2d-b823-413f-a67d-fe5e29e79cda),volume_type_id=9b8dbb2d-b823-413f-a67d-fe5e29e79cda)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:23:02 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-2ad0fe5c-ad95-458d-b960-a8cfe43be2e0 tempest-VolumeTypesAccessTest-62828296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4a2cdf5-e7d8-4c05-928d-1da6df2f546b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:23:02 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-2ad0fe5c-ad95-458d-b960-a8cfe43be2e0 tempest-VolumeTypesAccessTest-62828296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4a2cdf5-e7d8-4c05-928d-1da6df2f546b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:23:02 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-2ad0fe5c-ad95-458d-b960-a8cfe43be2e0 tempest-VolumeTypesAccessTest-62828296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2906670b-ae16-4d0a-8b1e-f01cbc09daa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:23:02 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-2ad0fe5c-ad95-458d-b960-a8cfe43be2e0 tempest-VolumeTypesAccessTest-62828296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2906670b-ae16-4d0a-8b1e-f01cbc09daa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e15d0406-1211-4814-94ac-82f4db2427ac', 'volume_name': 'volume-e15d0406-1211-4814-94ac-82f4db2427ac', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:23:02 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-2ad0fe5c-ad95-458d-b960-a8cfe43be2e0 tempest-VolumeTypesAccessTest-62828296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffcd686d-6a21-46c5-ba87-6e74f3f0b2a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:23:02 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-2ad0fe5c-ad95-458d-b960-a8cfe43be2e0 tempest-VolumeTypesAccessTest-62828296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffcd686d-6a21-46c5-ba87-6e74f3f0b2a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:23:02 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-2ad0fe5c-ad95-458d-b960-a8cfe43be2e0 tempest-VolumeTypesAccessTest-62828296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (213b48a1-b100-4515-a800-64139733ef10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:23:02 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-2ad0fe5c-ad95-458d-b960-a8cfe43be2e0 tempest-VolumeTypesAccessTest-62828296 None] Volume e15d0406-1211-4814-94ac-82f4db2427ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e15d0406-1211-4814-94ac-82f4db2427ac', 'volume_size': 1} Sep 16 20:23:02 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-2ad0fe5c-ad95-458d-b960-a8cfe43be2e0 tempest-VolumeTypesAccessTest-62828296 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:23:02 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-2ad0fe5c-ad95-458d-b960-a8cfe43be2e0 tempest-VolumeTypesAccessTest-62828296 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:23:02 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-2ad0fe5c-ad95-458d-b960-a8cfe43be2e0 tempest-VolumeTypesAccessTest-62828296 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:23:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-397986579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e15d0406-1211-4814-94ac-82f4db2427ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7181291df78b4651b2e45a45bb151e79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:23:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:23:03Z,use_quota=True,user_id='542c52a0ad9b48cf8892a9cbfd8c5c3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b8dbb2d-b823-413f-a67d-fe5e29e79cda),volume_type_id=9b8dbb2d-b823-413f-a67d-fe5e29e79cda)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:23:02 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-2ad0fe5c-ad95-458d-b960-a8cfe43be2e0 tempest-VolumeTypesAccessTest-62828296 None] Creating volume e15d0406-1211-4814-94ac-82f4db2427ac {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:23:02 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-2ad0fe5c-ad95-458d-b960-a8cfe43be2e0 tempest-VolumeTypesAccessTest-62828296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:23:02 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-2ad0fe5c-ad95-458d-b960-a8cfe43be2e0 tempest-VolumeTypesAccessTest-62828296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:23:02 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-2ad0fe5c-ad95-458d-b960-a8cfe43be2e0 tempest-VolumeTypesAccessTest-62828296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:23:02 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-2ad0fe5c-ad95-458d-b960-a8cfe43be2e0 tempest-VolumeTypesAccessTest-62828296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:23:02 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-2ad0fe5c-ad95-458d-b960-a8cfe43be2e0 tempest-VolumeTypesAccessTest-62828296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:23:02 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-2ad0fe5c-ad95-458d-b960-a8cfe43be2e0 tempest-VolumeTypesAccessTest-62828296 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:23:02 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-2ad0fe5c-ad95-458d-b960-a8cfe43be2e0 tempest-VolumeTypesAccessTest-62828296 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:23:02 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-2ad0fe5c-ad95-458d-b960-a8cfe43be2e0 tempest-VolumeTypesAccessTest-62828296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e15d0406-1211-4814-94ac-82f4db2427ac 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:23:02 devstack sudo[93511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e15d0406-1211-4814-94ac-82f4db2427ac 1073741824 Sep 16 20:23:02 devstack sudo[93511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:23:03 devstack sudo[93511]: pam_unix(sudo:session): session closed for user root Sep 16 20:23:03 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-2ad0fe5c-ad95-458d-b960-a8cfe43be2e0 tempest-VolumeTypesAccessTest-62828296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e15d0406-1211-4814-94ac-82f4db2427ac 1073741824" returned: 0 in 0.849s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:23:03 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-2ad0fe5c-ad95-458d-b960-a8cfe43be2e0 tempest-VolumeTypesAccessTest-62828296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e15d0406-1211-4814-94ac-82f4db2427ac {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:23:03 devstack sudo[93532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e15d0406-1211-4814-94ac-82f4db2427ac Sep 16 20:23:03 devstack sudo[93532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:23:04 devstack sudo[93532]: pam_unix(sudo:session): session closed for user root Sep 16 20:23:04 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-2ad0fe5c-ad95-458d-b960-a8cfe43be2e0 tempest-VolumeTypesAccessTest-62828296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e15d0406-1211-4814-94ac-82f4db2427ac" returned: 0 in 0.351s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:23:04 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-2ad0fe5c-ad95-458d-b960-a8cfe43be2e0 tempest-VolumeTypesAccessTest-62828296 None] <== create_volume: return (1285ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:23:04 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-2ad0fe5c-ad95-458d-b960-a8cfe43be2e0 tempest-VolumeTypesAccessTest-62828296 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.290s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:23:04 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-2ad0fe5c-ad95-458d-b960-a8cfe43be2e0 tempest-VolumeTypesAccessTest-62828296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (213b48a1-b100-4515-a800-64139733ef10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e15d0406-1211-4814-94ac-82f4db2427ac', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:23:04 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-2ad0fe5c-ad95-458d-b960-a8cfe43be2e0 tempest-VolumeTypesAccessTest-62828296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73964ec1-39df-462d-a03d-689d385aeb5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:23:04 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-2ad0fe5c-ad95-458d-b960-a8cfe43be2e0 tempest-VolumeTypesAccessTest-62828296 None] Volume volume-e15d0406-1211-4814-94ac-82f4db2427ac (e15d0406-1211-4814-94ac-82f4db2427ac): created successfully Sep 16 20:23:04 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-2ad0fe5c-ad95-458d-b960-a8cfe43be2e0 tempest-VolumeTypesAccessTest-62828296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73964ec1-39df-462d-a03d-689d385aeb5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:23:04 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-2ad0fe5c-ad95-458d-b960-a8cfe43be2e0 tempest-VolumeTypesAccessTest-62828296 None] Flow 'volume_create_manager' (0906a567-3348-4c6a-a2ab-a248882dd3b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:23:04 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-2ad0fe5c-ad95-458d-b960-a8cfe43be2e0 tempest-VolumeTypesAccessTest-62828296 None] Created volume successfully. Sep 16 20:23:04 devstack cinder-volume[86188]: INFO cinder.volume.manager [req-4833c83f-e595-4d5f-b871-c27354cd1718 req-bf89737e-fd37-4423-ab14-03cab03ac06e tempest-ServerActionsTestOtherA-1167936048 None] Terminate volume connection completed successfully. Sep 16 20:23:04 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [req-4833c83f-e595-4d5f-b871-c27354cd1718 req-bf89737e-fd37-4423-ab14-03cab03ac06e tempest-ServerActionsTestOtherA-1167936048 None] Deleting attachment 2d84a4e4-0b1f-49fd-84e0-fa5bc7228ade. {{(pid=86188) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 16 20:23:05 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-592d0170-f120-493a-b4aa-2076ce8da139 tempest-VolumeTypesAccessTest-62828296 None] Acquiring lock "cinder-e15d0406-1211-4814-94ac-82f4db2427ac-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:23:05 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-592d0170-f120-493a-b4aa-2076ce8da139 tempest-VolumeTypesAccessTest-62828296 None] Lock "cinder-e15d0406-1211-4814-94ac-82f4db2427ac-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:23:05 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-592d0170-f120-493a-b4aa-2076ce8da139 tempest-VolumeTypesAccessTest-62828296 None] Acquiring lock "cinder-quobyte-e15d0406-1211-4814-94ac-82f4db2427ac" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:23:05 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-592d0170-f120-493a-b4aa-2076ce8da139 tempest-VolumeTypesAccessTest-62828296 None] Lock "cinder-quobyte-e15d0406-1211-4814-94ac-82f4db2427ac" acquired by "delete_volume" :: waited 0.052s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:23:05 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[27753e83-aa4d-4a63-b68b-08480dbc98a5]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:23:05 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-592d0170-f120-493a-b4aa-2076ce8da139 tempest-VolumeTypesAccessTest-62828296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e15d0406-1211-4814-94ac-82f4db2427ac {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:23:05 devstack cinder-volume[86188]: DEBUG cinder.coordination [req-4833c83f-e595-4d5f-b871-c27354cd1718 req-ad81c8b1-eb67-4a47-a6a8-ac17df51e081 tempest-ServerActionsTestOtherA-1167936048 None] Acquiring lock "cinder-3570f169-4b45-4f1a-9476-11e57e5b87d4-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:23:05 devstack cinder-volume[86188]: DEBUG cinder.coordination [req-4833c83f-e595-4d5f-b871-c27354cd1718 req-ad81c8b1-eb67-4a47-a6a8-ac17df51e081 tempest-ServerActionsTestOtherA-1167936048 None] Lock "cinder-3570f169-4b45-4f1a-9476-11e57e5b87d4-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:23:05 devstack cinder-volume[86188]: DEBUG cinder.coordination [req-4833c83f-e595-4d5f-b871-c27354cd1718 req-ad81c8b1-eb67-4a47-a6a8-ac17df51e081 tempest-ServerActionsTestOtherA-1167936048 None] Acquiring lock "cinder-quobyte-3570f169-4b45-4f1a-9476-11e57e5b87d4" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:23:05 devstack cinder-volume[86188]: DEBUG cinder.coordination [req-4833c83f-e595-4d5f-b871-c27354cd1718 req-ad81c8b1-eb67-4a47-a6a8-ac17df51e081 tempest-ServerActionsTestOtherA-1167936048 None] Lock "cinder-quobyte-3570f169-4b45-4f1a-9476-11e57e5b87d4" acquired by "delete_volume" :: waited 0.031s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:23:05 devstack sudo[93547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e15d0406-1211-4814-94ac-82f4db2427ac Sep 16 20:23:05 devstack sudo[93547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:23:05 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[61741939-b0f0-4532-873e-0373a0f0a0ad]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:23:05 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [req-4833c83f-e595-4d5f-b871-c27354cd1718 req-ad81c8b1-eb67-4a47-a6a8-ac17df51e081 tempest-ServerActionsTestOtherA-1167936048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-3570f169-4b45-4f1a-9476-11e57e5b87d4 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:23:05 devstack sudo[93552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-3570f169-4b45-4f1a-9476-11e57e5b87d4 Sep 16 20:23:05 devstack sudo[93552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:23:05 devstack sudo[93547]: pam_unix(sudo:session): session closed for user root Sep 16 20:23:05 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-592d0170-f120-493a-b4aa-2076ce8da139 tempest-VolumeTypesAccessTest-62828296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e15d0406-1211-4814-94ac-82f4db2427ac" returned: 0 in 0.738s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:23:05 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-592d0170-f120-493a-b4aa-2076ce8da139 tempest-VolumeTypesAccessTest-62828296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e15d0406-1211-4814-94ac-82f4db2427ac {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:23:06 devstack sudo[93565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e15d0406-1211-4814-94ac-82f4db2427ac Sep 16 20:23:06 devstack sudo[93565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:23:06 devstack sudo[93552]: pam_unix(sudo:session): session closed for user root Sep 16 20:23:06 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [req-4833c83f-e595-4d5f-b871-c27354cd1718 req-ad81c8b1-eb67-4a47-a6a8-ac17df51e081 tempest-ServerActionsTestOtherA-1167936048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-3570f169-4b45-4f1a-9476-11e57e5b87d4" returned: 0 in 0.718s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:23:06 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [req-4833c83f-e595-4d5f-b871-c27354cd1718 req-ad81c8b1-eb67-4a47-a6a8-ac17df51e081 tempest-ServerActionsTestOtherA-1167936048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-3570f169-4b45-4f1a-9476-11e57e5b87d4 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:23:06 devstack sudo[93576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-3570f169-4b45-4f1a-9476-11e57e5b87d4 Sep 16 20:23:06 devstack sudo[93576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:23:06 devstack sudo[93565]: pam_unix(sudo:session): session closed for user root Sep 16 20:23:06 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-592d0170-f120-493a-b4aa-2076ce8da139 tempest-VolumeTypesAccessTest-62828296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e15d0406-1211-4814-94ac-82f4db2427ac" returned: 0 in 0.434s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:23:06 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-592d0170-f120-493a-b4aa-2076ce8da139 tempest-VolumeTypesAccessTest-62828296 None] Lock "cinder-quobyte-e15d0406-1211-4814-94ac-82f4db2427ac" released by "delete_volume" :: held 1.298s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:23:06 devstack cinder-volume[86188]: WARNING cinder.quota [None req-592d0170-f120-493a-b4aa-2076ce8da139 tempest-VolumeTypesAccessTest-62828296 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-621088344 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-621088344, it is now deprecated. Please use the default quota class for default quota. Sep 16 20:23:06 devstack cinder-volume[86188]: WARNING cinder.quota [None req-592d0170-f120-493a-b4aa-2076ce8da139 tempest-VolumeTypesAccessTest-62828296 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-621088344 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-621088344, it is now deprecated. Please use the default quota class for default quota. Sep 16 20:23:06 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-592d0170-f120-493a-b4aa-2076ce8da139 tempest-VolumeTypesAccessTest-62828296 None] Created reservations ['84f0e084-89b8-47a4-b06b-f4cc2b289d4a', '3713da4b-1e68-408d-9ac8-718b1dabd92f', 'd3e2608b-9655-491e-acb8-2c53045ef177', '2d74f859-65fd-44ef-af20-32eb901383ad'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:23:06 devstack sudo[93576]: pam_unix(sudo:session): session closed for user root Sep 16 20:23:06 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [req-4833c83f-e595-4d5f-b871-c27354cd1718 req-ad81c8b1-eb67-4a47-a6a8-ac17df51e081 tempest-ServerActionsTestOtherA-1167936048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-3570f169-4b45-4f1a-9476-11e57e5b87d4" returned: 0 in 0.474s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:23:06 devstack cinder-volume[86188]: DEBUG cinder.coordination [req-4833c83f-e595-4d5f-b871-c27354cd1718 req-ad81c8b1-eb67-4a47-a6a8-ac17df51e081 tempest-ServerActionsTestOtherA-1167936048 None] Lock "cinder-quobyte-3570f169-4b45-4f1a-9476-11e57e5b87d4" released by "delete_volume" :: held 1.278s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:23:06 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-592d0170-f120-493a-b4aa-2076ce8da139 tempest-VolumeTypesAccessTest-62828296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:23:06 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-592d0170-f120-493a-b4aa-2076ce8da139 tempest-VolumeTypesAccessTest-62828296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:23:06 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-592d0170-f120-493a-b4aa-2076ce8da139 tempest-VolumeTypesAccessTest-62828296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:23:06 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-592d0170-f120-493a-b4aa-2076ce8da139 tempest-VolumeTypesAccessTest-62828296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:23:06 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-592d0170-f120-493a-b4aa-2076ce8da139 tempest-VolumeTypesAccessTest-62828296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:23:06 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-592d0170-f120-493a-b4aa-2076ce8da139 tempest-VolumeTypesAccessTest-62828296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:23:06 devstack sudo[93586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:23:06 devstack sudo[93586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:23:06 devstack cinder-volume[86188]: DEBUG cinder.quota [req-4833c83f-e595-4d5f-b871-c27354cd1718 req-ad81c8b1-eb67-4a47-a6a8-ac17df51e081 tempest-ServerActionsTestOtherA-1167936048 None] Created reservations ['6f50d36a-9ba7-404c-9b9f-9f526d0eba0d', '32157de1-d208-44a9-84aa-c9be50d85c21', 'c96377d0-a779-4087-a806-013056887eda', '8a20c28a-a308-4823-9747-2e267a39eba3'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:23:06 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-78e921f4-a582-417f-a67e-da786ed0eff0 tempest-ServerActionsTestOtherA-1167936048 None] Acquiring lock "cinder-32516f9b-5697-4c95-9c01-1437f6a72d4f-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:23:07 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-78e921f4-a582-417f-a67e-da786ed0eff0 tempest-ServerActionsTestOtherA-1167936048 None] Lock "cinder-32516f9b-5697-4c95-9c01-1437f6a72d4f-delete_volume" acquired by "delete_volume" :: waited 0.084s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:23:07 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-78e921f4-a582-417f-a67e-da786ed0eff0 tempest-ServerActionsTestOtherA-1167936048 None] Acquiring lock "cinder-quobyte-32516f9b-5697-4c95-9c01-1437f6a72d4f" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:23:07 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [req-4833c83f-e595-4d5f-b871-c27354cd1718 req-ad81c8b1-eb67-4a47-a6a8-ac17df51e081 tempest-ServerActionsTestOtherA-1167936048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:23:07 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [req-4833c83f-e595-4d5f-b871-c27354cd1718 req-ad81c8b1-eb67-4a47-a6a8-ac17df51e081 tempest-ServerActionsTestOtherA-1167936048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:23:07 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [req-4833c83f-e595-4d5f-b871-c27354cd1718 req-ad81c8b1-eb67-4a47-a6a8-ac17df51e081 tempest-ServerActionsTestOtherA-1167936048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:23:07 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [req-4833c83f-e595-4d5f-b871-c27354cd1718 req-ad81c8b1-eb67-4a47-a6a8-ac17df51e081 tempest-ServerActionsTestOtherA-1167936048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:23:07 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [req-4833c83f-e595-4d5f-b871-c27354cd1718 req-ad81c8b1-eb67-4a47-a6a8-ac17df51e081 tempest-ServerActionsTestOtherA-1167936048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:23:07 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [req-4833c83f-e595-4d5f-b871-c27354cd1718 req-ad81c8b1-eb67-4a47-a6a8-ac17df51e081 tempest-ServerActionsTestOtherA-1167936048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:23:07 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-78e921f4-a582-417f-a67e-da786ed0eff0 tempest-ServerActionsTestOtherA-1167936048 None] Lock "cinder-quobyte-32516f9b-5697-4c95-9c01-1437f6a72d4f" acquired by "delete_volume" :: waited 0.068s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:23:07 devstack sudo[93591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:23:07 devstack sudo[93591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:23:07 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc5d3ff8-2268-4c90-a202-f88f9ed23e6b]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:23:07 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-78e921f4-a582-417f-a67e-da786ed0eff0 tempest-ServerActionsTestOtherA-1167936048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-32516f9b-5697-4c95-9c01-1437f6a72d4f {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:23:07 devstack sudo[93586]: pam_unix(sudo:session): session closed for user root Sep 16 20:23:07 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-592d0170-f120-493a-b4aa-2076ce8da139 tempest-VolumeTypesAccessTest-62828296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.395s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:23:07 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-592d0170-f120-493a-b4aa-2076ce8da139 tempest-VolumeTypesAccessTest-62828296 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:23:07 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-592d0170-f120-493a-b4aa-2076ce8da139 tempest-VolumeTypesAccessTest-62828296 None] Deleted volume successfully. Sep 16 20:23:07 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-592d0170-f120-493a-b4aa-2076ce8da139 tempest-VolumeTypesAccessTest-62828296 None] Lock "cinder-e15d0406-1211-4814-94ac-82f4db2427ac-delete_volume" released by "delete_volume" :: held 2.301s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:23:07 devstack sudo[93594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-32516f9b-5697-4c95-9c01-1437f6a72d4f Sep 16 20:23:07 devstack sudo[93594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:23:07 devstack sudo[93591]: pam_unix(sudo:session): session closed for user root Sep 16 20:23:07 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [req-4833c83f-e595-4d5f-b871-c27354cd1718 req-ad81c8b1-eb67-4a47-a6a8-ac17df51e081 tempest-ServerActionsTestOtherA-1167936048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.347s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:23:07 devstack cinder-volume[86188]: DEBUG cinder.manager [req-4833c83f-e595-4d5f-b871-c27354cd1718 req-ad81c8b1-eb67-4a47-a6a8-ac17df51e081 tempest-ServerActionsTestOtherA-1167936048 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:23:07 devstack cinder-volume[86188]: INFO cinder.volume.manager [req-4833c83f-e595-4d5f-b871-c27354cd1718 req-ad81c8b1-eb67-4a47-a6a8-ac17df51e081 tempest-ServerActionsTestOtherA-1167936048 None] Deleted volume successfully. Sep 16 20:23:07 devstack cinder-volume[86188]: DEBUG cinder.coordination [req-4833c83f-e595-4d5f-b871-c27354cd1718 req-ad81c8b1-eb67-4a47-a6a8-ac17df51e081 tempest-ServerActionsTestOtherA-1167936048 None] Lock "cinder-3570f169-4b45-4f1a-9476-11e57e5b87d4-delete_volume" released by "delete_volume" :: held 2.186s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:23:07 devstack sudo[93594]: pam_unix(sudo:session): session closed for user root Sep 16 20:23:07 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-78e921f4-a582-417f-a67e-da786ed0eff0 tempest-ServerActionsTestOtherA-1167936048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-32516f9b-5697-4c95-9c01-1437f6a72d4f" returned: 0 in 0.595s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:23:07 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-78e921f4-a582-417f-a67e-da786ed0eff0 tempest-ServerActionsTestOtherA-1167936048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-32516f9b-5697-4c95-9c01-1437f6a72d4f {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:23:07 devstack sudo[93600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-32516f9b-5697-4c95-9c01-1437f6a72d4f Sep 16 20:23:07 devstack sudo[93600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:23:08 devstack sudo[93600]: pam_unix(sudo:session): session closed for user root Sep 16 20:23:08 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-78e921f4-a582-417f-a67e-da786ed0eff0 tempest-ServerActionsTestOtherA-1167936048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-32516f9b-5697-4c95-9c01-1437f6a72d4f" returned: 0 in 0.347s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:23:08 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-78e921f4-a582-417f-a67e-da786ed0eff0 tempest-ServerActionsTestOtherA-1167936048 None] Lock "cinder-quobyte-32516f9b-5697-4c95-9c01-1437f6a72d4f" released by "delete_volume" :: held 1.023s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:23:08 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-78e921f4-a582-417f-a67e-da786ed0eff0 tempest-ServerActionsTestOtherA-1167936048 None] Created reservations ['175a4401-8620-41c9-83d6-ceda4a0fde99', '8c1b035b-03f2-43ad-a7c7-5c0e19570484', '86913da0-54c5-4ca5-b8a6-1f567b82c890', '991ed9d0-96ee-4d9a-b115-bd34ce6430ea'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:23:08 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-78e921f4-a582-417f-a67e-da786ed0eff0 tempest-ServerActionsTestOtherA-1167936048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:23:08 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-78e921f4-a582-417f-a67e-da786ed0eff0 tempest-ServerActionsTestOtherA-1167936048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:23:08 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-78e921f4-a582-417f-a67e-da786ed0eff0 tempest-ServerActionsTestOtherA-1167936048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:23:08 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-78e921f4-a582-417f-a67e-da786ed0eff0 tempest-ServerActionsTestOtherA-1167936048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:23:08 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-78e921f4-a582-417f-a67e-da786ed0eff0 tempest-ServerActionsTestOtherA-1167936048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:23:08 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-78e921f4-a582-417f-a67e-da786ed0eff0 tempest-ServerActionsTestOtherA-1167936048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:23:08 devstack sudo[93603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:23:08 devstack sudo[93603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:23:08 devstack sudo[93603]: pam_unix(sudo:session): session closed for user root Sep 16 20:23:08 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-78e921f4-a582-417f-a67e-da786ed0eff0 tempest-ServerActionsTestOtherA-1167936048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.262s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:23:08 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-78e921f4-a582-417f-a67e-da786ed0eff0 tempest-ServerActionsTestOtherA-1167936048 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:23:08 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-78e921f4-a582-417f-a67e-da786ed0eff0 tempest-ServerActionsTestOtherA-1167936048 None] Deleted volume successfully. Sep 16 20:23:08 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-78e921f4-a582-417f-a67e-da786ed0eff0 tempest-ServerActionsTestOtherA-1167936048 None] Lock "cinder-32516f9b-5697-4c95-9c01-1437f6a72d4f-delete_volume" released by "delete_volume" :: held 1.595s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:23:14 devstack cinder-volume[86188]: INFO cinder.volume.manager [req-f925c8ac-03ce-4d01-86b7-1883551a215f req-a6fa35ba-8078-4f9b-b331-ea53e917f6ab tempest-AttachVolumeTestJSON-1467622944 None] Terminate volume connection completed successfully. Sep 16 20:23:14 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [req-f925c8ac-03ce-4d01-86b7-1883551a215f req-a6fa35ba-8078-4f9b-b331-ea53e917f6ab tempest-AttachVolumeTestJSON-1467622944 None] Deleting attachment f9e0c1db-d2a4-4d73-b238-d973fcd3b5f9. {{(pid=86188) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 16 20:23:24 devstack cinder-volume[86188]: DEBUG dbcounter [-] [86188] Writing DB stats cinder:SELECT=48,cinder:INSERT=13,cinder:UPDATE=49,cinder:DELETE=2 {{(pid=86188) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 20:23:24 devstack cinder-volume[86188]: DEBUG dbcounter [-] [86188] Writing DB stats cinder:UPDATE=51,cinder:SELECT=42,cinder:DELETE=6,cinder:INSERT=11 {{(pid=86188) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 20:23:25 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2d40225-05cc-47f9-917e-8d46f52c6509 tempest-VolumesExtendTest-351274990 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:23:25 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f2d40225-05cc-47f9-917e-8d46f52c6509 tempest-VolumesExtendTest-351274990 None] Flow 'volume_create_manager' (47020d0f-3df9-4810-9960-67d96ab9e9cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:23:25 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f2d40225-05cc-47f9-917e-8d46f52c6509 tempest-VolumesExtendTest-351274990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (859321d4-63a4-4209-8b6f-02b384c32e35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:23:25 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f2d40225-05cc-47f9-917e-8d46f52c6509 tempest-VolumesExtendTest-351274990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (859321d4-63a4-4209-8b6f-02b384c32e35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:23:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-463945969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65415a7c-d0ab-4799-8000-81f264d0c3a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ec376806b43461cb9c111639eb31034',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:23:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:23:25Z,use_quota=True,user_id='c934655d636c418591e0ece6c4db23cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:23:25 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f2d40225-05cc-47f9-917e-8d46f52c6509 tempest-VolumesExtendTest-351274990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31535de2-43d1-4a65-96f7-aa19a99caf97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:23:25 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f2d40225-05cc-47f9-917e-8d46f52c6509 tempest-VolumesExtendTest-351274990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31535de2-43d1-4a65-96f7-aa19a99caf97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:23:25 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f2d40225-05cc-47f9-917e-8d46f52c6509 tempest-VolumesExtendTest-351274990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45097f0d-761a-465e-958e-fb03af72e39a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:23:25 devstack cinder-volume[86188]: DEBUG cinder.image.glance [None req-f2d40225-05cc-47f9-917e-8d46f52c6509 tempest-VolumesExtendTest-351274990 None] Creating Keystone auth plugin from conf {{(pid=86188) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 16 20:23:25 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f2d40225-05cc-47f9-917e-8d46f52c6509 tempest-VolumesExtendTest-351274990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45097f0d-761a-465e-958e-fb03af72e39a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '65415a7c-d0ab-4799-8000-81f264d0c3a4', 'volume_name': 'volume-65415a7c-d0ab-4799-8000-81f264d0c3a4', 'volume_size': 1, 'image_id': 'b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5c9c8eab814247029b6d508a74a1d19e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e', 'created_at': datetime.datetime(2026, 9, 16, 18, 12, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 18, 12, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:23:25 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f2d40225-05cc-47f9-917e-8d46f52c6509 tempest-VolumesExtendTest-351274990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b83776a-91e1-4261-9392-3b65f2dbd45e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:23:25 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f2d40225-05cc-47f9-917e-8d46f52c6509 tempest-VolumesExtendTest-351274990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b83776a-91e1-4261-9392-3b65f2dbd45e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:23:25 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f2d40225-05cc-47f9-917e-8d46f52c6509 tempest-VolumesExtendTest-351274990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46c8bcec-39d0-49ac-9233-81c6919ad174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:23:25 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-f2d40225-05cc-47f9-917e-8d46f52c6509 tempest-VolumesExtendTest-351274990 None] Volume 65415a7c-d0ab-4799-8000-81f264d0c3a4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-65415a7c-d0ab-4799-8000-81f264d0c3a4', 'volume_size': 1, 'image_id': 'b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5c9c8eab814247029b6d508a74a1d19e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e', 'created_at': datetime.datetime(2026, 9, 16, 18, 12, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 18, 12, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 16 20:23:25 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2d40225-05cc-47f9-917e-8d46f52c6509 tempest-VolumesExtendTest-351274990 None] Trying to clone 65415a7c-d0ab-4799-8000-81f264d0c3a4 from image b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e at location (None, [{'url': 'file:///opt/stack/data/glance/images/b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e', 'metadata': {}}]). {{(pid=86188) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 16 20:23:25 devstack cinder-volume[86188]: DEBUG cinder.image.image_utils [None req-f2d40225-05cc-47f9-917e-8d46f52c6509 tempest-VolumesExtendTest-351274990 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e_j5_yovj7devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86188) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 16 20:23:25 devstack cinder-volume[86188]: INFO cinder.image.image_utils [None req-f2d40225-05cc-47f9-917e-8d46f52c6509 tempest-VolumesExtendTest-351274990 None] Image download 20.69 MB at 20.69 MB/s Sep 16 20:23:26 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[f32dffd4-cd25-4417-9fb7-18cf5d65c3a3]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:23:26 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f2d40225-05cc-47f9-917e-8d46f52c6509 tempest-VolumesExtendTest-351274990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e_j5_yovj7devstack@QuobyteHD {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:23:26 devstack sudo[93768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e_j5_yovj7devstack@QuobyteHD Sep 16 20:23:26 devstack sudo[93768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:23:26 devstack sudo[93768]: pam_unix(sudo:session): session closed for user root Sep 16 20:23:26 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f2d40225-05cc-47f9-917e-8d46f52c6509 tempest-VolumesExtendTest-351274990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e_j5_yovj7devstack@QuobyteHD" returned: 0 in 0.396s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:23:26 devstack cinder-volume[86188]: DEBUG cinder.image.image_utils [None req-f2d40225-05cc-47f9-917e-8d46f52c6509 tempest-VolumesExtendTest-351274990 None] Temporary image b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e is fetched for user c934655d636c418591e0ece6c4db23cd. {{(pid=86188) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 16 20:23:26 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b58f838-566f-4000-821c-3ce9b7952118]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:23:26 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f2d40225-05cc-47f9-917e-8d46f52c6509 tempest-VolumesExtendTest-351274990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e_j5_yovj7devstack@QuobyteHD {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:23:26 devstack sudo[93775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e_j5_yovj7devstack@QuobyteHD Sep 16 20:23:26 devstack sudo[93775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:23:27 devstack sudo[93775]: pam_unix(sudo:session): session closed for user root Sep 16 20:23:27 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f2d40225-05cc-47f9-917e-8d46f52c6509 tempest-VolumesExtendTest-351274990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e_j5_yovj7devstack@QuobyteHD" returned: 0 in 0.523s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:23:27 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-f2d40225-05cc-47f9-917e-8d46f52c6509 tempest-VolumesExtendTest-351274990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:23:27 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-f2d40225-05cc-47f9-917e-8d46f52c6509 tempest-VolumesExtendTest-351274990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:23:27 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-f2d40225-05cc-47f9-917e-8d46f52c6509 tempest-VolumesExtendTest-351274990 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:23:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-463945969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65415a7c-d0ab-4799-8000-81f264d0c3a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ec376806b43461cb9c111639eb31034',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:23:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:23:25Z,use_quota=True,user_id='c934655d636c418591e0ece6c4db23cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:23:27 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-f2d40225-05cc-47f9-917e-8d46f52c6509 tempest-VolumesExtendTest-351274990 None] Creating volume 65415a7c-d0ab-4799-8000-81f264d0c3a4 {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:23:27 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-f2d40225-05cc-47f9-917e-8d46f52c6509 tempest-VolumesExtendTest-351274990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:23:27 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-f2d40225-05cc-47f9-917e-8d46f52c6509 tempest-VolumesExtendTest-351274990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:23:27 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-f2d40225-05cc-47f9-917e-8d46f52c6509 tempest-VolumesExtendTest-351274990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:23:27 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-f2d40225-05cc-47f9-917e-8d46f52c6509 tempest-VolumesExtendTest-351274990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:23:27 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-f2d40225-05cc-47f9-917e-8d46f52c6509 tempest-VolumesExtendTest-351274990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:23:27 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-f2d40225-05cc-47f9-917e-8d46f52c6509 tempest-VolumesExtendTest-351274990 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:23:27 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-f2d40225-05cc-47f9-917e-8d46f52c6509 tempest-VolumesExtendTest-351274990 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:23:27 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f2d40225-05cc-47f9-917e-8d46f52c6509 tempest-VolumesExtendTest-351274990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-65415a7c-d0ab-4799-8000-81f264d0c3a4 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:23:27 devstack sudo[93780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-65415a7c-d0ab-4799-8000-81f264d0c3a4 1073741824 Sep 16 20:23:27 devstack sudo[93780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:23:27 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-0aa3818e-5770-49b8-a543-70e94b9b6347 tempest-AttachVolumeNegativeTest-1537838471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:23:27 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-0aa3818e-5770-49b8-a543-70e94b9b6347 tempest-AttachVolumeNegativeTest-1537838471 None] Flow 'volume_create_manager' (4cabbe46-167c-478e-94e7-13d61ecfff26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:23:27 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-0aa3818e-5770-49b8-a543-70e94b9b6347 tempest-AttachVolumeNegativeTest-1537838471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef7a0586-a08f-4c9e-8406-8a16f58e338a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:23:27 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-0aa3818e-5770-49b8-a543-70e94b9b6347 tempest-AttachVolumeNegativeTest-1537838471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef7a0586-a08f-4c9e-8406-8a16f58e338a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:23:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2107659844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6aebae9c-796e-4361-8fa7-160435ddad1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3587d449fe5c467ba11ccf39851d1fc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:23:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:23:27Z,use_quota=True,user_id='426ad78a563445bb95108bdfd4bd10e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:23:27 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-0aa3818e-5770-49b8-a543-70e94b9b6347 tempest-AttachVolumeNegativeTest-1537838471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01286ef8-b8ca-4412-82af-13a574d1de0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:23:27 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-0aa3818e-5770-49b8-a543-70e94b9b6347 tempest-AttachVolumeNegativeTest-1537838471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01286ef8-b8ca-4412-82af-13a574d1de0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:23:27 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-0aa3818e-5770-49b8-a543-70e94b9b6347 tempest-AttachVolumeNegativeTest-1537838471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d4ac307-9393-4e11-9211-65f624778f53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:23:27 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-0aa3818e-5770-49b8-a543-70e94b9b6347 tempest-AttachVolumeNegativeTest-1537838471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d4ac307-9393-4e11-9211-65f624778f53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6aebae9c-796e-4361-8fa7-160435ddad1b', 'volume_name': 'volume-6aebae9c-796e-4361-8fa7-160435ddad1b', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:23:27 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-0aa3818e-5770-49b8-a543-70e94b9b6347 tempest-AttachVolumeNegativeTest-1537838471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3abec9d0-bb84-4367-9e45-58c41910ba41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:23:27 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-0aa3818e-5770-49b8-a543-70e94b9b6347 tempest-AttachVolumeNegativeTest-1537838471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3abec9d0-bb84-4367-9e45-58c41910ba41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:23:27 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-0aa3818e-5770-49b8-a543-70e94b9b6347 tempest-AttachVolumeNegativeTest-1537838471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9305ceb9-e1c7-4ebd-8e09-c94af5eb180a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:23:27 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-0aa3818e-5770-49b8-a543-70e94b9b6347 tempest-AttachVolumeNegativeTest-1537838471 None] Volume 6aebae9c-796e-4361-8fa7-160435ddad1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6aebae9c-796e-4361-8fa7-160435ddad1b', 'volume_size': 1} Sep 16 20:23:27 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-0aa3818e-5770-49b8-a543-70e94b9b6347 tempest-AttachVolumeNegativeTest-1537838471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:23:27 devstack sudo[93780]: pam_unix(sudo:session): session closed for user root Sep 16 20:23:27 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f2d40225-05cc-47f9-917e-8d46f52c6509 tempest-VolumesExtendTest-351274990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-65415a7c-d0ab-4799-8000-81f264d0c3a4 1073741824" returned: 0 in 0.582s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:23:27 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f2d40225-05cc-47f9-917e-8d46f52c6509 tempest-VolumesExtendTest-351274990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-65415a7c-d0ab-4799-8000-81f264d0c3a4 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:23:27 devstack sudo[93787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-65415a7c-d0ab-4799-8000-81f264d0c3a4 Sep 16 20:23:27 devstack sudo[93787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:23:28 devstack sudo[93787]: pam_unix(sudo:session): session closed for user root Sep 16 20:23:28 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f2d40225-05cc-47f9-917e-8d46f52c6509 tempest-VolumesExtendTest-351274990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-65415a7c-d0ab-4799-8000-81f264d0c3a4" returned: 0 in 0.409s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:23:28 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-f2d40225-05cc-47f9-917e-8d46f52c6509 tempest-VolumesExtendTest-351274990 None] <== create_volume: return (1105ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:23:28 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-f2d40225-05cc-47f9-917e-8d46f52c6509 tempest-VolumesExtendTest-351274990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.110s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:23:28 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-0aa3818e-5770-49b8-a543-70e94b9b6347 tempest-AttachVolumeNegativeTest-1537838471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.829s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:23:28 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-0aa3818e-5770-49b8-a543-70e94b9b6347 tempest-AttachVolumeNegativeTest-1537838471 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:23:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2107659844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6aebae9c-796e-4361-8fa7-160435ddad1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3587d449fe5c467ba11ccf39851d1fc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:23:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:23:27Z,use_quota=True,user_id='426ad78a563445bb95108bdfd4bd10e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:23:28 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-0aa3818e-5770-49b8-a543-70e94b9b6347 tempest-AttachVolumeNegativeTest-1537838471 None] Creating volume 6aebae9c-796e-4361-8fa7-160435ddad1b {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:23:28 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-0aa3818e-5770-49b8-a543-70e94b9b6347 tempest-AttachVolumeNegativeTest-1537838471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:23:28 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-0aa3818e-5770-49b8-a543-70e94b9b6347 tempest-AttachVolumeNegativeTest-1537838471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:23:28 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-0aa3818e-5770-49b8-a543-70e94b9b6347 tempest-AttachVolumeNegativeTest-1537838471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:23:28 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-0aa3818e-5770-49b8-a543-70e94b9b6347 tempest-AttachVolumeNegativeTest-1537838471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:23:28 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-0aa3818e-5770-49b8-a543-70e94b9b6347 tempest-AttachVolumeNegativeTest-1537838471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:23:28 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-0aa3818e-5770-49b8-a543-70e94b9b6347 tempest-AttachVolumeNegativeTest-1537838471 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:23:28 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-0aa3818e-5770-49b8-a543-70e94b9b6347 tempest-AttachVolumeNegativeTest-1537838471 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:23:28 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-0aa3818e-5770-49b8-a543-70e94b9b6347 tempest-AttachVolumeNegativeTest-1537838471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-6aebae9c-796e-4361-8fa7-160435ddad1b 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:23:28 devstack cinder-volume[86188]: DEBUG cinder.volume.volume_utils [None req-f2d40225-05cc-47f9-917e-8d46f52c6509 tempest-VolumesExtendTest-351274990 None] Attempting download of b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e ((None, [{'url': 'file:///opt/stack/data/glance/images/b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e', 'metadata': {}}])) to volume 65415a7c-d0ab-4799-8000-81f264d0c3a4. {{(pid=86188) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 16 20:23:28 devstack sudo[93790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-6aebae9c-796e-4361-8fa7-160435ddad1b 1073741824 Sep 16 20:23:28 devstack sudo[93790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:23:28 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4c0e098-2cd1-486d-8f65-4e8998a6cdd2]: (4, 'raw') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:23:28 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f2d40225-05cc-47f9-917e-8d46f52c6509 tempest-VolumesExtendTest-351274990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e_w0vu15ae {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:23:28 devstack sudo[93792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e_w0vu15ae Sep 16 20:23:28 devstack sudo[93792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:23:28 devstack sudo[93790]: pam_unix(sudo:session): session closed for user root Sep 16 20:23:28 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-0aa3818e-5770-49b8-a543-70e94b9b6347 tempest-AttachVolumeNegativeTest-1537838471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-6aebae9c-796e-4361-8fa7-160435ddad1b 1073741824" returned: 0 in 0.609s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:23:28 devstack sudo[93792]: pam_unix(sudo:session): session closed for user root Sep 16 20:23:28 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f2d40225-05cc-47f9-917e-8d46f52c6509 tempest-VolumesExtendTest-351274990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e_w0vu15ae" returned: 0 in 0.512s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:23:28 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f2d40225-05cc-47f9-917e-8d46f52c6509 tempest-VolumesExtendTest-351274990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e_w0vu15ae {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:23:28 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-0aa3818e-5770-49b8-a543-70e94b9b6347 tempest-AttachVolumeNegativeTest-1537838471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-6aebae9c-796e-4361-8fa7-160435ddad1b {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:23:28 devstack sudo[93802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-6aebae9c-796e-4361-8fa7-160435ddad1b Sep 16 20:23:28 devstack sudo[93802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:23:29 devstack sudo[93801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e_w0vu15ae Sep 16 20:23:29 devstack sudo[93801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:23:29 devstack sudo[93802]: pam_unix(sudo:session): session closed for user root Sep 16 20:23:29 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-0aa3818e-5770-49b8-a543-70e94b9b6347 tempest-AttachVolumeNegativeTest-1537838471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-6aebae9c-796e-4361-8fa7-160435ddad1b" returned: 0 in 0.407s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:23:29 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-0aa3818e-5770-49b8-a543-70e94b9b6347 tempest-AttachVolumeNegativeTest-1537838471 None] <== create_volume: return (1126ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:23:29 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-0aa3818e-5770-49b8-a543-70e94b9b6347 tempest-AttachVolumeNegativeTest-1537838471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.130s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:23:29 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-0aa3818e-5770-49b8-a543-70e94b9b6347 tempest-AttachVolumeNegativeTest-1537838471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9305ceb9-e1c7-4ebd-8e09-c94af5eb180a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6aebae9c-796e-4361-8fa7-160435ddad1b', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:23:29 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-0aa3818e-5770-49b8-a543-70e94b9b6347 tempest-AttachVolumeNegativeTest-1537838471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (199f21ad-fdad-4450-b5c0-428d65cddb5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:23:29 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-0aa3818e-5770-49b8-a543-70e94b9b6347 tempest-AttachVolumeNegativeTest-1537838471 None] Volume volume-6aebae9c-796e-4361-8fa7-160435ddad1b (6aebae9c-796e-4361-8fa7-160435ddad1b): created successfully Sep 16 20:23:29 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-0aa3818e-5770-49b8-a543-70e94b9b6347 tempest-AttachVolumeNegativeTest-1537838471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (199f21ad-fdad-4450-b5c0-428d65cddb5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:23:29 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-0aa3818e-5770-49b8-a543-70e94b9b6347 tempest-AttachVolumeNegativeTest-1537838471 None] Flow 'volume_create_manager' (4cabbe46-167c-478e-94e7-13d61ecfff26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:23:29 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-0aa3818e-5770-49b8-a543-70e94b9b6347 tempest-AttachVolumeNegativeTest-1537838471 None] Created volume successfully. Sep 16 20:23:29 devstack sudo[93801]: pam_unix(sudo:session): session closed for user root Sep 16 20:23:29 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f2d40225-05cc-47f9-917e-8d46f52c6509 tempest-VolumesExtendTest-351274990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e_w0vu15ae" returned: 1 in 0.686s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:23:29 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f2d40225-05cc-47f9-917e-8d46f52c6509 tempest-VolumesExtendTest-351274990 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e_w0vu15ae' failed. Not Retrying. {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 16 20:23:29 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[18199e14-7e6b-4c71-b7d8-0ee81c2bcb2e]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:23:29 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f2d40225-05cc-47f9-917e-8d46f52c6509 tempest-VolumesExtendTest-351274990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e_j5_yovj7devstack@QuobyteHD {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:23:29 devstack sudo[93808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e_j5_yovj7devstack@QuobyteHD Sep 16 20:23:29 devstack sudo[93808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:23:30 devstack sudo[93808]: pam_unix(sudo:session): session closed for user root Sep 16 20:23:30 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f2d40225-05cc-47f9-917e-8d46f52c6509 tempest-VolumesExtendTest-351274990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e_j5_yovj7devstack@QuobyteHD" returned: 0 in 0.528s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:23:30 devstack cinder-volume[86188]: DEBUG cinder.image.image_utils [None req-f2d40225-05cc-47f9-917e-8d46f52c6509 tempest-VolumesExtendTest-351274990 None] b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e was qcow2, converting to qcow2 {{(pid=86188) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 16 20:23:30 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f2d40225-05cc-47f9-917e-8d46f52c6509 tempest-VolumesExtendTest-351274990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e_j5_yovj7devstack@QuobyteHD /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-65415a7c-d0ab-4799-8000-81f264d0c3a4 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:23:30 devstack sudo[93813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e_j5_yovj7devstack@QuobyteHD /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-65415a7c-d0ab-4799-8000-81f264d0c3a4 Sep 16 20:23:30 devstack sudo[93813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:23:32 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [req-2ddc2a85-d82b-49e8-982a-6b6fd0c46300 req-0092bdec-eeb1-4439-92f7-ae33097a4966 tempest-AttachVolumeNegativeTest-1537838471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:23:32 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [req-2ddc2a85-d82b-49e8-982a-6b6fd0c46300 req-0092bdec-eeb1-4439-92f7-ae33097a4966 tempest-AttachVolumeNegativeTest-1537838471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:23:32 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [req-2ddc2a85-d82b-49e8-982a-6b6fd0c46300 req-0092bdec-eeb1-4439-92f7-ae33097a4966 tempest-AttachVolumeNegativeTest-1537838471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:23:32 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [req-2ddc2a85-d82b-49e8-982a-6b6fd0c46300 req-0092bdec-eeb1-4439-92f7-ae33097a4966 tempest-AttachVolumeNegativeTest-1537838471 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81', 'name': 'volume-6aebae9c-796e-4361-8fa7-160435ddad1b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c193f1d5-6a6a-4357-9b97-97c98082b1a0', 'enforce_multipath': True} {{(pid=86188) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 16 20:23:32 devstack cinder-volume[86188]: INFO cinder.volume.manager [req-2ddc2a85-d82b-49e8-982a-6b6fd0c46300 req-0092bdec-eeb1-4439-92f7-ae33097a4966 tempest-AttachVolumeNegativeTest-1537838471 None] attachment_update completed successfully. Sep 16 20:23:33 devstack sudo[93813]: pam_unix(sudo:session): session closed for user root Sep 16 20:23:33 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f2d40225-05cc-47f9-917e-8d46f52c6509 tempest-VolumesExtendTest-351274990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e_j5_yovj7devstack@QuobyteHD /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-65415a7c-d0ab-4799-8000-81f264d0c3a4" returned: 0 in 3.107s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:23:33 devstack cinder-volume[86188]: DEBUG cinder.image.image_utils [None req-f2d40225-05cc-47f9-917e-8d46f52c6509 tempest-VolumesExtendTest-351274990 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e_j5_yovj7devstack@QuobyteHD, size 112.00 MB, duration 3.11 sec, destination /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-65415a7c-d0ab-4799-8000-81f264d0c3a4 {{(pid=86188) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 16 20:23:33 devstack cinder-volume[86188]: INFO cinder.image.image_utils [None req-f2d40225-05cc-47f9-917e-8d46f52c6509 tempest-VolumesExtendTest-351274990 None] Converted 112.00 MB image at 36.03 MB/s Sep 16 20:23:33 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f2d40225-05cc-47f9-917e-8d46f52c6509 tempest-VolumesExtendTest-351274990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-65415a7c-d0ab-4799-8000-81f264d0c3a4 1G {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:23:33 devstack sudo[94249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-65415a7c-d0ab-4799-8000-81f264d0c3a4 1G Sep 16 20:23:33 devstack sudo[94249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:23:33 devstack sudo[94249]: pam_unix(sudo:session): session closed for user root Sep 16 20:23:33 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f2d40225-05cc-47f9-917e-8d46f52c6509 tempest-VolumesExtendTest-351274990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-65415a7c-d0ab-4799-8000-81f264d0c3a4 1G" returned: 0 in 0.463s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:23:33 devstack cinder-volume[86188]: DEBUG cinder.volume.volume_utils [None req-f2d40225-05cc-47f9-917e-8d46f52c6509 tempest-VolumesExtendTest-351274990 None] Downloaded image b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e ((None, [{'url': 'file:///opt/stack/data/glance/images/b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e', 'metadata': {}}])) to volume 65415a7c-d0ab-4799-8000-81f264d0c3a4 successfully. {{(pid=86188) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 16 20:23:33 devstack cinder-volume[86188]: DEBUG cinder.image.image_utils [None req-f2d40225-05cc-47f9-917e-8d46f52c6509 tempest-VolumesExtendTest-351274990 None] Temporary image b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e for user c934655d636c418591e0ece6c4db23cd is deleted. {{(pid=86188) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 16 20:23:33 devstack cinder-volume[86188]: DEBUG cinder.volume.volume_utils [None req-f2d40225-05cc-47f9-917e-8d46f52c6509 tempest-VolumesExtendTest-351274990 None] Marking volume 65415a7c-d0ab-4799-8000-81f264d0c3a4 as bootable. {{(pid=86188) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 16 20:23:33 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2d40225-05cc-47f9-917e-8d46f52c6509 tempest-VolumesExtendTest-351274990 None] Copying metadata from image b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e to 65415a7c-d0ab-4799-8000-81f264d0c3a4. {{(pid=86188) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 16 20:23:33 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2d40225-05cc-47f9-917e-8d46f52c6509 tempest-VolumesExtendTest-351274990 None] Creating volume glance metadata for volume 65415a7c-d0ab-4799-8000-81f264d0c3a4 backed by image b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86188) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 16 20:23:33 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f2d40225-05cc-47f9-917e-8d46f52c6509 tempest-VolumesExtendTest-351274990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46c8bcec-39d0-49ac-9233-81c6919ad174) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65415a7c-d0ab-4799-8000-81f264d0c3a4', 'volume_size': 1, 'image_id': 'b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5c9c8eab814247029b6d508a74a1d19e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e', 'created_at': datetime.datetime(2026, 9, 16, 18, 12, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 18, 12, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:23:33 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f2d40225-05cc-47f9-917e-8d46f52c6509 tempest-VolumesExtendTest-351274990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f67074b-c23b-43e7-a49d-7ab786392787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:23:33 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-f2d40225-05cc-47f9-917e-8d46f52c6509 tempest-VolumesExtendTest-351274990 None] Volume volume-65415a7c-d0ab-4799-8000-81f264d0c3a4 (65415a7c-d0ab-4799-8000-81f264d0c3a4): created successfully Sep 16 20:23:33 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f2d40225-05cc-47f9-917e-8d46f52c6509 tempest-VolumesExtendTest-351274990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f67074b-c23b-43e7-a49d-7ab786392787) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:23:33 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f2d40225-05cc-47f9-917e-8d46f52c6509 tempest-VolumesExtendTest-351274990 None] Flow 'volume_create_manager' (47020d0f-3df9-4810-9960-67d96ab9e9cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:23:33 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-f2d40225-05cc-47f9-917e-8d46f52c6509 tempest-VolumesExtendTest-351274990 None] Created volume successfully. Sep 16 20:23:34 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-99aeeeb7-1119-4759-9e28-995869efbd40 tempest-VolumesExtendTest-351274990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:23:34 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-99aeeeb7-1119-4759-9e28-995869efbd40 tempest-VolumesExtendTest-351274990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.002s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:23:34 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[634f8d32-7fcb-45d2-a48c-762517e6f8e0]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:23:34 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-99aeeeb7-1119-4759-9e28-995869efbd40 tempest-VolumesExtendTest-351274990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-65415a7c-d0ab-4799-8000-81f264d0c3a4 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:23:34 devstack sudo[94256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-65415a7c-d0ab-4799-8000-81f264d0c3a4 Sep 16 20:23:34 devstack sudo[94256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:23:34 devstack cinder-volume[86188]: INFO cinder.volume.manager [req-e22a141f-53f7-4eb8-9db6-7eef1e35b9b9 req-973edbc7-a31f-47eb-82c8-c82bfea1739b tempest-AttachVolumeNegativeTest-1537838471 None] Terminate volume connection completed successfully. Sep 16 20:23:34 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [req-e22a141f-53f7-4eb8-9db6-7eef1e35b9b9 req-973edbc7-a31f-47eb-82c8-c82bfea1739b tempest-AttachVolumeNegativeTest-1537838471 None] Deleting attachment c193f1d5-6a6a-4357-9b97-97c98082b1a0. {{(pid=86188) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 16 20:23:34 devstack sudo[94256]: pam_unix(sudo:session): session closed for user root Sep 16 20:23:34 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-99aeeeb7-1119-4759-9e28-995869efbd40 tempest-VolumesExtendTest-351274990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-65415a7c-d0ab-4799-8000-81f264d0c3a4" returned: 0 in 0.412s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:23:34 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-99aeeeb7-1119-4759-9e28-995869efbd40 tempest-VolumesExtendTest-351274990 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-65415a7c-d0ab-4799-8000-81f264d0c3a4 2G {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:23:34 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-99aeeeb7-1119-4759-9e28-995869efbd40 tempest-VolumesExtendTest-351274990 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-65415a7c-d0ab-4799-8000-81f264d0c3a4 2G" returned: 0 in 0.104s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:23:34 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-99aeeeb7-1119-4759-9e28-995869efbd40 tempest-VolumesExtendTest-351274990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.543s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:23:34 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-99aeeeb7-1119-4759-9e28-995869efbd40 tempest-VolumesExtendTest-351274990 None] Extend volume completed successfully. Sep 16 20:23:36 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-71a095a9-cbbb-4546-b70c-e180846c0339 tempest-VolumesExtendTest-351274990 None] Acquiring lock "cinder-65415a7c-d0ab-4799-8000-81f264d0c3a4-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:23:36 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-71a095a9-cbbb-4546-b70c-e180846c0339 tempest-VolumesExtendTest-351274990 None] Lock "cinder-65415a7c-d0ab-4799-8000-81f264d0c3a4-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:23:36 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-71a095a9-cbbb-4546-b70c-e180846c0339 tempest-VolumesExtendTest-351274990 None] Acquiring lock "cinder-quobyte-65415a7c-d0ab-4799-8000-81f264d0c3a4" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:23:36 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-71a095a9-cbbb-4546-b70c-e180846c0339 tempest-VolumesExtendTest-351274990 None] Lock "cinder-quobyte-65415a7c-d0ab-4799-8000-81f264d0c3a4" acquired by "delete_volume" :: waited 0.019s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:23:36 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[20ebca97-df9b-4083-834b-31e4b782aa05]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:23:36 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-71a095a9-cbbb-4546-b70c-e180846c0339 tempest-VolumesExtendTest-351274990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-65415a7c-d0ab-4799-8000-81f264d0c3a4 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:23:36 devstack sudo[94311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-65415a7c-d0ab-4799-8000-81f264d0c3a4 Sep 16 20:23:36 devstack sudo[94311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:23:36 devstack sudo[94311]: pam_unix(sudo:session): session closed for user root Sep 16 20:23:36 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-71a095a9-cbbb-4546-b70c-e180846c0339 tempest-VolumesExtendTest-351274990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-65415a7c-d0ab-4799-8000-81f264d0c3a4" returned: 0 in 0.464s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:23:36 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-71a095a9-cbbb-4546-b70c-e180846c0339 tempest-VolumesExtendTest-351274990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-65415a7c-d0ab-4799-8000-81f264d0c3a4 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:23:36 devstack sudo[94317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-65415a7c-d0ab-4799-8000-81f264d0c3a4 Sep 16 20:23:36 devstack sudo[94317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:23:37 devstack sudo[94317]: pam_unix(sudo:session): session closed for user root Sep 16 20:23:37 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-71a095a9-cbbb-4546-b70c-e180846c0339 tempest-VolumesExtendTest-351274990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-65415a7c-d0ab-4799-8000-81f264d0c3a4" returned: 0 in 0.299s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:23:37 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-71a095a9-cbbb-4546-b70c-e180846c0339 tempest-VolumesExtendTest-351274990 None] Lock "cinder-quobyte-65415a7c-d0ab-4799-8000-81f264d0c3a4" released by "delete_volume" :: held 0.824s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:23:37 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-71a095a9-cbbb-4546-b70c-e180846c0339 tempest-VolumesExtendTest-351274990 None] Created reservations ['cc832022-b3fc-4310-a7c9-48974687a3d8', 'fae92f4c-f976-44eb-8b29-0446c412ea3d', '05176d26-eeba-4204-aced-2d7dd3c6c256', '509f6e63-f13c-422f-b693-827a7e5baa9b'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:23:37 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-71a095a9-cbbb-4546-b70c-e180846c0339 tempest-VolumesExtendTest-351274990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:23:37 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-71a095a9-cbbb-4546-b70c-e180846c0339 tempest-VolumesExtendTest-351274990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:23:37 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-71a095a9-cbbb-4546-b70c-e180846c0339 tempest-VolumesExtendTest-351274990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:23:37 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-71a095a9-cbbb-4546-b70c-e180846c0339 tempest-VolumesExtendTest-351274990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:23:37 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-71a095a9-cbbb-4546-b70c-e180846c0339 tempest-VolumesExtendTest-351274990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:23:37 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-71a095a9-cbbb-4546-b70c-e180846c0339 tempest-VolumesExtendTest-351274990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:23:37 devstack sudo[94322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:23:37 devstack sudo[94322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:23:37 devstack sudo[94322]: pam_unix(sudo:session): session closed for user root Sep 16 20:23:37 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-71a095a9-cbbb-4546-b70c-e180846c0339 tempest-VolumesExtendTest-351274990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.287s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:23:37 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-71a095a9-cbbb-4546-b70c-e180846c0339 tempest-VolumesExtendTest-351274990 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:23:37 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-71a095a9-cbbb-4546-b70c-e180846c0339 tempest-VolumesExtendTest-351274990 None] Deleted volume successfully. Sep 16 20:23:37 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-71a095a9-cbbb-4546-b70c-e180846c0339 tempest-VolumesExtendTest-351274990 None] Lock "cinder-65415a7c-d0ab-4799-8000-81f264d0c3a4-delete_volume" released by "delete_volume" :: held 1.345s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:23:37 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bd4a29d-8e85-4685-a7ab-ee1219eb6ac6 tempest-VolumesExtendTest-351274990 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:23:37 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-2bd4a29d-8e85-4685-a7ab-ee1219eb6ac6 tempest-VolumesExtendTest-351274990 None] Flow 'volume_create_manager' (c3b826a8-d747-4ca4-85e8-57b91367fd65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:23:37 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-2bd4a29d-8e85-4685-a7ab-ee1219eb6ac6 tempest-VolumesExtendTest-351274990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7834e03-9b93-4c06-82c6-b14c10826148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:23:37 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-2bd4a29d-8e85-4685-a7ab-ee1219eb6ac6 tempest-VolumesExtendTest-351274990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7834e03-9b93-4c06-82c6-b14c10826148) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:23:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1718447751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f60a98a-6d1a-499f-9c90-41fc0d71c0b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ec376806b43461cb9c111639eb31034',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:23:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:23:38Z,use_quota=True,user_id='c934655d636c418591e0ece6c4db23cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:23:37 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-2bd4a29d-8e85-4685-a7ab-ee1219eb6ac6 tempest-VolumesExtendTest-351274990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8245b82b-52c7-4537-b339-9959d59cdb42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:23:37 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-2bd4a29d-8e85-4685-a7ab-ee1219eb6ac6 tempest-VolumesExtendTest-351274990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8245b82b-52c7-4537-b339-9959d59cdb42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:23:37 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-2bd4a29d-8e85-4685-a7ab-ee1219eb6ac6 tempest-VolumesExtendTest-351274990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c3bb41b-9fb8-4d08-82d9-aab5b615f5bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:23:37 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-2bd4a29d-8e85-4685-a7ab-ee1219eb6ac6 tempest-VolumesExtendTest-351274990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c3bb41b-9fb8-4d08-82d9-aab5b615f5bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f60a98a-6d1a-499f-9c90-41fc0d71c0b2', 'volume_name': 'volume-4f60a98a-6d1a-499f-9c90-41fc0d71c0b2', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:23:37 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-2bd4a29d-8e85-4685-a7ab-ee1219eb6ac6 tempest-VolumesExtendTest-351274990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b03fb05-7887-4912-b563-06f0517ff9df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:23:37 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-2bd4a29d-8e85-4685-a7ab-ee1219eb6ac6 tempest-VolumesExtendTest-351274990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b03fb05-7887-4912-b563-06f0517ff9df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:23:37 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-2bd4a29d-8e85-4685-a7ab-ee1219eb6ac6 tempest-VolumesExtendTest-351274990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b31bd7e-600c-4c7c-bc2c-595e55402592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:23:37 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-2bd4a29d-8e85-4685-a7ab-ee1219eb6ac6 tempest-VolumesExtendTest-351274990 None] Volume 4f60a98a-6d1a-499f-9c90-41fc0d71c0b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f60a98a-6d1a-499f-9c90-41fc0d71c0b2', 'volume_size': 1} Sep 16 20:23:37 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-2bd4a29d-8e85-4685-a7ab-ee1219eb6ac6 tempest-VolumesExtendTest-351274990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:23:37 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-2bd4a29d-8e85-4685-a7ab-ee1219eb6ac6 tempest-VolumesExtendTest-351274990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:23:37 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-2bd4a29d-8e85-4685-a7ab-ee1219eb6ac6 tempest-VolumesExtendTest-351274990 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:23:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1718447751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f60a98a-6d1a-499f-9c90-41fc0d71c0b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ec376806b43461cb9c111639eb31034',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:23:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:23:38Z,use_quota=True,user_id='c934655d636c418591e0ece6c4db23cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:23:37 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-2bd4a29d-8e85-4685-a7ab-ee1219eb6ac6 tempest-VolumesExtendTest-351274990 None] Creating volume 4f60a98a-6d1a-499f-9c90-41fc0d71c0b2 {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:23:37 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-2bd4a29d-8e85-4685-a7ab-ee1219eb6ac6 tempest-VolumesExtendTest-351274990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:23:37 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-2bd4a29d-8e85-4685-a7ab-ee1219eb6ac6 tempest-VolumesExtendTest-351274990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:23:37 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-2bd4a29d-8e85-4685-a7ab-ee1219eb6ac6 tempest-VolumesExtendTest-351274990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:23:37 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-2bd4a29d-8e85-4685-a7ab-ee1219eb6ac6 tempest-VolumesExtendTest-351274990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:23:37 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-2bd4a29d-8e85-4685-a7ab-ee1219eb6ac6 tempest-VolumesExtendTest-351274990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:23:37 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-2bd4a29d-8e85-4685-a7ab-ee1219eb6ac6 tempest-VolumesExtendTest-351274990 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:23:37 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-2bd4a29d-8e85-4685-a7ab-ee1219eb6ac6 tempest-VolumesExtendTest-351274990 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:23:37 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-2bd4a29d-8e85-4685-a7ab-ee1219eb6ac6 tempest-VolumesExtendTest-351274990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-4f60a98a-6d1a-499f-9c90-41fc0d71c0b2 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:23:37 devstack sudo[94325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-4f60a98a-6d1a-499f-9c90-41fc0d71c0b2 1073741824 Sep 16 20:23:37 devstack sudo[94325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:23:38 devstack sudo[94325]: pam_unix(sudo:session): session closed for user root Sep 16 20:23:38 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-2bd4a29d-8e85-4685-a7ab-ee1219eb6ac6 tempest-VolumesExtendTest-351274990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-4f60a98a-6d1a-499f-9c90-41fc0d71c0b2 1073741824" returned: 0 in 0.611s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:23:38 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-2bd4a29d-8e85-4685-a7ab-ee1219eb6ac6 tempest-VolumesExtendTest-351274990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-4f60a98a-6d1a-499f-9c90-41fc0d71c0b2 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:23:38 devstack sudo[94335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-4f60a98a-6d1a-499f-9c90-41fc0d71c0b2 Sep 16 20:23:38 devstack sudo[94335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:23:38 devstack sudo[94335]: pam_unix(sudo:session): session closed for user root Sep 16 20:23:38 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-2bd4a29d-8e85-4685-a7ab-ee1219eb6ac6 tempest-VolumesExtendTest-351274990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-4f60a98a-6d1a-499f-9c90-41fc0d71c0b2" returned: 0 in 0.306s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:23:38 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-2bd4a29d-8e85-4685-a7ab-ee1219eb6ac6 tempest-VolumesExtendTest-351274990 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:23:38 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-2bd4a29d-8e85-4685-a7ab-ee1219eb6ac6 tempest-VolumesExtendTest-351274990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:23:38 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-2bd4a29d-8e85-4685-a7ab-ee1219eb6ac6 tempest-VolumesExtendTest-351274990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b31bd7e-600c-4c7c-bc2c-595e55402592) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f60a98a-6d1a-499f-9c90-41fc0d71c0b2', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:23:38 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-2bd4a29d-8e85-4685-a7ab-ee1219eb6ac6 tempest-VolumesExtendTest-351274990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d87ff30d-acd7-4517-95c8-524622d5d487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:23:38 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-2bd4a29d-8e85-4685-a7ab-ee1219eb6ac6 tempest-VolumesExtendTest-351274990 None] Volume volume-4f60a98a-6d1a-499f-9c90-41fc0d71c0b2 (4f60a98a-6d1a-499f-9c90-41fc0d71c0b2): created successfully Sep 16 20:23:38 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-2bd4a29d-8e85-4685-a7ab-ee1219eb6ac6 tempest-VolumesExtendTest-351274990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d87ff30d-acd7-4517-95c8-524622d5d487) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:23:38 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-2bd4a29d-8e85-4685-a7ab-ee1219eb6ac6 tempest-VolumesExtendTest-351274990 None] Flow 'volume_create_manager' (c3b826a8-d747-4ca4-85e8-57b91367fd65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:23:38 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-2bd4a29d-8e85-4685-a7ab-ee1219eb6ac6 tempest-VolumesExtendTest-351274990 None] Created volume successfully. Sep 16 20:23:40 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-2689aa0d-7fae-4cb2-b1b5-d1c1e350e264 tempest-VolumesExtendTest-351274990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:23:40 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-2689aa0d-7fae-4cb2-b1b5-d1c1e350e264 tempest-VolumesExtendTest-351274990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:23:40 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-2689aa0d-7fae-4cb2-b1b5-d1c1e350e264 tempest-VolumesExtendTest-351274990 None] Creating offline snapshot 9b235e92-ddf6-43d4-899d-e45357f43919 of volume 4f60a98a-6d1a-499f-9c90-41fc0d71c0b2 {{(pid=86188) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 20:23:40 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[276e18f9-4e9b-4637-87ea-c72df3e0448a]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:23:40 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-2689aa0d-7fae-4cb2-b1b5-d1c1e350e264 tempest-VolumesExtendTest-351274990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-4f60a98a-6d1a-499f-9c90-41fc0d71c0b2 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:23:40 devstack sudo[94347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-4f60a98a-6d1a-499f-9c90-41fc0d71c0b2 Sep 16 20:23:40 devstack sudo[94347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:23:40 devstack sudo[94347]: pam_unix(sudo:session): session closed for user root Sep 16 20:23:40 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-2689aa0d-7fae-4cb2-b1b5-d1c1e350e264 tempest-VolumesExtendTest-351274990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-4f60a98a-6d1a-499f-9c90-41fc0d71c0b2" returned: 0 in 0.537s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:23:40 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-2689aa0d-7fae-4cb2-b1b5-d1c1e350e264 tempest-VolumesExtendTest-351274990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-4f60a98a-6d1a-499f-9c90-41fc0d71c0b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-4f60a98a-6d1a-499f-9c90-41fc0d71c0b2.9b235e92-ddf6-43d4-899d-e45357f43919 1G {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:23:40 devstack sudo[94361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-4f60a98a-6d1a-499f-9c90-41fc0d71c0b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-4f60a98a-6d1a-499f-9c90-41fc0d71c0b2.9b235e92-ddf6-43d4-899d-e45357f43919 1G Sep 16 20:23:40 devstack sudo[94361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:23:41 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-aa31968c-ddb7-4f6f-84d0-c111e94de701 tempest-AttachVolumeNegativeTest-1537838471 None] Acquiring lock "cinder-6aebae9c-796e-4361-8fa7-160435ddad1b-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:23:41 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-aa31968c-ddb7-4f6f-84d0-c111e94de701 tempest-AttachVolumeNegativeTest-1537838471 None] Lock "cinder-6aebae9c-796e-4361-8fa7-160435ddad1b-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:23:41 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-aa31968c-ddb7-4f6f-84d0-c111e94de701 tempest-AttachVolumeNegativeTest-1537838471 None] Acquiring lock "cinder-quobyte-6aebae9c-796e-4361-8fa7-160435ddad1b" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:23:41 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-aa31968c-ddb7-4f6f-84d0-c111e94de701 tempest-AttachVolumeNegativeTest-1537838471 None] Lock "cinder-quobyte-6aebae9c-796e-4361-8fa7-160435ddad1b" acquired by "delete_volume" :: waited 0.021s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:23:41 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[02432502-8a73-432a-9c48-7f20d2f382fe]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:23:41 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-aa31968c-ddb7-4f6f-84d0-c111e94de701 tempest-AttachVolumeNegativeTest-1537838471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-6aebae9c-796e-4361-8fa7-160435ddad1b {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:23:41 devstack sudo[94366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-6aebae9c-796e-4361-8fa7-160435ddad1b Sep 16 20:23:41 devstack sudo[94366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:23:41 devstack sudo[94361]: pam_unix(sudo:session): session closed for user root Sep 16 20:23:41 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-2689aa0d-7fae-4cb2-b1b5-d1c1e350e264 tempest-VolumesExtendTest-351274990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-4f60a98a-6d1a-499f-9c90-41fc0d71c0b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-4f60a98a-6d1a-499f-9c90-41fc0d71c0b2.9b235e92-ddf6-43d4-899d-e45357f43919 1G" returned: 0 in 0.563s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:23:41 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-2689aa0d-7fae-4cb2-b1b5-d1c1e350e264 tempest-VolumesExtendTest-351274990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f60a98a-6d1a-499f-9c90-41fc0d71c0b2 -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-4f60a98a-6d1a-499f-9c90-41fc0d71c0b2.9b235e92-ddf6-43d4-899d-e45357f43919 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:23:41 devstack sudo[94369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f60a98a-6d1a-499f-9c90-41fc0d71c0b2 -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-4f60a98a-6d1a-499f-9c90-41fc0d71c0b2.9b235e92-ddf6-43d4-899d-e45357f43919 Sep 16 20:23:41 devstack sudo[94369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:23:41 devstack sudo[94366]: pam_unix(sudo:session): session closed for user root Sep 16 20:23:41 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-aa31968c-ddb7-4f6f-84d0-c111e94de701 tempest-AttachVolumeNegativeTest-1537838471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-6aebae9c-796e-4361-8fa7-160435ddad1b" returned: 0 in 0.433s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:23:41 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-aa31968c-ddb7-4f6f-84d0-c111e94de701 tempest-AttachVolumeNegativeTest-1537838471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-6aebae9c-796e-4361-8fa7-160435ddad1b {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:23:41 devstack sudo[94374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-6aebae9c-796e-4361-8fa7-160435ddad1b Sep 16 20:23:41 devstack sudo[94374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:23:41 devstack sudo[94369]: pam_unix(sudo:session): session closed for user root Sep 16 20:23:41 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-2689aa0d-7fae-4cb2-b1b5-d1c1e350e264 tempest-VolumesExtendTest-351274990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f60a98a-6d1a-499f-9c90-41fc0d71c0b2 -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-4f60a98a-6d1a-499f-9c90-41fc0d71c0b2.9b235e92-ddf6-43d4-899d-e45357f43919" returned: 0 in 0.309s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:23:41 devstack cinder-volume[86188]: WARNING cinder.volume.drivers.remotefs [None req-2689aa0d-7fae-4cb2-b1b5-d1c1e350e264 tempest-VolumesExtendTest-351274990 None] /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-4f60a98a-6d1a-499f-9c90-41fc0d71c0b2.9b235e92-ddf6-43d4-899d-e45357f43919 is being set with open permissions: ugo+rw Sep 16 20:23:41 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-2689aa0d-7fae-4cb2-b1b5-d1c1e350e264 tempest-VolumesExtendTest-351274990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-4f60a98a-6d1a-499f-9c90-41fc0d71c0b2.9b235e92-ddf6-43d4-899d-e45357f43919 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:23:41 devstack sudo[94380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-4f60a98a-6d1a-499f-9c90-41fc0d71c0b2.9b235e92-ddf6-43d4-899d-e45357f43919 Sep 16 20:23:41 devstack sudo[94380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:23:41 devstack sudo[94374]: pam_unix(sudo:session): session closed for user root Sep 16 20:23:41 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-aa31968c-ddb7-4f6f-84d0-c111e94de701 tempest-AttachVolumeNegativeTest-1537838471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-6aebae9c-796e-4361-8fa7-160435ddad1b" returned: 0 in 0.293s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:23:41 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-aa31968c-ddb7-4f6f-84d0-c111e94de701 tempest-AttachVolumeNegativeTest-1537838471 None] Lock "cinder-quobyte-6aebae9c-796e-4361-8fa7-160435ddad1b" released by "delete_volume" :: held 0.775s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:23:41 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-aa31968c-ddb7-4f6f-84d0-c111e94de701 tempest-AttachVolumeNegativeTest-1537838471 None] Created reservations ['64f9b088-5c8d-44b8-b7f4-bf4dc4c11808', '873aefd8-0f63-4321-a202-ced521697db6', 'a9ebe1e5-864c-4233-b691-632028d86865', 'b4eec878-01f1-49f0-b4a1-82fd4df46f5f'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:23:42 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-aa31968c-ddb7-4f6f-84d0-c111e94de701 tempest-AttachVolumeNegativeTest-1537838471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:23:42 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-aa31968c-ddb7-4f6f-84d0-c111e94de701 tempest-AttachVolumeNegativeTest-1537838471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:23:42 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-aa31968c-ddb7-4f6f-84d0-c111e94de701 tempest-AttachVolumeNegativeTest-1537838471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:23:42 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-aa31968c-ddb7-4f6f-84d0-c111e94de701 tempest-AttachVolumeNegativeTest-1537838471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:23:42 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-aa31968c-ddb7-4f6f-84d0-c111e94de701 tempest-AttachVolumeNegativeTest-1537838471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:23:42 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-aa31968c-ddb7-4f6f-84d0-c111e94de701 tempest-AttachVolumeNegativeTest-1537838471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:23:42 devstack sudo[94387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:23:42 devstack sudo[94387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:23:42 devstack sudo[94380]: pam_unix(sudo:session): session closed for user root Sep 16 20:23:42 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-2689aa0d-7fae-4cb2-b1b5-d1c1e350e264 tempest-VolumesExtendTest-351274990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-4f60a98a-6d1a-499f-9c90-41fc0d71c0b2.9b235e92-ddf6-43d4-899d-e45357f43919" returned: 0 in 0.417s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:23:42 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-2689aa0d-7fae-4cb2-b1b5-d1c1e350e264 tempest-VolumesExtendTest-351274990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-4f60a98a-6d1a-499f-9c90-41fc0d71c0b2.info {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:23:42 devstack sudo[94389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-4f60a98a-6d1a-499f-9c90-41fc0d71c0b2.info Sep 16 20:23:42 devstack sudo[94389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:23:42 devstack sudo[94387]: pam_unix(sudo:session): session closed for user root Sep 16 20:23:42 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-aa31968c-ddb7-4f6f-84d0-c111e94de701 tempest-AttachVolumeNegativeTest-1537838471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.433s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:23:42 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-aa31968c-ddb7-4f6f-84d0-c111e94de701 tempest-AttachVolumeNegativeTest-1537838471 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:23:42 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-aa31968c-ddb7-4f6f-84d0-c111e94de701 tempest-AttachVolumeNegativeTest-1537838471 None] Deleted volume successfully. Sep 16 20:23:42 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-aa31968c-ddb7-4f6f-84d0-c111e94de701 tempest-AttachVolumeNegativeTest-1537838471 None] Lock "cinder-6aebae9c-796e-4361-8fa7-160435ddad1b-delete_volume" released by "delete_volume" :: held 1.486s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:23:42 devstack sudo[94389]: pam_unix(sudo:session): session closed for user root Sep 16 20:23:42 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-b3cd7abd-dd32-45a6-b21a-728cd1813182 tempest-AttachVolumeNegativeTest-1537838471 None] Acquiring lock "cinder-23a91cd7-74d7-494e-a735-4d4cb4714a9c-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:23:42 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-2689aa0d-7fae-4cb2-b1b5-d1c1e350e264 tempest-VolumesExtendTest-351274990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-4f60a98a-6d1a-499f-9c90-41fc0d71c0b2.info" returned: 0 in 0.474s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:23:42 devstack cinder-volume[86188]: WARNING cinder.volume.drivers.remotefs [None req-2689aa0d-7fae-4cb2-b1b5-d1c1e350e264 tempest-VolumesExtendTest-351274990 None] /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-4f60a98a-6d1a-499f-9c90-41fc0d71c0b2.info is being set with open permissions: ugo+rw Sep 16 20:23:42 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-2689aa0d-7fae-4cb2-b1b5-d1c1e350e264 tempest-VolumesExtendTest-351274990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-4f60a98a-6d1a-499f-9c90-41fc0d71c0b2.info {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:23:42 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-b3cd7abd-dd32-45a6-b21a-728cd1813182 tempest-AttachVolumeNegativeTest-1537838471 None] Lock "cinder-23a91cd7-74d7-494e-a735-4d4cb4714a9c-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:23:42 devstack sudo[94396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-4f60a98a-6d1a-499f-9c90-41fc0d71c0b2.info Sep 16 20:23:42 devstack sudo[94396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:23:42 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-b3cd7abd-dd32-45a6-b21a-728cd1813182 tempest-AttachVolumeNegativeTest-1537838471 None] Acquiring lock "cinder-quobyte-23a91cd7-74d7-494e-a735-4d4cb4714a9c" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:23:42 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-b3cd7abd-dd32-45a6-b21a-728cd1813182 tempest-AttachVolumeNegativeTest-1537838471 None] Lock "cinder-quobyte-23a91cd7-74d7-494e-a735-4d4cb4714a9c" acquired by "delete_volume" :: waited 0.016s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:23:42 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[883c4eb3-faf2-4fe1-aff7-c7ce0a1a924d]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:23:42 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b3cd7abd-dd32-45a6-b21a-728cd1813182 tempest-AttachVolumeNegativeTest-1537838471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-23a91cd7-74d7-494e-a735-4d4cb4714a9c {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:23:43 devstack sudo[94406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-23a91cd7-74d7-494e-a735-4d4cb4714a9c Sep 16 20:23:43 devstack sudo[94406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:23:43 devstack sudo[94396]: pam_unix(sudo:session): session closed for user root Sep 16 20:23:43 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-2689aa0d-7fae-4cb2-b1b5-d1c1e350e264 tempest-VolumesExtendTest-351274990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-4f60a98a-6d1a-499f-9c90-41fc0d71c0b2.info" returned: 0 in 0.612s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:23:43 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-2689aa0d-7fae-4cb2-b1b5-d1c1e350e264 tempest-VolumesExtendTest-351274990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.062s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:23:43 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-2689aa0d-7fae-4cb2-b1b5-d1c1e350e264 tempest-VolumesExtendTest-351274990 None] Create snapshot completed successfully Sep 16 20:23:43 devstack sudo[94406]: pam_unix(sudo:session): session closed for user root Sep 16 20:23:43 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b3cd7abd-dd32-45a6-b21a-728cd1813182 tempest-AttachVolumeNegativeTest-1537838471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-23a91cd7-74d7-494e-a735-4d4cb4714a9c" returned: 0 in 0.647s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:23:43 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b3cd7abd-dd32-45a6-b21a-728cd1813182 tempest-AttachVolumeNegativeTest-1537838471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-23a91cd7-74d7-494e-a735-4d4cb4714a9c {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:23:43 devstack sudo[94449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-23a91cd7-74d7-494e-a735-4d4cb4714a9c Sep 16 20:23:43 devstack sudo[94449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:23:44 devstack sudo[94449]: pam_unix(sudo:session): session closed for user root Sep 16 20:23:44 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b3cd7abd-dd32-45a6-b21a-728cd1813182 tempest-AttachVolumeNegativeTest-1537838471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-23a91cd7-74d7-494e-a735-4d4cb4714a9c" returned: 0 in 0.565s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:23:44 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-b3cd7abd-dd32-45a6-b21a-728cd1813182 tempest-AttachVolumeNegativeTest-1537838471 None] Lock "cinder-quobyte-23a91cd7-74d7-494e-a735-4d4cb4714a9c" released by "delete_volume" :: held 1.296s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:23:44 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-b3cd7abd-dd32-45a6-b21a-728cd1813182 tempest-AttachVolumeNegativeTest-1537838471 None] Created reservations ['73895dae-f4bf-480e-a978-d2f18fc89e94', 'f432fe1a-d1fc-4fe6-a8cc-642bfa553199', '03dfa835-00c2-4f45-9318-586b5044f340', 'f78115c0-3874-4d20-8440-4bfb299f6c85'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:23:44 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-b3cd7abd-dd32-45a6-b21a-728cd1813182 tempest-AttachVolumeNegativeTest-1537838471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:23:44 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-b3cd7abd-dd32-45a6-b21a-728cd1813182 tempest-AttachVolumeNegativeTest-1537838471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:23:44 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-b3cd7abd-dd32-45a6-b21a-728cd1813182 tempest-AttachVolumeNegativeTest-1537838471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:23:44 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-b3cd7abd-dd32-45a6-b21a-728cd1813182 tempest-AttachVolumeNegativeTest-1537838471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:23:44 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-b3cd7abd-dd32-45a6-b21a-728cd1813182 tempest-AttachVolumeNegativeTest-1537838471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:23:44 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b3cd7abd-dd32-45a6-b21a-728cd1813182 tempest-AttachVolumeNegativeTest-1537838471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:23:44 devstack sudo[94490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:23:44 devstack sudo[94490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:23:44 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-460fde10-c686-4f0b-88d4-4fbd53794bb4 tempest-VolumesExtendTest-351274990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:23:44 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-460fde10-c686-4f0b-88d4-4fbd53794bb4 tempest-VolumesExtendTest-351274990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.005s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:23:44 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f7f257b-cb07-4de5-be43-6b95b44e881d]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:23:44 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-460fde10-c686-4f0b-88d4-4fbd53794bb4 tempest-VolumesExtendTest-351274990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-4f60a98a-6d1a-499f-9c90-41fc0d71c0b2 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:23:44 devstack sudo[94490]: pam_unix(sudo:session): session closed for user root Sep 16 20:23:44 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b3cd7abd-dd32-45a6-b21a-728cd1813182 tempest-AttachVolumeNegativeTest-1537838471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.512s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:23:44 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-b3cd7abd-dd32-45a6-b21a-728cd1813182 tempest-AttachVolumeNegativeTest-1537838471 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:23:44 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-b3cd7abd-dd32-45a6-b21a-728cd1813182 tempest-AttachVolumeNegativeTest-1537838471 None] Deleted volume successfully. Sep 16 20:23:44 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-b3cd7abd-dd32-45a6-b21a-728cd1813182 tempest-AttachVolumeNegativeTest-1537838471 None] Lock "cinder-23a91cd7-74d7-494e-a735-4d4cb4714a9c-delete_volume" released by "delete_volume" :: held 2.215s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:23:45 devstack sudo[94496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-4f60a98a-6d1a-499f-9c90-41fc0d71c0b2 Sep 16 20:23:45 devstack sudo[94496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:23:45 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-4823827a-624d-4830-921b-23e8d10222a8 tempest-AttachVolumeNegativeTest-1537838471 None] Acquiring lock "cinder-ad18f387-eef5-4f3b-8d1c-5795ce000a83-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:23:45 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-4823827a-624d-4830-921b-23e8d10222a8 tempest-AttachVolumeNegativeTest-1537838471 None] Lock "cinder-ad18f387-eef5-4f3b-8d1c-5795ce000a83-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:23:45 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-4823827a-624d-4830-921b-23e8d10222a8 tempest-AttachVolumeNegativeTest-1537838471 None] Acquiring lock "cinder-quobyte-ad18f387-eef5-4f3b-8d1c-5795ce000a83" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:23:45 devstack sudo[94496]: pam_unix(sudo:session): session closed for user root Sep 16 20:23:45 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-460fde10-c686-4f0b-88d4-4fbd53794bb4 tempest-VolumesExtendTest-351274990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-4f60a98a-6d1a-499f-9c90-41fc0d71c0b2" returned: 0 in 0.860s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:23:45 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-460fde10-c686-4f0b-88d4-4fbd53794bb4 tempest-VolumesExtendTest-351274990 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-4f60a98a-6d1a-499f-9c90-41fc0d71c0b2.9b235e92-ddf6-43d4-899d-e45357f43919 2G {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:23:45 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-4823827a-624d-4830-921b-23e8d10222a8 tempest-AttachVolumeNegativeTest-1537838471 None] Lock "cinder-quobyte-ad18f387-eef5-4f3b-8d1c-5795ce000a83" acquired by "delete_volume" :: waited 0.072s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:23:45 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[7df7ad23-b7c7-4695-991e-8e5ca87f601c]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:23:45 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-4823827a-624d-4830-921b-23e8d10222a8 tempest-AttachVolumeNegativeTest-1537838471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ad18f387-eef5-4f3b-8d1c-5795ce000a83 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:23:46 devstack sudo[94507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ad18f387-eef5-4f3b-8d1c-5795ce000a83 Sep 16 20:23:46 devstack sudo[94507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:23:46 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-460fde10-c686-4f0b-88d4-4fbd53794bb4 tempest-VolumesExtendTest-351274990 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-4f60a98a-6d1a-499f-9c90-41fc0d71c0b2.9b235e92-ddf6-43d4-899d-e45357f43919 2G" returned: 0 in 0.326s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:23:46 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-460fde10-c686-4f0b-88d4-4fbd53794bb4 tempest-VolumesExtendTest-351274990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.239s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:23:46 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-460fde10-c686-4f0b-88d4-4fbd53794bb4 tempest-VolumesExtendTest-351274990 None] Extend volume completed successfully. Sep 16 20:23:46 devstack sudo[94507]: pam_unix(sudo:session): session closed for user root Sep 16 20:23:46 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-4823827a-624d-4830-921b-23e8d10222a8 tempest-AttachVolumeNegativeTest-1537838471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ad18f387-eef5-4f3b-8d1c-5795ce000a83" returned: 0 in 0.652s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:23:46 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-4823827a-624d-4830-921b-23e8d10222a8 tempest-AttachVolumeNegativeTest-1537838471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ad18f387-eef5-4f3b-8d1c-5795ce000a83 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:23:46 devstack sudo[94515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ad18f387-eef5-4f3b-8d1c-5795ce000a83 Sep 16 20:23:46 devstack sudo[94515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:23:46 devstack sudo[94515]: pam_unix(sudo:session): session closed for user root Sep 16 20:23:46 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-4823827a-624d-4830-921b-23e8d10222a8 tempest-AttachVolumeNegativeTest-1537838471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ad18f387-eef5-4f3b-8d1c-5795ce000a83" returned: 0 in 0.291s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:23:46 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-4823827a-624d-4830-921b-23e8d10222a8 tempest-AttachVolumeNegativeTest-1537838471 None] Lock "cinder-quobyte-ad18f387-eef5-4f3b-8d1c-5795ce000a83" released by "delete_volume" :: held 1.013s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:23:46 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-4823827a-624d-4830-921b-23e8d10222a8 tempest-AttachVolumeNegativeTest-1537838471 None] Created reservations ['df6109aa-b153-4237-92ab-78d219bc32fa', '3ceafeb4-6aab-4eeb-8e40-d99e8e613315', 'ed9c862a-e890-4f9b-aa9a-2e25c3d9aee7', 'f0578fe6-79a7-4402-859c-4c1dc2d3f8d3'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:23:46 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-4823827a-624d-4830-921b-23e8d10222a8 tempest-AttachVolumeNegativeTest-1537838471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:23:46 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-4823827a-624d-4830-921b-23e8d10222a8 tempest-AttachVolumeNegativeTest-1537838471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:23:46 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-4823827a-624d-4830-921b-23e8d10222a8 tempest-AttachVolumeNegativeTest-1537838471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:23:46 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-4823827a-624d-4830-921b-23e8d10222a8 tempest-AttachVolumeNegativeTest-1537838471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:23:46 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-4823827a-624d-4830-921b-23e8d10222a8 tempest-AttachVolumeNegativeTest-1537838471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:23:46 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-4823827a-624d-4830-921b-23e8d10222a8 tempest-AttachVolumeNegativeTest-1537838471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:23:46 devstack sudo[94518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:23:46 devstack sudo[94518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:23:47 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-7ef75eb6-a9cf-4d74-8592-36d4be424ae1 tempest-VolumesExtendTest-351274990 None] Acquiring lock "cinder-9b235e92-ddf6-43d4-899d-e45357f43919-delete_snapshot" by "delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:23:47 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-7ef75eb6-a9cf-4d74-8592-36d4be424ae1 tempest-VolumesExtendTest-351274990 None] Lock "cinder-9b235e92-ddf6-43d4-899d-e45357f43919-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:23:47 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-7ef75eb6-a9cf-4d74-8592-36d4be424ae1 tempest-VolumesExtendTest-351274990 None] Acquiring lock "cinder-quobyte-4f60a98a-6d1a-499f-9c90-41fc0d71c0b2" by "delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:23:47 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-7ef75eb6-a9cf-4d74-8592-36d4be424ae1 tempest-VolumesExtendTest-351274990 None] Lock "cinder-quobyte-4f60a98a-6d1a-499f-9c90-41fc0d71c0b2" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:23:47 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-7ef75eb6-a9cf-4d74-8592-36d4be424ae1 tempest-VolumesExtendTest-351274990 None] Acquiring lock "cinder-quobyte-9b235e92-ddf6-43d4-899d-e45357f43919" by "_delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:23:47 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-7ef75eb6-a9cf-4d74-8592-36d4be424ae1 tempest-VolumesExtendTest-351274990 None] Lock "cinder-quobyte-9b235e92-ddf6-43d4-899d-e45357f43919" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:23:47 devstack sudo[94518]: pam_unix(sudo:session): session closed for user root Sep 16 20:23:47 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-7ef75eb6-a9cf-4d74-8592-36d4be424ae1 tempest-VolumesExtendTest-351274990 None] Deleting offline snapshot 9b235e92-ddf6-43d4-899d-e45357f43919 of volume 4f60a98a-6d1a-499f-9c90-41fc0d71c0b2 {{(pid=86188) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 20:23:47 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-7ef75eb6-a9cf-4d74-8592-36d4be424ae1 tempest-VolumesExtendTest-351274990 None] snapshot_file for this snap is: volume-4f60a98a-6d1a-499f-9c90-41fc0d71c0b2.9b235e92-ddf6-43d4-899d-e45357f43919 {{(pid=86188) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 20:23:47 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-4823827a-624d-4830-921b-23e8d10222a8 tempest-AttachVolumeNegativeTest-1537838471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.435s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:23:47 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-4823827a-624d-4830-921b-23e8d10222a8 tempest-AttachVolumeNegativeTest-1537838471 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:23:47 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-4823827a-624d-4830-921b-23e8d10222a8 tempest-AttachVolumeNegativeTest-1537838471 None] Deleted volume successfully. Sep 16 20:23:47 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b7cc066-47ef-40f1-9d15-08ae56fdaf43]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:23:47 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-7ef75eb6-a9cf-4d74-8592-36d4be424ae1 tempest-VolumesExtendTest-351274990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-4f60a98a-6d1a-499f-9c90-41fc0d71c0b2.9b235e92-ddf6-43d4-899d-e45357f43919 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:23:47 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-4823827a-624d-4830-921b-23e8d10222a8 tempest-AttachVolumeNegativeTest-1537838471 None] Lock "cinder-ad18f387-eef5-4f3b-8d1c-5795ce000a83-delete_volume" released by "delete_volume" :: held 1.862s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:23:47 devstack sudo[94521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-4f60a98a-6d1a-499f-9c90-41fc0d71c0b2.9b235e92-ddf6-43d4-899d-e45357f43919 Sep 16 20:23:47 devstack sudo[94521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:23:47 devstack sudo[94521]: pam_unix(sudo:session): session closed for user root Sep 16 20:23:47 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-7ef75eb6-a9cf-4d74-8592-36d4be424ae1 tempest-VolumesExtendTest-351274990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-4f60a98a-6d1a-499f-9c90-41fc0d71c0b2.9b235e92-ddf6-43d4-899d-e45357f43919" returned: 0 in 0.578s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:23:48 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-7ef75eb6-a9cf-4d74-8592-36d4be424ae1 tempest-VolumesExtendTest-351274990 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4f60a98a-6d1a-499f-9c90-41fc0d71c0b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86188) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 20:23:48 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[a45435d2-204d-4780-ad5c-6f235ddd1109]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:23:48 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-7ef75eb6-a9cf-4d74-8592-36d4be424ae1 tempest-VolumesExtendTest-351274990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-4f60a98a-6d1a-499f-9c90-41fc0d71c0b2 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:23:48 devstack sudo[94531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-4f60a98a-6d1a-499f-9c90-41fc0d71c0b2 Sep 16 20:23:48 devstack sudo[94531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:23:48 devstack sudo[94531]: pam_unix(sudo:session): session closed for user root Sep 16 20:23:48 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-7ef75eb6-a9cf-4d74-8592-36d4be424ae1 tempest-VolumesExtendTest-351274990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-4f60a98a-6d1a-499f-9c90-41fc0d71c0b2" returned: 0 in 0.494s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:23:48 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-7ef75eb6-a9cf-4d74-8592-36d4be424ae1 tempest-VolumesExtendTest-351274990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-4f60a98a-6d1a-499f-9c90-41fc0d71c0b2.9b235e92-ddf6-43d4-899d-e45357f43919 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:23:48 devstack sudo[94538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-4f60a98a-6d1a-499f-9c90-41fc0d71c0b2.9b235e92-ddf6-43d4-899d-e45357f43919 Sep 16 20:23:48 devstack sudo[94538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:23:49 devstack sudo[94538]: pam_unix(sudo:session): session closed for user root Sep 16 20:23:49 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-7ef75eb6-a9cf-4d74-8592-36d4be424ae1 tempest-VolumesExtendTest-351274990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-4f60a98a-6d1a-499f-9c90-41fc0d71c0b2.9b235e92-ddf6-43d4-899d-e45357f43919" returned: 0 in 0.557s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:23:49 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-7ef75eb6-a9cf-4d74-8592-36d4be424ae1 tempest-VolumesExtendTest-351274990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-4f60a98a-6d1a-499f-9c90-41fc0d71c0b2.9b235e92-ddf6-43d4-899d-e45357f43919 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:23:49 devstack sudo[94547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-4f60a98a-6d1a-499f-9c90-41fc0d71c0b2.9b235e92-ddf6-43d4-899d-e45357f43919 Sep 16 20:23:49 devstack sudo[94547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:23:49 devstack sudo[94547]: pam_unix(sudo:session): session closed for user root Sep 16 20:23:49 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-7ef75eb6-a9cf-4d74-8592-36d4be424ae1 tempest-VolumesExtendTest-351274990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-4f60a98a-6d1a-499f-9c90-41fc0d71c0b2.9b235e92-ddf6-43d4-899d-e45357f43919" returned: 0 in 0.366s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:23:49 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-7ef75eb6-a9cf-4d74-8592-36d4be424ae1 tempest-VolumesExtendTest-351274990 None] Lock "cinder-quobyte-9b235e92-ddf6-43d4-899d-e45357f43919" released by "_delete_snapshot" :: held 2.211s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:23:49 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-7ef75eb6-a9cf-4d74-8592-36d4be424ae1 tempest-VolumesExtendTest-351274990 None] Lock "cinder-quobyte-4f60a98a-6d1a-499f-9c90-41fc0d71c0b2" released by "delete_snapshot" :: held 2.255s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:23:49 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-7ef75eb6-a9cf-4d74-8592-36d4be424ae1 tempest-VolumesExtendTest-351274990 None] Created reservations ['8a5ca87d-b18d-49c1-aa82-41eef34ad7ca', 'e60f12bf-2c49-4649-9179-5adfadbcec17', 'bbf167e6-d344-4550-8069-d6c6304a2b9e', '5a9c634b-f5f3-4ee2-bbd4-c19cdd78a186'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:23:49 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-7ef75eb6-a9cf-4d74-8592-36d4be424ae1 tempest-VolumesExtendTest-351274990 None] Delete snapshot completed successfully. Sep 16 20:23:49 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-7ef75eb6-a9cf-4d74-8592-36d4be424ae1 tempest-VolumesExtendTest-351274990 None] Lock "cinder-9b235e92-ddf6-43d4-899d-e45357f43919-delete_snapshot" released by "delete_snapshot" :: held 2.454s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:23:50 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-857edf8c-b089-473a-817b-ae3f092b74ed tempest-VolumesExtendTest-351274990 None] Acquiring lock "cinder-4f60a98a-6d1a-499f-9c90-41fc0d71c0b2-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:23:50 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-857edf8c-b089-473a-817b-ae3f092b74ed tempest-VolumesExtendTest-351274990 None] Lock "cinder-4f60a98a-6d1a-499f-9c90-41fc0d71c0b2-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:23:50 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-857edf8c-b089-473a-817b-ae3f092b74ed tempest-VolumesExtendTest-351274990 None] Acquiring lock "cinder-quobyte-4f60a98a-6d1a-499f-9c90-41fc0d71c0b2" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:23:50 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-857edf8c-b089-473a-817b-ae3f092b74ed tempest-VolumesExtendTest-351274990 None] Lock "cinder-quobyte-4f60a98a-6d1a-499f-9c90-41fc0d71c0b2" acquired by "delete_volume" :: waited 0.053s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:23:50 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d014fa6-31d0-4efe-9855-5292e8b8376e]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:23:50 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-857edf8c-b089-473a-817b-ae3f092b74ed tempest-VolumesExtendTest-351274990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-4f60a98a-6d1a-499f-9c90-41fc0d71c0b2 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:23:51 devstack sudo[94551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-4f60a98a-6d1a-499f-9c90-41fc0d71c0b2 Sep 16 20:23:51 devstack sudo[94551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:23:51 devstack sudo[94551]: pam_unix(sudo:session): session closed for user root Sep 16 20:23:51 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-857edf8c-b089-473a-817b-ae3f092b74ed tempest-VolumesExtendTest-351274990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-4f60a98a-6d1a-499f-9c90-41fc0d71c0b2" returned: 0 in 0.532s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:23:51 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-857edf8c-b089-473a-817b-ae3f092b74ed tempest-VolumesExtendTest-351274990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-4f60a98a-6d1a-499f-9c90-41fc0d71c0b2 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:23:51 devstack sudo[94556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-4f60a98a-6d1a-499f-9c90-41fc0d71c0b2 Sep 16 20:23:51 devstack sudo[94556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:23:51 devstack sudo[94556]: pam_unix(sudo:session): session closed for user root Sep 16 20:23:51 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-857edf8c-b089-473a-817b-ae3f092b74ed tempest-VolumesExtendTest-351274990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-4f60a98a-6d1a-499f-9c90-41fc0d71c0b2" returned: 0 in 0.282s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:23:51 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-857edf8c-b089-473a-817b-ae3f092b74ed tempest-VolumesExtendTest-351274990 None] Lock "cinder-quobyte-4f60a98a-6d1a-499f-9c90-41fc0d71c0b2" released by "delete_volume" :: held 0.930s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:23:51 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-857edf8c-b089-473a-817b-ae3f092b74ed tempest-VolumesExtendTest-351274990 None] Created reservations ['0a28f1fd-afb1-475c-a414-dd61574f5a1a', '7d54fbe3-d30f-4c1a-9e92-1ccf90e35752', 'b8416110-3b0b-4fdb-bc69-7960cc1a6187', 'aedeae14-b0ae-4b7c-9eb9-1a916bbd2b7b'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:23:51 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-857edf8c-b089-473a-817b-ae3f092b74ed tempest-VolumesExtendTest-351274990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:23:51 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-857edf8c-b089-473a-817b-ae3f092b74ed tempest-VolumesExtendTest-351274990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:23:51 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-857edf8c-b089-473a-817b-ae3f092b74ed tempest-VolumesExtendTest-351274990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:23:51 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-857edf8c-b089-473a-817b-ae3f092b74ed tempest-VolumesExtendTest-351274990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:23:51 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-857edf8c-b089-473a-817b-ae3f092b74ed tempest-VolumesExtendTest-351274990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:23:51 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-857edf8c-b089-473a-817b-ae3f092b74ed tempest-VolumesExtendTest-351274990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:23:51 devstack sudo[94559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:23:51 devstack sudo[94559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:23:52 devstack sudo[94559]: pam_unix(sudo:session): session closed for user root Sep 16 20:23:52 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-857edf8c-b089-473a-817b-ae3f092b74ed tempest-VolumesExtendTest-351274990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.428s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:23:52 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-857edf8c-b089-473a-817b-ae3f092b74ed tempest-VolumesExtendTest-351274990 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:23:52 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-857edf8c-b089-473a-817b-ae3f092b74ed tempest-VolumesExtendTest-351274990 None] Deleted volume successfully. Sep 16 20:23:52 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-857edf8c-b089-473a-817b-ae3f092b74ed tempest-VolumesExtendTest-351274990 None] Lock "cinder-4f60a98a-6d1a-499f-9c90-41fc0d71c0b2-delete_volume" released by "delete_volume" :: held 1.693s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:23:52 devstack cinder-volume[86188]: DEBUG oslo_service.periodic_task [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86188) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 20:23:52 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:23:52 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:23:52 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:23:53 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:23:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:23:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:23:53 devstack sudo[94596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:23:53 devstack sudo[94596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:23:53 devstack sudo[94596]: pam_unix(sudo:session): session closed for user root Sep 16 20:23:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.493s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:23:53 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:23:53 devstack cinder-volume[86188]: DEBUG oslo_service.periodic_task [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Running periodic task VolumeManager._thread_info {{(pid=86188) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 20:23:53 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] thread count: 28 {{(pid=86188) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 16 20:23:53 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] thread info: [<_MainThread(MainThread, started 139858124406912)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86188) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 16 20:23:58 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0e6cf5d-3d69-4319-bbd5-fe563bd1d940 tempest-VolumesSnapshotListTestJSON-1719130302 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:23:58 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f0e6cf5d-3d69-4319-bbd5-fe563bd1d940 tempest-VolumesSnapshotListTestJSON-1719130302 None] Flow 'volume_create_manager' (6dc695ff-1ff5-47f5-8301-dabc4f43f650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:23:58 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f0e6cf5d-3d69-4319-bbd5-fe563bd1d940 tempest-VolumesSnapshotListTestJSON-1719130302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a6a51f5-6036-4bca-92b5-ba0fbfdfcc9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:23:58 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f0e6cf5d-3d69-4319-bbd5-fe563bd1d940 tempest-VolumesSnapshotListTestJSON-1719130302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a6a51f5-6036-4bca-92b5-ba0fbfdfcc9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:23:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-788333756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d74a6d2e-290f-4f82-b93b-0e0737e5d2e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3e498cd0cac44ed98f0964ec2971635',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:23:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:23:58Z,use_quota=True,user_id='ae97e092a5124e8db815294f5718711d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:23:58 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f0e6cf5d-3d69-4319-bbd5-fe563bd1d940 tempest-VolumesSnapshotListTestJSON-1719130302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ed1bde3-d432-4e17-9ed4-5fd6b6b2c4da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:23:58 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f0e6cf5d-3d69-4319-bbd5-fe563bd1d940 tempest-VolumesSnapshotListTestJSON-1719130302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ed1bde3-d432-4e17-9ed4-5fd6b6b2c4da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:23:58 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f0e6cf5d-3d69-4319-bbd5-fe563bd1d940 tempest-VolumesSnapshotListTestJSON-1719130302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ce4dbb9-36e2-46ca-839d-913342ef4004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:23:58 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f0e6cf5d-3d69-4319-bbd5-fe563bd1d940 tempest-VolumesSnapshotListTestJSON-1719130302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ce4dbb9-36e2-46ca-839d-913342ef4004) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd74a6d2e-290f-4f82-b93b-0e0737e5d2e5', 'volume_name': 'volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:23:58 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f0e6cf5d-3d69-4319-bbd5-fe563bd1d940 tempest-VolumesSnapshotListTestJSON-1719130302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5872fcd-6a0a-4ec1-9ba4-41e8bb92aadb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:23:58 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f0e6cf5d-3d69-4319-bbd5-fe563bd1d940 tempest-VolumesSnapshotListTestJSON-1719130302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5872fcd-6a0a-4ec1-9ba4-41e8bb92aadb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:23:58 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f0e6cf5d-3d69-4319-bbd5-fe563bd1d940 tempest-VolumesSnapshotListTestJSON-1719130302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dc7773a-044f-4a1d-8203-3d22f4c23da3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:23:58 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-f0e6cf5d-3d69-4319-bbd5-fe563bd1d940 tempest-VolumesSnapshotListTestJSON-1719130302 None] Volume d74a6d2e-290f-4f82-b93b-0e0737e5d2e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5', 'volume_size': 1} Sep 16 20:23:58 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-f0e6cf5d-3d69-4319-bbd5-fe563bd1d940 tempest-VolumesSnapshotListTestJSON-1719130302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:23:58 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-f0e6cf5d-3d69-4319-bbd5-fe563bd1d940 tempest-VolumesSnapshotListTestJSON-1719130302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:23:58 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-f0e6cf5d-3d69-4319-bbd5-fe563bd1d940 tempest-VolumesSnapshotListTestJSON-1719130302 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:23:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-788333756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d74a6d2e-290f-4f82-b93b-0e0737e5d2e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3e498cd0cac44ed98f0964ec2971635',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:23:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:23:58Z,use_quota=True,user_id='ae97e092a5124e8db815294f5718711d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:23:58 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-f0e6cf5d-3d69-4319-bbd5-fe563bd1d940 tempest-VolumesSnapshotListTestJSON-1719130302 None] Creating volume d74a6d2e-290f-4f82-b93b-0e0737e5d2e5 {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:23:58 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-f0e6cf5d-3d69-4319-bbd5-fe563bd1d940 tempest-VolumesSnapshotListTestJSON-1719130302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:23:58 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-f0e6cf5d-3d69-4319-bbd5-fe563bd1d940 tempest-VolumesSnapshotListTestJSON-1719130302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:23:58 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-f0e6cf5d-3d69-4319-bbd5-fe563bd1d940 tempest-VolumesSnapshotListTestJSON-1719130302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:23:58 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-f0e6cf5d-3d69-4319-bbd5-fe563bd1d940 tempest-VolumesSnapshotListTestJSON-1719130302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:23:58 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-f0e6cf5d-3d69-4319-bbd5-fe563bd1d940 tempest-VolumesSnapshotListTestJSON-1719130302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:23:58 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-f0e6cf5d-3d69-4319-bbd5-fe563bd1d940 tempest-VolumesSnapshotListTestJSON-1719130302 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:23:58 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-f0e6cf5d-3d69-4319-bbd5-fe563bd1d940 tempest-VolumesSnapshotListTestJSON-1719130302 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:23:58 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f0e6cf5d-3d69-4319-bbd5-fe563bd1d940 tempest-VolumesSnapshotListTestJSON-1719130302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:23:58 devstack sudo[94635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5 1073741824 Sep 16 20:23:58 devstack sudo[94635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:23:59 devstack sudo[94635]: pam_unix(sudo:session): session closed for user root Sep 16 20:23:59 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f0e6cf5d-3d69-4319-bbd5-fe563bd1d940 tempest-VolumesSnapshotListTestJSON-1719130302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5 1073741824" returned: 0 in 0.559s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:23:59 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f0e6cf5d-3d69-4319-bbd5-fe563bd1d940 tempest-VolumesSnapshotListTestJSON-1719130302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:23:59 devstack sudo[94642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5 Sep 16 20:23:59 devstack sudo[94642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:23:59 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [req-f2641c9c-3ad8-4de4-80c1-566f2f66d47e req-6f4f4d03-8633-489b-a615-8545f0f3cee2 tempest-VolumesGetTestJSON-36093036 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:23:59 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [req-f2641c9c-3ad8-4de4-80c1-566f2f66d47e req-6f4f4d03-8633-489b-a615-8545f0f3cee2 tempest-VolumesGetTestJSON-36093036 None] Flow 'volume_create_manager' (17b14773-81e0-4d8b-bcba-023b75ea1993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:23:59 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [req-f2641c9c-3ad8-4de4-80c1-566f2f66d47e req-6f4f4d03-8633-489b-a615-8545f0f3cee2 tempest-VolumesGetTestJSON-36093036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1715cab5-ac60-4ff2-8932-b52873a2757e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:23:59 devstack sudo[94642]: pam_unix(sudo:session): session closed for user root Sep 16 20:23:59 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [req-f2641c9c-3ad8-4de4-80c1-566f2f66d47e req-6f4f4d03-8633-489b-a615-8545f0f3cee2 tempest-VolumesGetTestJSON-36093036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1715cab5-ac60-4ff2-8932-b52873a2757e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:23:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1289015081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0a5efdb-2df4-4310-b4fd-6fb2dfe51ed7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6fa99406d4004d328b6b0b9e3ed47690',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:23:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:23:59Z,use_quota=True,user_id='69b2ab243257479185c856f5be05693a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:23:59 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [req-f2641c9c-3ad8-4de4-80c1-566f2f66d47e req-6f4f4d03-8633-489b-a615-8545f0f3cee2 tempest-VolumesGetTestJSON-36093036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b93e40f3-2df4-4984-8bfe-b498d5fd6b9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:23:59 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [req-f2641c9c-3ad8-4de4-80c1-566f2f66d47e req-6f4f4d03-8633-489b-a615-8545f0f3cee2 tempest-VolumesGetTestJSON-36093036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b93e40f3-2df4-4984-8bfe-b498d5fd6b9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:23:59 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [req-f2641c9c-3ad8-4de4-80c1-566f2f66d47e req-6f4f4d03-8633-489b-a615-8545f0f3cee2 tempest-VolumesGetTestJSON-36093036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cd29c67-780c-4c4f-a9d4-5b4c549c1a7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:23:59 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [req-f2641c9c-3ad8-4de4-80c1-566f2f66d47e req-6f4f4d03-8633-489b-a615-8545f0f3cee2 tempest-VolumesGetTestJSON-36093036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cd29c67-780c-4c4f-a9d4-5b4c549c1a7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0a5efdb-2df4-4310-b4fd-6fb2dfe51ed7', 'volume_name': 'volume-d0a5efdb-2df4-4310-b4fd-6fb2dfe51ed7', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:23:59 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [req-f2641c9c-3ad8-4de4-80c1-566f2f66d47e req-6f4f4d03-8633-489b-a615-8545f0f3cee2 tempest-VolumesGetTestJSON-36093036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50bb00e4-1b8b-49eb-9738-aa9eb6d823fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:23:59 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [req-f2641c9c-3ad8-4de4-80c1-566f2f66d47e req-6f4f4d03-8633-489b-a615-8545f0f3cee2 tempest-VolumesGetTestJSON-36093036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50bb00e4-1b8b-49eb-9738-aa9eb6d823fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:23:59 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [req-f2641c9c-3ad8-4de4-80c1-566f2f66d47e req-6f4f4d03-8633-489b-a615-8545f0f3cee2 tempest-VolumesGetTestJSON-36093036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (340da0f6-c580-437b-8c47-04e673f9d1f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:23:59 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [req-f2641c9c-3ad8-4de4-80c1-566f2f66d47e req-6f4f4d03-8633-489b-a615-8545f0f3cee2 tempest-VolumesGetTestJSON-36093036 None] Volume d0a5efdb-2df4-4310-b4fd-6fb2dfe51ed7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0a5efdb-2df4-4310-b4fd-6fb2dfe51ed7', 'volume_size': 1} Sep 16 20:23:59 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [req-f2641c9c-3ad8-4de4-80c1-566f2f66d47e req-6f4f4d03-8633-489b-a615-8545f0f3cee2 tempest-VolumesGetTestJSON-36093036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:23:59 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f0e6cf5d-3d69-4319-bbd5-fe563bd1d940 tempest-VolumesSnapshotListTestJSON-1719130302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5" returned: 0 in 0.367s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:23:59 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-f0e6cf5d-3d69-4319-bbd5-fe563bd1d940 tempest-VolumesSnapshotListTestJSON-1719130302 None] <== create_volume: return (989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:23:59 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-f0e6cf5d-3d69-4319-bbd5-fe563bd1d940 tempest-VolumesSnapshotListTestJSON-1719130302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.992s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:23:59 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [req-f2641c9c-3ad8-4de4-80c1-566f2f66d47e req-6f4f4d03-8633-489b-a615-8545f0f3cee2 tempest-VolumesGetTestJSON-36093036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:23:59 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [req-f2641c9c-3ad8-4de4-80c1-566f2f66d47e req-6f4f4d03-8633-489b-a615-8545f0f3cee2 tempest-VolumesGetTestJSON-36093036 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:23:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1289015081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0a5efdb-2df4-4310-b4fd-6fb2dfe51ed7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6fa99406d4004d328b6b0b9e3ed47690',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:23:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:23:59Z,use_quota=True,user_id='69b2ab243257479185c856f5be05693a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:23:59 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [req-f2641c9c-3ad8-4de4-80c1-566f2f66d47e req-6f4f4d03-8633-489b-a615-8545f0f3cee2 tempest-VolumesGetTestJSON-36093036 None] Creating volume d0a5efdb-2df4-4310-b4fd-6fb2dfe51ed7 {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:23:59 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [req-f2641c9c-3ad8-4de4-80c1-566f2f66d47e req-6f4f4d03-8633-489b-a615-8545f0f3cee2 tempest-VolumesGetTestJSON-36093036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:23:59 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [req-f2641c9c-3ad8-4de4-80c1-566f2f66d47e req-6f4f4d03-8633-489b-a615-8545f0f3cee2 tempest-VolumesGetTestJSON-36093036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:23:59 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [req-f2641c9c-3ad8-4de4-80c1-566f2f66d47e req-6f4f4d03-8633-489b-a615-8545f0f3cee2 tempest-VolumesGetTestJSON-36093036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:23:59 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [req-f2641c9c-3ad8-4de4-80c1-566f2f66d47e req-6f4f4d03-8633-489b-a615-8545f0f3cee2 tempest-VolumesGetTestJSON-36093036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:23:59 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [req-f2641c9c-3ad8-4de4-80c1-566f2f66d47e req-6f4f4d03-8633-489b-a615-8545f0f3cee2 tempest-VolumesGetTestJSON-36093036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:23:59 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [req-f2641c9c-3ad8-4de4-80c1-566f2f66d47e req-6f4f4d03-8633-489b-a615-8545f0f3cee2 tempest-VolumesGetTestJSON-36093036 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:23:59 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [req-f2641c9c-3ad8-4de4-80c1-566f2f66d47e req-6f4f4d03-8633-489b-a615-8545f0f3cee2 tempest-VolumesGetTestJSON-36093036 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:23:59 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [req-f2641c9c-3ad8-4de4-80c1-566f2f66d47e req-6f4f4d03-8633-489b-a615-8545f0f3cee2 tempest-VolumesGetTestJSON-36093036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d0a5efdb-2df4-4310-b4fd-6fb2dfe51ed7 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:23:59 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f0e6cf5d-3d69-4319-bbd5-fe563bd1d940 tempest-VolumesSnapshotListTestJSON-1719130302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dc7773a-044f-4a1d-8203-3d22f4c23da3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:23:59 devstack sudo[94645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d0a5efdb-2df4-4310-b4fd-6fb2dfe51ed7 1073741824 Sep 16 20:23:59 devstack sudo[94645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:23:59 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f0e6cf5d-3d69-4319-bbd5-fe563bd1d940 tempest-VolumesSnapshotListTestJSON-1719130302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (162a7a38-4162-412b-9977-f10e660eb8d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:23:59 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-f0e6cf5d-3d69-4319-bbd5-fe563bd1d940 tempest-VolumesSnapshotListTestJSON-1719130302 None] Volume volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5 (d74a6d2e-290f-4f82-b93b-0e0737e5d2e5): created successfully Sep 16 20:23:59 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f0e6cf5d-3d69-4319-bbd5-fe563bd1d940 tempest-VolumesSnapshotListTestJSON-1719130302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (162a7a38-4162-412b-9977-f10e660eb8d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:23:59 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f0e6cf5d-3d69-4319-bbd5-fe563bd1d940 tempest-VolumesSnapshotListTestJSON-1719130302 None] Flow 'volume_create_manager' (6dc695ff-1ff5-47f5-8301-dabc4f43f650) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:23:59 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-f0e6cf5d-3d69-4319-bbd5-fe563bd1d940 tempest-VolumesSnapshotListTestJSON-1719130302 None] Created volume successfully. Sep 16 20:23:59 devstack sudo[94645]: pam_unix(sudo:session): session closed for user root Sep 16 20:23:59 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [req-f2641c9c-3ad8-4de4-80c1-566f2f66d47e req-6f4f4d03-8633-489b-a615-8545f0f3cee2 tempest-VolumesGetTestJSON-36093036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d0a5efdb-2df4-4310-b4fd-6fb2dfe51ed7 1073741824" returned: 0 in 0.454s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:23:59 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [req-f2641c9c-3ad8-4de4-80c1-566f2f66d47e req-6f4f4d03-8633-489b-a615-8545f0f3cee2 tempest-VolumesGetTestJSON-36093036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d0a5efdb-2df4-4310-b4fd-6fb2dfe51ed7 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:23:59 devstack sudo[94652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d0a5efdb-2df4-4310-b4fd-6fb2dfe51ed7 Sep 16 20:23:59 devstack sudo[94652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:24:00 devstack sudo[94652]: pam_unix(sudo:session): session closed for user root Sep 16 20:24:00 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [req-f2641c9c-3ad8-4de4-80c1-566f2f66d47e req-6f4f4d03-8633-489b-a615-8545f0f3cee2 tempest-VolumesGetTestJSON-36093036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d0a5efdb-2df4-4310-b4fd-6fb2dfe51ed7" returned: 0 in 0.279s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:24:00 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [req-f2641c9c-3ad8-4de4-80c1-566f2f66d47e req-6f4f4d03-8633-489b-a615-8545f0f3cee2 tempest-VolumesGetTestJSON-36093036 None] <== create_volume: return (769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:24:00 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [req-f2641c9c-3ad8-4de4-80c1-566f2f66d47e req-6f4f4d03-8633-489b-a615-8545f0f3cee2 tempest-VolumesGetTestJSON-36093036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.771s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:24:00 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [req-f2641c9c-3ad8-4de4-80c1-566f2f66d47e req-6f4f4d03-8633-489b-a615-8545f0f3cee2 tempest-VolumesGetTestJSON-36093036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (340da0f6-c580-437b-8c47-04e673f9d1f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0a5efdb-2df4-4310-b4fd-6fb2dfe51ed7', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:24:00 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [req-f2641c9c-3ad8-4de4-80c1-566f2f66d47e req-6f4f4d03-8633-489b-a615-8545f0f3cee2 tempest-VolumesGetTestJSON-36093036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c60a982-133b-41f6-ac39-07dbe26f3541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:24:00 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [req-f2641c9c-3ad8-4de4-80c1-566f2f66d47e req-6f4f4d03-8633-489b-a615-8545f0f3cee2 tempest-VolumesGetTestJSON-36093036 None] Volume volume-d0a5efdb-2df4-4310-b4fd-6fb2dfe51ed7 (d0a5efdb-2df4-4310-b4fd-6fb2dfe51ed7): created successfully Sep 16 20:24:00 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [req-f2641c9c-3ad8-4de4-80c1-566f2f66d47e req-6f4f4d03-8633-489b-a615-8545f0f3cee2 tempest-VolumesGetTestJSON-36093036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c60a982-133b-41f6-ac39-07dbe26f3541) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:24:00 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [req-f2641c9c-3ad8-4de4-80c1-566f2f66d47e req-6f4f4d03-8633-489b-a615-8545f0f3cee2 tempest-VolumesGetTestJSON-36093036 None] Flow 'volume_create_manager' (17b14773-81e0-4d8b-bcba-023b75ea1993) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:24:00 devstack cinder-volume[86188]: INFO cinder.volume.manager [req-f2641c9c-3ad8-4de4-80c1-566f2f66d47e req-6f4f4d03-8633-489b-a615-8545f0f3cee2 tempest-VolumesGetTestJSON-36093036 None] Created volume successfully. Sep 16 20:24:01 devstack cinder-volume[86188]: DEBUG cinder.coordination [req-ca0c9349-24ff-4536-80e2-27a88d5b0272 req-bc98680d-00bc-484a-8f1a-fafbb5918631 tempest-VolumesGetTestJSON-36093036 None] Acquiring lock "cinder-d0a5efdb-2df4-4310-b4fd-6fb2dfe51ed7-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:24:01 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-2c40503c-fbbb-4178-af70-8ff8ff52c29b tempest-VolumesSnapshotListTestJSON-1719130302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:24:01 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-2c40503c-fbbb-4178-af70-8ff8ff52c29b tempest-VolumesSnapshotListTestJSON-1719130302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:24:01 devstack cinder-volume[86188]: DEBUG cinder.coordination [req-ca0c9349-24ff-4536-80e2-27a88d5b0272 req-bc98680d-00bc-484a-8f1a-fafbb5918631 tempest-VolumesGetTestJSON-36093036 None] Lock "cinder-d0a5efdb-2df4-4310-b4fd-6fb2dfe51ed7-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:24:01 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-2c40503c-fbbb-4178-af70-8ff8ff52c29b tempest-VolumesSnapshotListTestJSON-1719130302 None] Creating offline snapshot 7224d463-ab9e-4459-b8a6-4e0c64b571f4 of volume d74a6d2e-290f-4f82-b93b-0e0737e5d2e5 {{(pid=86188) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 20:24:01 devstack cinder-volume[86188]: DEBUG cinder.coordination [req-ca0c9349-24ff-4536-80e2-27a88d5b0272 req-bc98680d-00bc-484a-8f1a-fafbb5918631 tempest-VolumesGetTestJSON-36093036 None] Acquiring lock "cinder-quobyte-d0a5efdb-2df4-4310-b4fd-6fb2dfe51ed7" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:24:01 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[78b1a34f-6256-4c56-b6d3-57cc5e3bab00]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:24:01 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-2c40503c-fbbb-4178-af70-8ff8ff52c29b tempest-VolumesSnapshotListTestJSON-1719130302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:24:01 devstack cinder-volume[86188]: DEBUG cinder.coordination [req-ca0c9349-24ff-4536-80e2-27a88d5b0272 req-bc98680d-00bc-484a-8f1a-fafbb5918631 tempest-VolumesGetTestJSON-36093036 None] Lock "cinder-quobyte-d0a5efdb-2df4-4310-b4fd-6fb2dfe51ed7" acquired by "delete_volume" :: waited 0.040s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:24:01 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[55603276-f546-4c11-a75f-8fcce3de288b]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:24:01 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [req-ca0c9349-24ff-4536-80e2-27a88d5b0272 req-bc98680d-00bc-484a-8f1a-fafbb5918631 tempest-VolumesGetTestJSON-36093036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d0a5efdb-2df4-4310-b4fd-6fb2dfe51ed7 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:24:01 devstack sudo[94710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5 Sep 16 20:24:01 devstack sudo[94710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:24:01 devstack sudo[94713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d0a5efdb-2df4-4310-b4fd-6fb2dfe51ed7 Sep 16 20:24:01 devstack sudo[94713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:24:01 devstack sudo[94710]: pam_unix(sudo:session): session closed for user root Sep 16 20:24:01 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-2c40503c-fbbb-4178-af70-8ff8ff52c29b tempest-VolumesSnapshotListTestJSON-1719130302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5" returned: 0 in 0.481s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:24:01 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-2c40503c-fbbb-4178-af70-8ff8ff52c29b tempest-VolumesSnapshotListTestJSON-1719130302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5.7224d463-ab9e-4459-b8a6-4e0c64b571f4 1G {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:24:01 devstack sudo[94726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5.7224d463-ab9e-4459-b8a6-4e0c64b571f4 1G Sep 16 20:24:01 devstack sudo[94726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:24:01 devstack sudo[94713]: pam_unix(sudo:session): session closed for user root Sep 16 20:24:01 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [req-ca0c9349-24ff-4536-80e2-27a88d5b0272 req-bc98680d-00bc-484a-8f1a-fafbb5918631 tempest-VolumesGetTestJSON-36093036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d0a5efdb-2df4-4310-b4fd-6fb2dfe51ed7" returned: 0 in 0.645s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:24:01 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [req-ca0c9349-24ff-4536-80e2-27a88d5b0272 req-bc98680d-00bc-484a-8f1a-fafbb5918631 tempest-VolumesGetTestJSON-36093036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d0a5efdb-2df4-4310-b4fd-6fb2dfe51ed7 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:24:01 devstack sudo[94736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d0a5efdb-2df4-4310-b4fd-6fb2dfe51ed7 Sep 16 20:24:01 devstack sudo[94736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:24:02 devstack sudo[94726]: pam_unix(sudo:session): session closed for user root Sep 16 20:24:02 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-2c40503c-fbbb-4178-af70-8ff8ff52c29b tempest-VolumesSnapshotListTestJSON-1719130302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5.7224d463-ab9e-4459-b8a6-4e0c64b571f4 1G" returned: 0 in 0.704s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:24:02 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-2c40503c-fbbb-4178-af70-8ff8ff52c29b tempest-VolumesSnapshotListTestJSON-1719130302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5 -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5.7224d463-ab9e-4459-b8a6-4e0c64b571f4 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:24:02 devstack sudo[94736]: pam_unix(sudo:session): session closed for user root Sep 16 20:24:02 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [req-ca0c9349-24ff-4536-80e2-27a88d5b0272 req-bc98680d-00bc-484a-8f1a-fafbb5918631 tempest-VolumesGetTestJSON-36093036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d0a5efdb-2df4-4310-b4fd-6fb2dfe51ed7" returned: 0 in 0.475s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:24:02 devstack sudo[94742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5 -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5.7224d463-ab9e-4459-b8a6-4e0c64b571f4 Sep 16 20:24:02 devstack sudo[94742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:24:02 devstack cinder-volume[86188]: DEBUG cinder.coordination [req-ca0c9349-24ff-4536-80e2-27a88d5b0272 req-bc98680d-00bc-484a-8f1a-fafbb5918631 tempest-VolumesGetTestJSON-36093036 None] Lock "cinder-quobyte-d0a5efdb-2df4-4310-b4fd-6fb2dfe51ed7" released by "delete_volume" :: held 1.219s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:24:02 devstack cinder-volume[86188]: DEBUG cinder.quota [req-ca0c9349-24ff-4536-80e2-27a88d5b0272 req-bc98680d-00bc-484a-8f1a-fafbb5918631 tempest-VolumesGetTestJSON-36093036 None] Created reservations ['a54903f6-9d48-4f3f-93b1-25c0e3525b8d', 'a5d20828-9865-4cc0-ad8d-1222e4e701fa', 'd8bf66f6-edf1-4172-a128-3dc6f1d6dfa5', '398d1843-70fd-4010-95a6-e8861965d18c'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:24:02 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [req-ca0c9349-24ff-4536-80e2-27a88d5b0272 req-bc98680d-00bc-484a-8f1a-fafbb5918631 tempest-VolumesGetTestJSON-36093036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:24:02 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [req-ca0c9349-24ff-4536-80e2-27a88d5b0272 req-bc98680d-00bc-484a-8f1a-fafbb5918631 tempest-VolumesGetTestJSON-36093036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:24:02 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [req-ca0c9349-24ff-4536-80e2-27a88d5b0272 req-bc98680d-00bc-484a-8f1a-fafbb5918631 tempest-VolumesGetTestJSON-36093036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:24:02 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [req-ca0c9349-24ff-4536-80e2-27a88d5b0272 req-bc98680d-00bc-484a-8f1a-fafbb5918631 tempest-VolumesGetTestJSON-36093036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:24:02 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [req-ca0c9349-24ff-4536-80e2-27a88d5b0272 req-bc98680d-00bc-484a-8f1a-fafbb5918631 tempest-VolumesGetTestJSON-36093036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:24:02 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [req-ca0c9349-24ff-4536-80e2-27a88d5b0272 req-bc98680d-00bc-484a-8f1a-fafbb5918631 tempest-VolumesGetTestJSON-36093036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:24:02 devstack sudo[94744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:24:02 devstack sudo[94744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:24:02 devstack sudo[94742]: pam_unix(sudo:session): session closed for user root Sep 16 20:24:02 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-2c40503c-fbbb-4178-af70-8ff8ff52c29b tempest-VolumesSnapshotListTestJSON-1719130302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5 -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5.7224d463-ab9e-4459-b8a6-4e0c64b571f4" returned: 0 in 0.356s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:24:02 devstack cinder-volume[86188]: WARNING cinder.volume.drivers.remotefs [None req-2c40503c-fbbb-4178-af70-8ff8ff52c29b tempest-VolumesSnapshotListTestJSON-1719130302 None] /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5.7224d463-ab9e-4459-b8a6-4e0c64b571f4 is being set with open permissions: ugo+rw Sep 16 20:24:02 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-2c40503c-fbbb-4178-af70-8ff8ff52c29b tempest-VolumesSnapshotListTestJSON-1719130302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5.7224d463-ab9e-4459-b8a6-4e0c64b571f4 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:24:02 devstack sudo[94749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5.7224d463-ab9e-4459-b8a6-4e0c64b571f4 Sep 16 20:24:02 devstack sudo[94749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:24:02 devstack sudo[94744]: pam_unix(sudo:session): session closed for user root Sep 16 20:24:02 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [req-ca0c9349-24ff-4536-80e2-27a88d5b0272 req-bc98680d-00bc-484a-8f1a-fafbb5918631 tempest-VolumesGetTestJSON-36093036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.264s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:24:02 devstack cinder-volume[86188]: DEBUG cinder.manager [req-ca0c9349-24ff-4536-80e2-27a88d5b0272 req-bc98680d-00bc-484a-8f1a-fafbb5918631 tempest-VolumesGetTestJSON-36093036 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:24:02 devstack cinder-volume[86188]: INFO cinder.volume.manager [req-ca0c9349-24ff-4536-80e2-27a88d5b0272 req-bc98680d-00bc-484a-8f1a-fafbb5918631 tempest-VolumesGetTestJSON-36093036 None] Deleted volume successfully. Sep 16 20:24:02 devstack cinder-volume[86188]: DEBUG cinder.coordination [req-ca0c9349-24ff-4536-80e2-27a88d5b0272 req-bc98680d-00bc-484a-8f1a-fafbb5918631 tempest-VolumesGetTestJSON-36093036 None] Lock "cinder-d0a5efdb-2df4-4310-b4fd-6fb2dfe51ed7-delete_volume" released by "delete_volume" :: held 1.788s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:24:02 devstack sudo[94749]: pam_unix(sudo:session): session closed for user root Sep 16 20:24:03 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-2c40503c-fbbb-4178-af70-8ff8ff52c29b tempest-VolumesSnapshotListTestJSON-1719130302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5.7224d463-ab9e-4459-b8a6-4e0c64b571f4" returned: 0 in 0.246s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:24:03 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-2c40503c-fbbb-4178-af70-8ff8ff52c29b tempest-VolumesSnapshotListTestJSON-1719130302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5.info {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:24:03 devstack sudo[94753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5.info Sep 16 20:24:03 devstack sudo[94753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:24:03 devstack sudo[94753]: pam_unix(sudo:session): session closed for user root Sep 16 20:24:03 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-2c40503c-fbbb-4178-af70-8ff8ff52c29b tempest-VolumesSnapshotListTestJSON-1719130302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5.info" returned: 0 in 0.292s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:24:03 devstack cinder-volume[86188]: WARNING cinder.volume.drivers.remotefs [None req-2c40503c-fbbb-4178-af70-8ff8ff52c29b tempest-VolumesSnapshotListTestJSON-1719130302 None] /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5.info is being set with open permissions: ugo+rw Sep 16 20:24:03 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-2c40503c-fbbb-4178-af70-8ff8ff52c29b tempest-VolumesSnapshotListTestJSON-1719130302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5.info {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:24:03 devstack sudo[94756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5.info Sep 16 20:24:03 devstack sudo[94756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:24:03 devstack sudo[94756]: pam_unix(sudo:session): session closed for user root Sep 16 20:24:03 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-2c40503c-fbbb-4178-af70-8ff8ff52c29b tempest-VolumesSnapshotListTestJSON-1719130302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5.info" returned: 0 in 0.391s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:24:03 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-2c40503c-fbbb-4178-af70-8ff8ff52c29b tempest-VolumesSnapshotListTestJSON-1719130302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.640s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:24:03 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-2c40503c-fbbb-4178-af70-8ff8ff52c29b tempest-VolumesSnapshotListTestJSON-1719130302 None] Create snapshot completed successfully Sep 16 20:24:04 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-964d1ac6-9767-4356-af5c-1f17f2c1c131 tempest-VolumesSnapshotListTestJSON-1719130302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:24:04 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-964d1ac6-9767-4356-af5c-1f17f2c1c131 tempest-VolumesSnapshotListTestJSON-1719130302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:24:04 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-964d1ac6-9767-4356-af5c-1f17f2c1c131 tempest-VolumesSnapshotListTestJSON-1719130302 None] Creating offline snapshot cf1f484c-425b-415e-b949-2ef22275ed0a of volume d74a6d2e-290f-4f82-b93b-0e0737e5d2e5 {{(pid=86188) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 20:24:04 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[d619b2b8-7df7-41e4-becf-6a515e007c44]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:24:04 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-964d1ac6-9767-4356-af5c-1f17f2c1c131 tempest-VolumesSnapshotListTestJSON-1719130302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5.7224d463-ab9e-4459-b8a6-4e0c64b571f4 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:24:04 devstack sudo[94766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5.7224d463-ab9e-4459-b8a6-4e0c64b571f4 Sep 16 20:24:04 devstack sudo[94766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:24:05 devstack sudo[94766]: pam_unix(sudo:session): session closed for user root Sep 16 20:24:05 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-964d1ac6-9767-4356-af5c-1f17f2c1c131 tempest-VolumesSnapshotListTestJSON-1719130302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5.7224d463-ab9e-4459-b8a6-4e0c64b571f4" returned: 0 in 0.839s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:24:05 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-964d1ac6-9767-4356-af5c-1f17f2c1c131 tempest-VolumesSnapshotListTestJSON-1719130302 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86188) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 20:24:05 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-964d1ac6-9767-4356-af5c-1f17f2c1c131 tempest-VolumesSnapshotListTestJSON-1719130302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5.7224d463-ab9e-4459-b8a6-4e0c64b571f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5.cf1f484c-425b-415e-b949-2ef22275ed0a 1G {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:24:05 devstack sudo[94772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5.7224d463-ab9e-4459-b8a6-4e0c64b571f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5.cf1f484c-425b-415e-b949-2ef22275ed0a 1G Sep 16 20:24:05 devstack sudo[94772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:24:06 devstack sudo[94772]: pam_unix(sudo:session): session closed for user root Sep 16 20:24:06 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-964d1ac6-9767-4356-af5c-1f17f2c1c131 tempest-VolumesSnapshotListTestJSON-1719130302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5.7224d463-ab9e-4459-b8a6-4e0c64b571f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5.cf1f484c-425b-415e-b949-2ef22275ed0a 1G" returned: 0 in 0.679s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:24:06 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-964d1ac6-9767-4356-af5c-1f17f2c1c131 tempest-VolumesSnapshotListTestJSON-1719130302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5.7224d463-ab9e-4459-b8a6-4e0c64b571f4 -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5.cf1f484c-425b-415e-b949-2ef22275ed0a {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:24:06 devstack sudo[94783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5.7224d463-ab9e-4459-b8a6-4e0c64b571f4 -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5.cf1f484c-425b-415e-b949-2ef22275ed0a Sep 16 20:24:06 devstack sudo[94783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:24:06 devstack sudo[94783]: pam_unix(sudo:session): session closed for user root Sep 16 20:24:06 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-964d1ac6-9767-4356-af5c-1f17f2c1c131 tempest-VolumesSnapshotListTestJSON-1719130302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5.7224d463-ab9e-4459-b8a6-4e0c64b571f4 -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5.cf1f484c-425b-415e-b949-2ef22275ed0a" returned: 0 in 0.460s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:24:06 devstack cinder-volume[86188]: WARNING cinder.volume.drivers.remotefs [None req-964d1ac6-9767-4356-af5c-1f17f2c1c131 tempest-VolumesSnapshotListTestJSON-1719130302 None] /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5.cf1f484c-425b-415e-b949-2ef22275ed0a is being set with open permissions: ugo+rw Sep 16 20:24:06 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-964d1ac6-9767-4356-af5c-1f17f2c1c131 tempest-VolumesSnapshotListTestJSON-1719130302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5.cf1f484c-425b-415e-b949-2ef22275ed0a {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:24:06 devstack sudo[94797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5.cf1f484c-425b-415e-b949-2ef22275ed0a Sep 16 20:24:06 devstack sudo[94797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:24:07 devstack sudo[94797]: pam_unix(sudo:session): session closed for user root Sep 16 20:24:07 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-964d1ac6-9767-4356-af5c-1f17f2c1c131 tempest-VolumesSnapshotListTestJSON-1719130302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5.cf1f484c-425b-415e-b949-2ef22275ed0a" returned: 0 in 0.352s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:24:07 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-964d1ac6-9767-4356-af5c-1f17f2c1c131 tempest-VolumesSnapshotListTestJSON-1719130302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.517s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:24:07 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-964d1ac6-9767-4356-af5c-1f17f2c1c131 tempest-VolumesSnapshotListTestJSON-1719130302 None] Create snapshot completed successfully Sep 16 20:24:08 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-6a209bcd-8df7-45fb-bfc9-658275806046 tempest-VolumesSnapshotListTestJSON-1719130302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:24:08 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-6a209bcd-8df7-45fb-bfc9-658275806046 tempest-VolumesSnapshotListTestJSON-1719130302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:24:08 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-6a209bcd-8df7-45fb-bfc9-658275806046 tempest-VolumesSnapshotListTestJSON-1719130302 None] Creating offline snapshot 87dadc74-178e-4e83-b4b0-4f0e53259cf4 of volume d74a6d2e-290f-4f82-b93b-0e0737e5d2e5 {{(pid=86188) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 20:24:08 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cc64003-0b55-40b1-9f14-a75a2e5ec96c]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:24:08 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-6a209bcd-8df7-45fb-bfc9-658275806046 tempest-VolumesSnapshotListTestJSON-1719130302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5.cf1f484c-425b-415e-b949-2ef22275ed0a {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:24:08 devstack sudo[94805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5.cf1f484c-425b-415e-b949-2ef22275ed0a Sep 16 20:24:08 devstack sudo[94805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:24:08 devstack sudo[94805]: pam_unix(sudo:session): session closed for user root Sep 16 20:24:08 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-6a209bcd-8df7-45fb-bfc9-658275806046 tempest-VolumesSnapshotListTestJSON-1719130302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5.cf1f484c-425b-415e-b949-2ef22275ed0a" returned: 0 in 0.408s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:24:08 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-6a209bcd-8df7-45fb-bfc9-658275806046 tempest-VolumesSnapshotListTestJSON-1719130302 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86188) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 20:24:08 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-6a209bcd-8df7-45fb-bfc9-658275806046 tempest-VolumesSnapshotListTestJSON-1719130302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5.cf1f484c-425b-415e-b949-2ef22275ed0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5.87dadc74-178e-4e83-b4b0-4f0e53259cf4 1G {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:24:08 devstack sudo[94813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5.cf1f484c-425b-415e-b949-2ef22275ed0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5.87dadc74-178e-4e83-b4b0-4f0e53259cf4 1G Sep 16 20:24:08 devstack sudo[94813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:24:09 devstack sudo[94813]: pam_unix(sudo:session): session closed for user root Sep 16 20:24:09 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-6a209bcd-8df7-45fb-bfc9-658275806046 tempest-VolumesSnapshotListTestJSON-1719130302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5.cf1f484c-425b-415e-b949-2ef22275ed0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5.87dadc74-178e-4e83-b4b0-4f0e53259cf4 1G" returned: 0 in 0.665s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:24:09 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-6a209bcd-8df7-45fb-bfc9-658275806046 tempest-VolumesSnapshotListTestJSON-1719130302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5.cf1f484c-425b-415e-b949-2ef22275ed0a -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5.87dadc74-178e-4e83-b4b0-4f0e53259cf4 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:24:09 devstack sudo[94820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5.cf1f484c-425b-415e-b949-2ef22275ed0a -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5.87dadc74-178e-4e83-b4b0-4f0e53259cf4 Sep 16 20:24:09 devstack sudo[94820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:24:09 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-439ef6da-3c4c-4d6b-a394-50c190c56bad tempest-VolumesTestJSON-940777586 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:24:09 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-439ef6da-3c4c-4d6b-a394-50c190c56bad tempest-VolumesTestJSON-940777586 None] Flow 'volume_create_manager' (a5c33105-9443-417c-8e6c-1e13e152957c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:24:09 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-439ef6da-3c4c-4d6b-a394-50c190c56bad tempest-VolumesTestJSON-940777586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90fee347-f067-4726-871f-bbb1c5a15871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:24:09 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-439ef6da-3c4c-4d6b-a394-50c190c56bad tempest-VolumesTestJSON-940777586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90fee347-f067-4726-871f-bbb1c5a15871) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:24:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1257854113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42eb3bc4-9440-41d4-a9bc-9e277444cb64,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f375ec77f8be449e8ea79eef3297a2a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:24:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:24:09Z,use_quota=True,user_id='cca2e6de1871433a8dc9afc45cf5d54d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:24:09 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-439ef6da-3c4c-4d6b-a394-50c190c56bad tempest-VolumesTestJSON-940777586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b869909a-ddf2-47cb-a711-ffaed193855f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:24:09 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-439ef6da-3c4c-4d6b-a394-50c190c56bad tempest-VolumesTestJSON-940777586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b869909a-ddf2-47cb-a711-ffaed193855f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:24:09 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-439ef6da-3c4c-4d6b-a394-50c190c56bad tempest-VolumesTestJSON-940777586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a59d147-989f-4392-9f51-cbc3dad0546f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:24:09 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-439ef6da-3c4c-4d6b-a394-50c190c56bad tempest-VolumesTestJSON-940777586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a59d147-989f-4392-9f51-cbc3dad0546f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42eb3bc4-9440-41d4-a9bc-9e277444cb64', 'volume_name': 'volume-42eb3bc4-9440-41d4-a9bc-9e277444cb64', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:24:09 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-439ef6da-3c4c-4d6b-a394-50c190c56bad tempest-VolumesTestJSON-940777586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86a9932b-a3b1-41b9-8926-42d5ea63abbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:24:09 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-439ef6da-3c4c-4d6b-a394-50c190c56bad tempest-VolumesTestJSON-940777586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86a9932b-a3b1-41b9-8926-42d5ea63abbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:24:09 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-439ef6da-3c4c-4d6b-a394-50c190c56bad tempest-VolumesTestJSON-940777586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9014866f-0208-40ff-8992-3734a0b769af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:24:09 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-439ef6da-3c4c-4d6b-a394-50c190c56bad tempest-VolumesTestJSON-940777586 None] Volume 42eb3bc4-9440-41d4-a9bc-9e277444cb64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42eb3bc4-9440-41d4-a9bc-9e277444cb64', 'volume_size': 1} Sep 16 20:24:09 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-439ef6da-3c4c-4d6b-a394-50c190c56bad tempest-VolumesTestJSON-940777586 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:24:09 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-909ca5ad-acea-435c-8885-e3832bef1bf9 tempest-AttachVolumeShelveTestJSON-649703128 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:24:09 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-909ca5ad-acea-435c-8885-e3832bef1bf9 tempest-AttachVolumeShelveTestJSON-649703128 None] Flow 'volume_create_manager' (07fcd30e-731c-48a6-9a30-0233d5e6d229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:24:09 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-909ca5ad-acea-435c-8885-e3832bef1bf9 tempest-AttachVolumeShelveTestJSON-649703128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (603bce76-008e-4c44-ada7-0290eb8cbf78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:24:09 devstack sudo[94820]: pam_unix(sudo:session): session closed for user root Sep 16 20:24:09 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-6a209bcd-8df7-45fb-bfc9-658275806046 tempest-VolumesSnapshotListTestJSON-1719130302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5.cf1f484c-425b-415e-b949-2ef22275ed0a -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5.87dadc74-178e-4e83-b4b0-4f0e53259cf4" returned: 0 in 0.353s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:24:09 devstack cinder-volume[86188]: WARNING cinder.volume.drivers.remotefs [None req-6a209bcd-8df7-45fb-bfc9-658275806046 tempest-VolumesSnapshotListTestJSON-1719130302 None] /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5.87dadc74-178e-4e83-b4b0-4f0e53259cf4 is being set with open permissions: ugo+rw Sep 16 20:24:09 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-6a209bcd-8df7-45fb-bfc9-658275806046 tempest-VolumesSnapshotListTestJSON-1719130302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5.87dadc74-178e-4e83-b4b0-4f0e53259cf4 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:24:09 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-909ca5ad-acea-435c-8885-e3832bef1bf9 tempest-AttachVolumeShelveTestJSON-649703128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (603bce76-008e-4c44-ada7-0290eb8cbf78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:24:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-804239917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02ec95b7-2155-4b2a-8392-ce83dd4b78d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca9d95f3cdf14b8e89d683d66475c216',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:24:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:24:09Z,use_quota=True,user_id='892e02ea2df04335b11a2e9f280013f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:24:09 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-909ca5ad-acea-435c-8885-e3832bef1bf9 tempest-AttachVolumeShelveTestJSON-649703128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c427d8a0-a928-4e0b-a685-34a5cddbf4b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:24:09 devstack sudo[94825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5.87dadc74-178e-4e83-b4b0-4f0e53259cf4 Sep 16 20:24:09 devstack sudo[94825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:24:09 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-909ca5ad-acea-435c-8885-e3832bef1bf9 tempest-AttachVolumeShelveTestJSON-649703128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c427d8a0-a928-4e0b-a685-34a5cddbf4b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:24:09 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-909ca5ad-acea-435c-8885-e3832bef1bf9 tempest-AttachVolumeShelveTestJSON-649703128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3023ff0-7562-481c-a4b8-cc2a511b2d4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:24:09 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-909ca5ad-acea-435c-8885-e3832bef1bf9 tempest-AttachVolumeShelveTestJSON-649703128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3023ff0-7562-481c-a4b8-cc2a511b2d4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02ec95b7-2155-4b2a-8392-ce83dd4b78d7', 'volume_name': 'volume-02ec95b7-2155-4b2a-8392-ce83dd4b78d7', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:24:09 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-909ca5ad-acea-435c-8885-e3832bef1bf9 tempest-AttachVolumeShelveTestJSON-649703128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e2eb924-b47f-4451-ad76-8b9ff3055bc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:24:09 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-909ca5ad-acea-435c-8885-e3832bef1bf9 tempest-AttachVolumeShelveTestJSON-649703128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e2eb924-b47f-4451-ad76-8b9ff3055bc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:24:09 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-909ca5ad-acea-435c-8885-e3832bef1bf9 tempest-AttachVolumeShelveTestJSON-649703128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc1d2dce-421b-48c0-a8f1-561591085620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:24:09 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-909ca5ad-acea-435c-8885-e3832bef1bf9 tempest-AttachVolumeShelveTestJSON-649703128 None] Volume 02ec95b7-2155-4b2a-8392-ce83dd4b78d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02ec95b7-2155-4b2a-8392-ce83dd4b78d7', 'volume_size': 1} Sep 16 20:24:09 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-909ca5ad-acea-435c-8885-e3832bef1bf9 tempest-AttachVolumeShelveTestJSON-649703128 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:24:09 devstack sudo[94825]: pam_unix(sudo:session): session closed for user root Sep 16 20:24:09 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-6a209bcd-8df7-45fb-bfc9-658275806046 tempest-VolumesSnapshotListTestJSON-1719130302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5.87dadc74-178e-4e83-b4b0-4f0e53259cf4" returned: 0 in 0.250s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:24:09 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-6a209bcd-8df7-45fb-bfc9-658275806046 tempest-VolumesSnapshotListTestJSON-1719130302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.786s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:24:09 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-439ef6da-3c4c-4d6b-a394-50c190c56bad tempest-VolumesTestJSON-940777586 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.338s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:24:09 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-439ef6da-3c4c-4d6b-a394-50c190c56bad tempest-VolumesTestJSON-940777586 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:24:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1257854113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42eb3bc4-9440-41d4-a9bc-9e277444cb64,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f375ec77f8be449e8ea79eef3297a2a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:24:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:24:09Z,use_quota=True,user_id='cca2e6de1871433a8dc9afc45cf5d54d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:24:09 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-439ef6da-3c4c-4d6b-a394-50c190c56bad tempest-VolumesTestJSON-940777586 None] Creating volume 42eb3bc4-9440-41d4-a9bc-9e277444cb64 {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:24:09 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-439ef6da-3c4c-4d6b-a394-50c190c56bad tempest-VolumesTestJSON-940777586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:24:09 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-439ef6da-3c4c-4d6b-a394-50c190c56bad tempest-VolumesTestJSON-940777586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:24:09 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-439ef6da-3c4c-4d6b-a394-50c190c56bad tempest-VolumesTestJSON-940777586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:24:09 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-439ef6da-3c4c-4d6b-a394-50c190c56bad tempest-VolumesTestJSON-940777586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:24:09 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-439ef6da-3c4c-4d6b-a394-50c190c56bad tempest-VolumesTestJSON-940777586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:24:09 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-439ef6da-3c4c-4d6b-a394-50c190c56bad tempest-VolumesTestJSON-940777586 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:24:09 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-439ef6da-3c4c-4d6b-a394-50c190c56bad tempest-VolumesTestJSON-940777586 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:24:09 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-439ef6da-3c4c-4d6b-a394-50c190c56bad tempest-VolumesTestJSON-940777586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-42eb3bc4-9440-41d4-a9bc-9e277444cb64 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:24:09 devstack sudo[94828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-42eb3bc4-9440-41d4-a9bc-9e277444cb64 1073741824 Sep 16 20:24:09 devstack sudo[94828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:24:09 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-6a209bcd-8df7-45fb-bfc9-658275806046 tempest-VolumesSnapshotListTestJSON-1719130302 None] Create snapshot completed successfully Sep 16 20:24:10 devstack sudo[94828]: pam_unix(sudo:session): session closed for user root Sep 16 20:24:10 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-439ef6da-3c4c-4d6b-a394-50c190c56bad tempest-VolumesTestJSON-940777586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-42eb3bc4-9440-41d4-a9bc-9e277444cb64 1073741824" returned: 0 in 0.482s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:24:10 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-439ef6da-3c4c-4d6b-a394-50c190c56bad tempest-VolumesTestJSON-940777586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-42eb3bc4-9440-41d4-a9bc-9e277444cb64 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:24:10 devstack sudo[94834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-42eb3bc4-9440-41d4-a9bc-9e277444cb64 Sep 16 20:24:10 devstack sudo[94834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:24:10 devstack sudo[94834]: pam_unix(sudo:session): session closed for user root Sep 16 20:24:10 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-439ef6da-3c4c-4d6b-a394-50c190c56bad tempest-VolumesTestJSON-940777586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-42eb3bc4-9440-41d4-a9bc-9e277444cb64" returned: 0 in 0.292s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:24:10 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-439ef6da-3c4c-4d6b-a394-50c190c56bad tempest-VolumesTestJSON-940777586 None] <== create_volume: return (820ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:24:10 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-439ef6da-3c4c-4d6b-a394-50c190c56bad tempest-VolumesTestJSON-940777586 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.823s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:24:10 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-909ca5ad-acea-435c-8885-e3832bef1bf9 tempest-AttachVolumeShelveTestJSON-649703128 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.052s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:24:10 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-909ca5ad-acea-435c-8885-e3832bef1bf9 tempest-AttachVolumeShelveTestJSON-649703128 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:24:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-804239917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02ec95b7-2155-4b2a-8392-ce83dd4b78d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca9d95f3cdf14b8e89d683d66475c216',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:24:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:24:09Z,use_quota=True,user_id='892e02ea2df04335b11a2e9f280013f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:24:10 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-909ca5ad-acea-435c-8885-e3832bef1bf9 tempest-AttachVolumeShelveTestJSON-649703128 None] Creating volume 02ec95b7-2155-4b2a-8392-ce83dd4b78d7 {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:24:10 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-909ca5ad-acea-435c-8885-e3832bef1bf9 tempest-AttachVolumeShelveTestJSON-649703128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:24:10 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-909ca5ad-acea-435c-8885-e3832bef1bf9 tempest-AttachVolumeShelveTestJSON-649703128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:24:10 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-909ca5ad-acea-435c-8885-e3832bef1bf9 tempest-AttachVolumeShelveTestJSON-649703128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:24:10 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-909ca5ad-acea-435c-8885-e3832bef1bf9 tempest-AttachVolumeShelveTestJSON-649703128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:24:10 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-909ca5ad-acea-435c-8885-e3832bef1bf9 tempest-AttachVolumeShelveTestJSON-649703128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:24:10 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-909ca5ad-acea-435c-8885-e3832bef1bf9 tempest-AttachVolumeShelveTestJSON-649703128 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:24:10 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-909ca5ad-acea-435c-8885-e3832bef1bf9 tempest-AttachVolumeShelveTestJSON-649703128 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:24:10 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-909ca5ad-acea-435c-8885-e3832bef1bf9 tempest-AttachVolumeShelveTestJSON-649703128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-02ec95b7-2155-4b2a-8392-ce83dd4b78d7 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:24:10 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-439ef6da-3c4c-4d6b-a394-50c190c56bad tempest-VolumesTestJSON-940777586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9014866f-0208-40ff-8992-3734a0b769af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42eb3bc4-9440-41d4-a9bc-9e277444cb64', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:24:10 devstack sudo[94837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-02ec95b7-2155-4b2a-8392-ce83dd4b78d7 1073741824 Sep 16 20:24:10 devstack sudo[94837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:24:10 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-439ef6da-3c4c-4d6b-a394-50c190c56bad tempest-VolumesTestJSON-940777586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10d3055f-5bad-4f09-b912-4bc3e163f82c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:24:10 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-439ef6da-3c4c-4d6b-a394-50c190c56bad tempest-VolumesTestJSON-940777586 None] Volume volume-42eb3bc4-9440-41d4-a9bc-9e277444cb64 (42eb3bc4-9440-41d4-a9bc-9e277444cb64): created successfully Sep 16 20:24:10 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-439ef6da-3c4c-4d6b-a394-50c190c56bad tempest-VolumesTestJSON-940777586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10d3055f-5bad-4f09-b912-4bc3e163f82c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:24:10 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-439ef6da-3c4c-4d6b-a394-50c190c56bad tempest-VolumesTestJSON-940777586 None] Flow 'volume_create_manager' (a5c33105-9443-417c-8e6c-1e13e152957c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:24:10 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-439ef6da-3c4c-4d6b-a394-50c190c56bad tempest-VolumesTestJSON-940777586 None] Created volume successfully. Sep 16 20:24:11 devstack sudo[94837]: pam_unix(sudo:session): session closed for user root Sep 16 20:24:11 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-909ca5ad-acea-435c-8885-e3832bef1bf9 tempest-AttachVolumeShelveTestJSON-649703128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-02ec95b7-2155-4b2a-8392-ce83dd4b78d7 1073741824" returned: 0 in 0.537s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:24:11 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-909ca5ad-acea-435c-8885-e3832bef1bf9 tempest-AttachVolumeShelveTestJSON-649703128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-02ec95b7-2155-4b2a-8392-ce83dd4b78d7 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:24:11 devstack sudo[94843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-02ec95b7-2155-4b2a-8392-ce83dd4b78d7 Sep 16 20:24:11 devstack sudo[94843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:24:11 devstack sudo[94843]: pam_unix(sudo:session): session closed for user root Sep 16 20:24:11 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-909ca5ad-acea-435c-8885-e3832bef1bf9 tempest-AttachVolumeShelveTestJSON-649703128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-02ec95b7-2155-4b2a-8392-ce83dd4b78d7" returned: 0 in 0.371s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:24:11 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-909ca5ad-acea-435c-8885-e3832bef1bf9 tempest-AttachVolumeShelveTestJSON-649703128 None] <== create_volume: return (983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:24:11 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-909ca5ad-acea-435c-8885-e3832bef1bf9 tempest-AttachVolumeShelveTestJSON-649703128 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.987s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:24:11 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-909ca5ad-acea-435c-8885-e3832bef1bf9 tempest-AttachVolumeShelveTestJSON-649703128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc1d2dce-421b-48c0-a8f1-561591085620) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02ec95b7-2155-4b2a-8392-ce83dd4b78d7', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:24:11 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-909ca5ad-acea-435c-8885-e3832bef1bf9 tempest-AttachVolumeShelveTestJSON-649703128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a7add6c-0e42-434e-82f0-36166ba5062f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:24:11 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-909ca5ad-acea-435c-8885-e3832bef1bf9 tempest-AttachVolumeShelveTestJSON-649703128 None] Volume volume-02ec95b7-2155-4b2a-8392-ce83dd4b78d7 (02ec95b7-2155-4b2a-8392-ce83dd4b78d7): created successfully Sep 16 20:24:11 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-909ca5ad-acea-435c-8885-e3832bef1bf9 tempest-AttachVolumeShelveTestJSON-649703128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a7add6c-0e42-434e-82f0-36166ba5062f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:24:11 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-909ca5ad-acea-435c-8885-e3832bef1bf9 tempest-AttachVolumeShelveTestJSON-649703128 None] Flow 'volume_create_manager' (07fcd30e-731c-48a6-9a30-0233d5e6d229) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:24:11 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-909ca5ad-acea-435c-8885-e3832bef1bf9 tempest-AttachVolumeShelveTestJSON-649703128 None] Created volume successfully. Sep 16 20:24:11 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-e46090a3-73ae-4ccd-814c-8d1a1a679d1c tempest-VolumesTestJSON-940777586 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:24:11 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e46090a3-73ae-4ccd-814c-8d1a1a679d1c tempest-VolumesTestJSON-940777586 None] Flow 'volume_create_manager' (7be77986-fb91-42df-aead-222360bfd75a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:24:11 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e46090a3-73ae-4ccd-814c-8d1a1a679d1c tempest-VolumesTestJSON-940777586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcb01c00-76b9-4180-9fc1-cad2a5aae7fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:24:11 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e46090a3-73ae-4ccd-814c-8d1a1a679d1c tempest-VolumesTestJSON-940777586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcb01c00-76b9-4180-9fc1-cad2a5aae7fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:24:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1015876277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa94d3cc-0ac9-40d6-9354-9981fda24d34,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f375ec77f8be449e8ea79eef3297a2a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:24:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:24:12Z,use_quota=True,user_id='cca2e6de1871433a8dc9afc45cf5d54d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:24:11 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e46090a3-73ae-4ccd-814c-8d1a1a679d1c tempest-VolumesTestJSON-940777586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8c6767b-085d-46bd-b234-73dfec4c4822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:24:11 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e46090a3-73ae-4ccd-814c-8d1a1a679d1c tempest-VolumesTestJSON-940777586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8c6767b-085d-46bd-b234-73dfec4c4822) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:24:11 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e46090a3-73ae-4ccd-814c-8d1a1a679d1c tempest-VolumesTestJSON-940777586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3ff771e-dfd8-4919-b325-4d0f09186472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:24:11 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e46090a3-73ae-4ccd-814c-8d1a1a679d1c tempest-VolumesTestJSON-940777586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3ff771e-dfd8-4919-b325-4d0f09186472) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa94d3cc-0ac9-40d6-9354-9981fda24d34', 'volume_name': 'volume-aa94d3cc-0ac9-40d6-9354-9981fda24d34', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:24:11 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e46090a3-73ae-4ccd-814c-8d1a1a679d1c tempest-VolumesTestJSON-940777586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48a67b77-c0f8-41bc-9100-458084952e05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:24:11 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e46090a3-73ae-4ccd-814c-8d1a1a679d1c tempest-VolumesTestJSON-940777586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48a67b77-c0f8-41bc-9100-458084952e05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:24:11 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e46090a3-73ae-4ccd-814c-8d1a1a679d1c tempest-VolumesTestJSON-940777586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (379c6e05-d9f8-41bd-8162-d1fa29691a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:24:11 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-e46090a3-73ae-4ccd-814c-8d1a1a679d1c tempest-VolumesTestJSON-940777586 None] Volume aa94d3cc-0ac9-40d6-9354-9981fda24d34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa94d3cc-0ac9-40d6-9354-9981fda24d34', 'volume_size': 1} Sep 16 20:24:11 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-e46090a3-73ae-4ccd-814c-8d1a1a679d1c tempest-VolumesTestJSON-940777586 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:24:11 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-e46090a3-73ae-4ccd-814c-8d1a1a679d1c tempest-VolumesTestJSON-940777586 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:24:11 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-e46090a3-73ae-4ccd-814c-8d1a1a679d1c tempest-VolumesTestJSON-940777586 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:24:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1015876277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa94d3cc-0ac9-40d6-9354-9981fda24d34,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f375ec77f8be449e8ea79eef3297a2a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:24:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:24:12Z,use_quota=True,user_id='cca2e6de1871433a8dc9afc45cf5d54d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:24:11 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-e46090a3-73ae-4ccd-814c-8d1a1a679d1c tempest-VolumesTestJSON-940777586 None] Creating volume aa94d3cc-0ac9-40d6-9354-9981fda24d34 {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:24:11 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-e46090a3-73ae-4ccd-814c-8d1a1a679d1c tempest-VolumesTestJSON-940777586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:24:11 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-e46090a3-73ae-4ccd-814c-8d1a1a679d1c tempest-VolumesTestJSON-940777586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:24:11 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-e46090a3-73ae-4ccd-814c-8d1a1a679d1c tempest-VolumesTestJSON-940777586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:24:11 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-e46090a3-73ae-4ccd-814c-8d1a1a679d1c tempest-VolumesTestJSON-940777586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:24:11 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-e46090a3-73ae-4ccd-814c-8d1a1a679d1c tempest-VolumesTestJSON-940777586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:24:11 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-e46090a3-73ae-4ccd-814c-8d1a1a679d1c tempest-VolumesTestJSON-940777586 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:24:11 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-e46090a3-73ae-4ccd-814c-8d1a1a679d1c tempest-VolumesTestJSON-940777586 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:24:11 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e46090a3-73ae-4ccd-814c-8d1a1a679d1c tempest-VolumesTestJSON-940777586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-aa94d3cc-0ac9-40d6-9354-9981fda24d34 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:24:11 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-4603b728-9f30-47af-8ea3-aa1775c8999d tempest-VolumesSnapshotListTestJSON-1719130302 None] Acquiring lock "cinder-87dadc74-178e-4e83-b4b0-4f0e53259cf4-delete_snapshot" by "delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:24:12 devstack sudo[94846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-aa94d3cc-0ac9-40d6-9354-9981fda24d34 1073741824 Sep 16 20:24:12 devstack sudo[94846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:24:12 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-4603b728-9f30-47af-8ea3-aa1775c8999d tempest-VolumesSnapshotListTestJSON-1719130302 None] Lock "cinder-87dadc74-178e-4e83-b4b0-4f0e53259cf4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:24:12 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-4603b728-9f30-47af-8ea3-aa1775c8999d tempest-VolumesSnapshotListTestJSON-1719130302 None] Acquiring lock "cinder-quobyte-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5" by "delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:24:12 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-4603b728-9f30-47af-8ea3-aa1775c8999d tempest-VolumesSnapshotListTestJSON-1719130302 None] Lock "cinder-quobyte-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:24:12 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-4603b728-9f30-47af-8ea3-aa1775c8999d tempest-VolumesSnapshotListTestJSON-1719130302 None] Acquiring lock "cinder-quobyte-87dadc74-178e-4e83-b4b0-4f0e53259cf4" by "_delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:24:12 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-4603b728-9f30-47af-8ea3-aa1775c8999d tempest-VolumesSnapshotListTestJSON-1719130302 None] Lock "cinder-quobyte-87dadc74-178e-4e83-b4b0-4f0e53259cf4" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:24:12 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-4603b728-9f30-47af-8ea3-aa1775c8999d tempest-VolumesSnapshotListTestJSON-1719130302 None] Deleting offline snapshot 87dadc74-178e-4e83-b4b0-4f0e53259cf4 of volume d74a6d2e-290f-4f82-b93b-0e0737e5d2e5 {{(pid=86188) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 20:24:12 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-4603b728-9f30-47af-8ea3-aa1775c8999d tempest-VolumesSnapshotListTestJSON-1719130302 None] snapshot_file for this snap is: volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5.87dadc74-178e-4e83-b4b0-4f0e53259cf4 {{(pid=86188) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 20:24:12 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[b112f40b-149c-4af2-a631-5cc0eeb25fac]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:24:12 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-4603b728-9f30-47af-8ea3-aa1775c8999d tempest-VolumesSnapshotListTestJSON-1719130302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5.87dadc74-178e-4e83-b4b0-4f0e53259cf4 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:24:12 devstack sudo[94848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5.87dadc74-178e-4e83-b4b0-4f0e53259cf4 Sep 16 20:24:12 devstack sudo[94848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:24:12 devstack sudo[94846]: pam_unix(sudo:session): session closed for user root Sep 16 20:24:12 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e46090a3-73ae-4ccd-814c-8d1a1a679d1c tempest-VolumesTestJSON-940777586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-aa94d3cc-0ac9-40d6-9354-9981fda24d34 1073741824" returned: 0 in 0.475s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:24:12 devstack sudo[94848]: pam_unix(sudo:session): session closed for user root Sep 16 20:24:12 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-4603b728-9f30-47af-8ea3-aa1775c8999d tempest-VolumesSnapshotListTestJSON-1719130302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5.87dadc74-178e-4e83-b4b0-4f0e53259cf4" returned: 0 in 0.414s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:24:12 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-4603b728-9f30-47af-8ea3-aa1775c8999d tempest-VolumesSnapshotListTestJSON-1719130302 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86188) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 20:24:12 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c828fdf-f0ae-4ba8-96ed-542a26707bac]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:24:12 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-4603b728-9f30-47af-8ea3-aa1775c8999d tempest-VolumesSnapshotListTestJSON-1719130302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5.cf1f484c-425b-415e-b949-2ef22275ed0a {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:24:12 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e46090a3-73ae-4ccd-814c-8d1a1a679d1c tempest-VolumesTestJSON-940777586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-aa94d3cc-0ac9-40d6-9354-9981fda24d34 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:24:12 devstack sudo[94862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-aa94d3cc-0ac9-40d6-9354-9981fda24d34 Sep 16 20:24:12 devstack sudo[94862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:24:12 devstack sudo[94861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5.cf1f484c-425b-415e-b949-2ef22275ed0a Sep 16 20:24:12 devstack sudo[94861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:24:12 devstack sudo[94862]: pam_unix(sudo:session): session closed for user root Sep 16 20:24:12 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e46090a3-73ae-4ccd-814c-8d1a1a679d1c tempest-VolumesTestJSON-940777586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-aa94d3cc-0ac9-40d6-9354-9981fda24d34" returned: 0 in 0.359s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:24:12 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-e46090a3-73ae-4ccd-814c-8d1a1a679d1c tempest-VolumesTestJSON-940777586 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:24:12 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-e46090a3-73ae-4ccd-814c-8d1a1a679d1c tempest-VolumesTestJSON-940777586 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:24:12 devstack sudo[94861]: pam_unix(sudo:session): session closed for user root Sep 16 20:24:12 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e46090a3-73ae-4ccd-814c-8d1a1a679d1c tempest-VolumesTestJSON-940777586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (379c6e05-d9f8-41bd-8162-d1fa29691a99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa94d3cc-0ac9-40d6-9354-9981fda24d34', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:24:12 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e46090a3-73ae-4ccd-814c-8d1a1a679d1c tempest-VolumesTestJSON-940777586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d70c4ec-6e15-4ef0-81e9-b923cfa28fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:24:12 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-4603b728-9f30-47af-8ea3-aa1775c8999d tempest-VolumesSnapshotListTestJSON-1719130302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5.cf1f484c-425b-415e-b949-2ef22275ed0a" returned: 0 in 0.438s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:24:12 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-4603b728-9f30-47af-8ea3-aa1775c8999d tempest-VolumesSnapshotListTestJSON-1719130302 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86188) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 20:24:12 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-4603b728-9f30-47af-8ea3-aa1775c8999d tempest-VolumesSnapshotListTestJSON-1719130302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5.87dadc74-178e-4e83-b4b0-4f0e53259cf4 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:24:12 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-e46090a3-73ae-4ccd-814c-8d1a1a679d1c tempest-VolumesTestJSON-940777586 None] Volume volume-aa94d3cc-0ac9-40d6-9354-9981fda24d34 (aa94d3cc-0ac9-40d6-9354-9981fda24d34): created successfully Sep 16 20:24:13 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e46090a3-73ae-4ccd-814c-8d1a1a679d1c tempest-VolumesTestJSON-940777586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d70c4ec-6e15-4ef0-81e9-b923cfa28fe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:24:13 devstack sudo[94869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5.87dadc74-178e-4e83-b4b0-4f0e53259cf4 Sep 16 20:24:13 devstack sudo[94869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:24:13 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e46090a3-73ae-4ccd-814c-8d1a1a679d1c tempest-VolumesTestJSON-940777586 None] Flow 'volume_create_manager' (7be77986-fb91-42df-aead-222360bfd75a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:24:13 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-e46090a3-73ae-4ccd-814c-8d1a1a679d1c tempest-VolumesTestJSON-940777586 None] Created volume successfully. Sep 16 20:24:13 devstack sudo[94869]: pam_unix(sudo:session): session closed for user root Sep 16 20:24:13 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-4603b728-9f30-47af-8ea3-aa1775c8999d tempest-VolumesSnapshotListTestJSON-1719130302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5.87dadc74-178e-4e83-b4b0-4f0e53259cf4" returned: 0 in 0.474s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:24:13 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-4603b728-9f30-47af-8ea3-aa1775c8999d tempest-VolumesSnapshotListTestJSON-1719130302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5.87dadc74-178e-4e83-b4b0-4f0e53259cf4 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:24:13 devstack sudo[94875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5.87dadc74-178e-4e83-b4b0-4f0e53259cf4 Sep 16 20:24:13 devstack sudo[94875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:24:13 devstack sudo[94875]: pam_unix(sudo:session): session closed for user root Sep 16 20:24:13 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-4603b728-9f30-47af-8ea3-aa1775c8999d tempest-VolumesSnapshotListTestJSON-1719130302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5.87dadc74-178e-4e83-b4b0-4f0e53259cf4" returned: 0 in 0.253s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:24:13 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-4603b728-9f30-47af-8ea3-aa1775c8999d tempest-VolumesSnapshotListTestJSON-1719130302 None] Lock "cinder-quobyte-87dadc74-178e-4e83-b4b0-4f0e53259cf4" released by "_delete_snapshot" :: held 1.681s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:24:13 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-4603b728-9f30-47af-8ea3-aa1775c8999d tempest-VolumesSnapshotListTestJSON-1719130302 None] Lock "cinder-quobyte-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5" released by "delete_snapshot" :: held 1.704s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:24:13 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-4603b728-9f30-47af-8ea3-aa1775c8999d tempest-VolumesSnapshotListTestJSON-1719130302 None] Created reservations ['894cd084-4f62-4ea6-8474-f47bde5fb835', '9dd5eeba-50a5-496b-8d2e-42d5082b1016', 'ca9a8644-cabd-4f28-bd70-fefcb4b55354', 'b7b895f5-be2a-4c6d-815a-3360686fe834'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:24:13 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-4603b728-9f30-47af-8ea3-aa1775c8999d tempest-VolumesSnapshotListTestJSON-1719130302 None] Delete snapshot completed successfully. Sep 16 20:24:13 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-4603b728-9f30-47af-8ea3-aa1775c8999d tempest-VolumesSnapshotListTestJSON-1719130302 None] Lock "cinder-87dadc74-178e-4e83-b4b0-4f0e53259cf4-delete_snapshot" released by "delete_snapshot" :: held 1.935s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:24:14 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-9c1c1fa4-fb21-4b14-8edf-4fe5b9a76df7 tempest-VolumesSnapshotListTestJSON-1719130302 None] Acquiring lock "cinder-cf1f484c-425b-415e-b949-2ef22275ed0a-delete_snapshot" by "delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:24:14 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-9c1c1fa4-fb21-4b14-8edf-4fe5b9a76df7 tempest-VolumesSnapshotListTestJSON-1719130302 None] Lock "cinder-cf1f484c-425b-415e-b949-2ef22275ed0a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.061s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:24:14 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-9c1c1fa4-fb21-4b14-8edf-4fe5b9a76df7 tempest-VolumesSnapshotListTestJSON-1719130302 None] Acquiring lock "cinder-quobyte-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5" by "delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:24:14 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-9c1c1fa4-fb21-4b14-8edf-4fe5b9a76df7 tempest-VolumesSnapshotListTestJSON-1719130302 None] Lock "cinder-quobyte-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5" acquired by "delete_snapshot" :: waited 0.043s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:24:14 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-9c1c1fa4-fb21-4b14-8edf-4fe5b9a76df7 tempest-VolumesSnapshotListTestJSON-1719130302 None] Acquiring lock "cinder-quobyte-cf1f484c-425b-415e-b949-2ef22275ed0a" by "_delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:24:14 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-9c1c1fa4-fb21-4b14-8edf-4fe5b9a76df7 tempest-VolumesSnapshotListTestJSON-1719130302 None] Lock "cinder-quobyte-cf1f484c-425b-415e-b949-2ef22275ed0a" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:24:14 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-9c1c1fa4-fb21-4b14-8edf-4fe5b9a76df7 tempest-VolumesSnapshotListTestJSON-1719130302 None] Deleting offline snapshot cf1f484c-425b-415e-b949-2ef22275ed0a of volume d74a6d2e-290f-4f82-b93b-0e0737e5d2e5 {{(pid=86188) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 20:24:14 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-9c1c1fa4-fb21-4b14-8edf-4fe5b9a76df7 tempest-VolumesSnapshotListTestJSON-1719130302 None] snapshot_file for this snap is: volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5.cf1f484c-425b-415e-b949-2ef22275ed0a {{(pid=86188) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 20:24:14 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0db2ac7-792d-42ef-b191-0e29ec4b504a]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:24:14 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-9c1c1fa4-fb21-4b14-8edf-4fe5b9a76df7 tempest-VolumesSnapshotListTestJSON-1719130302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5.cf1f484c-425b-415e-b949-2ef22275ed0a {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:24:14 devstack sudo[94883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5.cf1f484c-425b-415e-b949-2ef22275ed0a Sep 16 20:24:14 devstack sudo[94883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:24:14 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-937525fc-921d-4abc-af7c-a739c228e449 tempest-VolumesTestJSON-940777586 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:24:14 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-937525fc-921d-4abc-af7c-a739c228e449 tempest-VolumesTestJSON-940777586 None] Flow 'volume_create_manager' (70dcc70e-1b95-47d3-8ed9-c642bee1c9c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:24:14 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-937525fc-921d-4abc-af7c-a739c228e449 tempest-VolumesTestJSON-940777586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e31eaf67-13d2-4e30-ab23-50c14448e1e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:24:14 devstack sudo[94883]: pam_unix(sudo:session): session closed for user root Sep 16 20:24:14 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-9c1c1fa4-fb21-4b14-8edf-4fe5b9a76df7 tempest-VolumesSnapshotListTestJSON-1719130302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5.cf1f484c-425b-415e-b949-2ef22275ed0a" returned: 0 in 0.509s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:24:14 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-9c1c1fa4-fb21-4b14-8edf-4fe5b9a76df7 tempest-VolumesSnapshotListTestJSON-1719130302 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86188) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 20:24:14 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-937525fc-921d-4abc-af7c-a739c228e449 tempest-VolumesTestJSON-940777586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e31eaf67-13d2-4e30-ab23-50c14448e1e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:24:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-719162695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1818da4-0faf-446e-b097-0e581d2b0d99,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f375ec77f8be449e8ea79eef3297a2a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:24:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:24:15Z,use_quota=True,user_id='cca2e6de1871433a8dc9afc45cf5d54d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:24:14 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-937525fc-921d-4abc-af7c-a739c228e449 tempest-VolumesTestJSON-940777586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c49746b2-b6cf-4e33-915b-2d757301106b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:24:14 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-937525fc-921d-4abc-af7c-a739c228e449 tempest-VolumesTestJSON-940777586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c49746b2-b6cf-4e33-915b-2d757301106b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:24:14 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-937525fc-921d-4abc-af7c-a739c228e449 tempest-VolumesTestJSON-940777586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94da40ff-97e5-42ad-baec-0dce540f11d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:24:14 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-937525fc-921d-4abc-af7c-a739c228e449 tempest-VolumesTestJSON-940777586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94da40ff-97e5-42ad-baec-0dce540f11d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1818da4-0faf-446e-b097-0e581d2b0d99', 'volume_name': 'volume-e1818da4-0faf-446e-b097-0e581d2b0d99', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:24:14 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-937525fc-921d-4abc-af7c-a739c228e449 tempest-VolumesTestJSON-940777586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa4ad6ea-cfaa-4e96-83f0-4f5c04ed7e9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:24:14 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-937525fc-921d-4abc-af7c-a739c228e449 tempest-VolumesTestJSON-940777586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa4ad6ea-cfaa-4e96-83f0-4f5c04ed7e9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:24:14 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-937525fc-921d-4abc-af7c-a739c228e449 tempest-VolumesTestJSON-940777586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb9ab668-0a50-4caf-b3eb-9fe739999ef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:24:14 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-937525fc-921d-4abc-af7c-a739c228e449 tempest-VolumesTestJSON-940777586 None] Volume e1818da4-0faf-446e-b097-0e581d2b0d99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1818da4-0faf-446e-b097-0e581d2b0d99', 'volume_size': 1} Sep 16 20:24:14 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-937525fc-921d-4abc-af7c-a739c228e449 tempest-VolumesTestJSON-940777586 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:24:14 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-937525fc-921d-4abc-af7c-a739c228e449 tempest-VolumesTestJSON-940777586 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:24:14 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-937525fc-921d-4abc-af7c-a739c228e449 tempest-VolumesTestJSON-940777586 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:24:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-719162695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1818da4-0faf-446e-b097-0e581d2b0d99,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f375ec77f8be449e8ea79eef3297a2a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:24:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:24:15Z,use_quota=True,user_id='cca2e6de1871433a8dc9afc45cf5d54d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:24:14 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-937525fc-921d-4abc-af7c-a739c228e449 tempest-VolumesTestJSON-940777586 None] Creating volume e1818da4-0faf-446e-b097-0e581d2b0d99 {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:24:14 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-937525fc-921d-4abc-af7c-a739c228e449 tempest-VolumesTestJSON-940777586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:24:14 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-937525fc-921d-4abc-af7c-a739c228e449 tempest-VolumesTestJSON-940777586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:24:14 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-937525fc-921d-4abc-af7c-a739c228e449 tempest-VolumesTestJSON-940777586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:24:14 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-937525fc-921d-4abc-af7c-a739c228e449 tempest-VolumesTestJSON-940777586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:24:14 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-937525fc-921d-4abc-af7c-a739c228e449 tempest-VolumesTestJSON-940777586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:24:14 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-937525fc-921d-4abc-af7c-a739c228e449 tempest-VolumesTestJSON-940777586 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:24:14 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-937525fc-921d-4abc-af7c-a739c228e449 tempest-VolumesTestJSON-940777586 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:24:14 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-937525fc-921d-4abc-af7c-a739c228e449 tempest-VolumesTestJSON-940777586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e1818da4-0faf-446e-b097-0e581d2b0d99 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:24:14 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[d60d7be0-a473-42a6-b026-e279be16206e]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:24:14 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-9c1c1fa4-fb21-4b14-8edf-4fe5b9a76df7 tempest-VolumesSnapshotListTestJSON-1719130302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5.7224d463-ab9e-4459-b8a6-4e0c64b571f4 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:24:15 devstack sudo[94907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e1818da4-0faf-446e-b097-0e581d2b0d99 1073741824 Sep 16 20:24:15 devstack sudo[94907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:24:15 devstack sudo[94908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5.7224d463-ab9e-4459-b8a6-4e0c64b571f4 Sep 16 20:24:15 devstack sudo[94908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:24:15 devstack sudo[94908]: pam_unix(sudo:session): session closed for user root Sep 16 20:24:15 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-9c1c1fa4-fb21-4b14-8edf-4fe5b9a76df7 tempest-VolumesSnapshotListTestJSON-1719130302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5.7224d463-ab9e-4459-b8a6-4e0c64b571f4" returned: 0 in 0.439s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:24:15 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-9c1c1fa4-fb21-4b14-8edf-4fe5b9a76df7 tempest-VolumesSnapshotListTestJSON-1719130302 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86188) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 20:24:15 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-9c1c1fa4-fb21-4b14-8edf-4fe5b9a76df7 tempest-VolumesSnapshotListTestJSON-1719130302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5.cf1f484c-425b-415e-b949-2ef22275ed0a {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:24:15 devstack sudo[94918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5.cf1f484c-425b-415e-b949-2ef22275ed0a Sep 16 20:24:15 devstack sudo[94918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:24:15 devstack sudo[94907]: pam_unix(sudo:session): session closed for user root Sep 16 20:24:15 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-937525fc-921d-4abc-af7c-a739c228e449 tempest-VolumesTestJSON-940777586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e1818da4-0faf-446e-b097-0e581d2b0d99 1073741824" returned: 0 in 0.575s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:24:15 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-937525fc-921d-4abc-af7c-a739c228e449 tempest-VolumesTestJSON-940777586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e1818da4-0faf-446e-b097-0e581d2b0d99 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:24:15 devstack sudo[94920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e1818da4-0faf-446e-b097-0e581d2b0d99 Sep 16 20:24:15 devstack sudo[94920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:24:15 devstack sudo[94918]: pam_unix(sudo:session): session closed for user root Sep 16 20:24:15 devstack sudo[94920]: pam_unix(sudo:session): session closed for user root Sep 16 20:24:15 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-9c1c1fa4-fb21-4b14-8edf-4fe5b9a76df7 tempest-VolumesSnapshotListTestJSON-1719130302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5.cf1f484c-425b-415e-b949-2ef22275ed0a" returned: 0 in 0.481s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:24:15 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-9c1c1fa4-fb21-4b14-8edf-4fe5b9a76df7 tempest-VolumesSnapshotListTestJSON-1719130302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5.cf1f484c-425b-415e-b949-2ef22275ed0a {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:24:15 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-937525fc-921d-4abc-af7c-a739c228e449 tempest-VolumesTestJSON-940777586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e1818da4-0faf-446e-b097-0e581d2b0d99" returned: 0 in 0.334s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:24:15 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-937525fc-921d-4abc-af7c-a739c228e449 tempest-VolumesTestJSON-940777586 None] <== create_volume: return (966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:24:15 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-937525fc-921d-4abc-af7c-a739c228e449 tempest-VolumesTestJSON-940777586 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:24:15 devstack sudo[94927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5.cf1f484c-425b-415e-b949-2ef22275ed0a Sep 16 20:24:15 devstack sudo[94927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:24:15 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-937525fc-921d-4abc-af7c-a739c228e449 tempest-VolumesTestJSON-940777586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb9ab668-0a50-4caf-b3eb-9fe739999ef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1818da4-0faf-446e-b097-0e581d2b0d99', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:24:15 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-937525fc-921d-4abc-af7c-a739c228e449 tempest-VolumesTestJSON-940777586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2c3561f-71bd-48bc-a61a-c1d7a8ebb801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:24:15 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-937525fc-921d-4abc-af7c-a739c228e449 tempest-VolumesTestJSON-940777586 None] Volume volume-e1818da4-0faf-446e-b097-0e581d2b0d99 (e1818da4-0faf-446e-b097-0e581d2b0d99): created successfully Sep 16 20:24:15 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-937525fc-921d-4abc-af7c-a739c228e449 tempest-VolumesTestJSON-940777586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2c3561f-71bd-48bc-a61a-c1d7a8ebb801) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:24:15 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-937525fc-921d-4abc-af7c-a739c228e449 tempest-VolumesTestJSON-940777586 None] Flow 'volume_create_manager' (70dcc70e-1b95-47d3-8ed9-c642bee1c9c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:24:15 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-937525fc-921d-4abc-af7c-a739c228e449 tempest-VolumesTestJSON-940777586 None] Created volume successfully. Sep 16 20:24:16 devstack sudo[94927]: pam_unix(sudo:session): session closed for user root Sep 16 20:24:16 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-9c1c1fa4-fb21-4b14-8edf-4fe5b9a76df7 tempest-VolumesSnapshotListTestJSON-1719130302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5.cf1f484c-425b-415e-b949-2ef22275ed0a" returned: 0 in 0.268s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:24:16 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-9c1c1fa4-fb21-4b14-8edf-4fe5b9a76df7 tempest-VolumesSnapshotListTestJSON-1719130302 None] Lock "cinder-quobyte-cf1f484c-425b-415e-b949-2ef22275ed0a" released by "_delete_snapshot" :: held 1.905s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:24:16 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-9c1c1fa4-fb21-4b14-8edf-4fe5b9a76df7 tempest-VolumesSnapshotListTestJSON-1719130302 None] Lock "cinder-quobyte-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5" released by "delete_snapshot" :: held 1.947s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:24:16 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-9c1c1fa4-fb21-4b14-8edf-4fe5b9a76df7 tempest-VolumesSnapshotListTestJSON-1719130302 None] Created reservations ['22d5caf9-e5f0-44cc-a73a-81a148dd6e0a', '58a09183-4093-473c-ab9d-f8b25eb89eff', '61392dd6-da63-4c2f-99db-c36628aaaba1', '5f9c0e4b-8daa-4ab3-875b-2b403c804dca'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:24:16 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-9c1c1fa4-fb21-4b14-8edf-4fe5b9a76df7 tempest-VolumesSnapshotListTestJSON-1719130302 None] Delete snapshot completed successfully. Sep 16 20:24:16 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-9c1c1fa4-fb21-4b14-8edf-4fe5b9a76df7 tempest-VolumesSnapshotListTestJSON-1719130302 None] Lock "cinder-cf1f484c-425b-415e-b949-2ef22275ed0a-delete_snapshot" released by "delete_snapshot" :: held 2.129s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:24:17 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-f82a3a49-0e66-478c-b892-efbd0e243dfe tempest-VolumesSnapshotListTestJSON-1719130302 None] Acquiring lock "cinder-7224d463-ab9e-4459-b8a6-4e0c64b571f4-delete_snapshot" by "delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:24:17 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-f82a3a49-0e66-478c-b892-efbd0e243dfe tempest-VolumesSnapshotListTestJSON-1719130302 None] Lock "cinder-7224d463-ab9e-4459-b8a6-4e0c64b571f4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:24:17 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-f82a3a49-0e66-478c-b892-efbd0e243dfe tempest-VolumesSnapshotListTestJSON-1719130302 None] Acquiring lock "cinder-quobyte-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5" by "delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:24:17 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-f82a3a49-0e66-478c-b892-efbd0e243dfe tempest-VolumesSnapshotListTestJSON-1719130302 None] Lock "cinder-quobyte-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:24:17 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-f82a3a49-0e66-478c-b892-efbd0e243dfe tempest-VolumesSnapshotListTestJSON-1719130302 None] Acquiring lock "cinder-quobyte-7224d463-ab9e-4459-b8a6-4e0c64b571f4" by "_delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:24:17 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-f82a3a49-0e66-478c-b892-efbd0e243dfe tempest-VolumesSnapshotListTestJSON-1719130302 None] Lock "cinder-quobyte-7224d463-ab9e-4459-b8a6-4e0c64b571f4" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:24:17 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-f82a3a49-0e66-478c-b892-efbd0e243dfe tempest-VolumesSnapshotListTestJSON-1719130302 None] Deleting offline snapshot 7224d463-ab9e-4459-b8a6-4e0c64b571f4 of volume d74a6d2e-290f-4f82-b93b-0e0737e5d2e5 {{(pid=86188) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 20:24:17 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-f82a3a49-0e66-478c-b892-efbd0e243dfe tempest-VolumesSnapshotListTestJSON-1719130302 None] snapshot_file for this snap is: volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5.7224d463-ab9e-4459-b8a6-4e0c64b571f4 {{(pid=86188) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 20:24:17 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcb40726-d869-4ab8-bb2c-49c31eee3724]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:24:17 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f82a3a49-0e66-478c-b892-efbd0e243dfe tempest-VolumesSnapshotListTestJSON-1719130302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5.7224d463-ab9e-4459-b8a6-4e0c64b571f4 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:24:17 devstack sudo[94930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5.7224d463-ab9e-4459-b8a6-4e0c64b571f4 Sep 16 20:24:17 devstack sudo[94930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:24:17 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-e69ec5a3-c1b9-4ce4-9111-38c2380f9804 tempest-VolumesTestJSON-940777586 None] Acquiring lock "cinder-e1818da4-0faf-446e-b097-0e581d2b0d99-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:24:17 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-e69ec5a3-c1b9-4ce4-9111-38c2380f9804 tempest-VolumesTestJSON-940777586 None] Lock "cinder-e1818da4-0faf-446e-b097-0e581d2b0d99-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:24:17 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-e69ec5a3-c1b9-4ce4-9111-38c2380f9804 tempest-VolumesTestJSON-940777586 None] Acquiring lock "cinder-quobyte-e1818da4-0faf-446e-b097-0e581d2b0d99" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:24:17 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-e69ec5a3-c1b9-4ce4-9111-38c2380f9804 tempest-VolumesTestJSON-940777586 None] Lock "cinder-quobyte-e1818da4-0faf-446e-b097-0e581d2b0d99" acquired by "delete_volume" :: waited 0.019s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:24:17 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[d54b1736-3366-48ce-ab41-8b56f48011c4]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:24:17 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e69ec5a3-c1b9-4ce4-9111-38c2380f9804 tempest-VolumesTestJSON-940777586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e1818da4-0faf-446e-b097-0e581d2b0d99 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:24:17 devstack sudo[94930]: pam_unix(sudo:session): session closed for user root Sep 16 20:24:17 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f82a3a49-0e66-478c-b892-efbd0e243dfe tempest-VolumesSnapshotListTestJSON-1719130302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5.7224d463-ab9e-4459-b8a6-4e0c64b571f4" returned: 0 in 0.483s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:24:17 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-f82a3a49-0e66-478c-b892-efbd0e243dfe tempest-VolumesSnapshotListTestJSON-1719130302 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86188) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 20:24:18 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[92423047-5a8a-4ebf-b10c-f9aaf58326a9]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:24:18 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f82a3a49-0e66-478c-b892-efbd0e243dfe tempest-VolumesSnapshotListTestJSON-1719130302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:24:18 devstack sudo[94934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e1818da4-0faf-446e-b097-0e581d2b0d99 Sep 16 20:24:18 devstack sudo[94934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:24:18 devstack sudo[94936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5 Sep 16 20:24:18 devstack sudo[94936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:24:18 devstack sudo[94934]: pam_unix(sudo:session): session closed for user root Sep 16 20:24:18 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e69ec5a3-c1b9-4ce4-9111-38c2380f9804 tempest-VolumesTestJSON-940777586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e1818da4-0faf-446e-b097-0e581d2b0d99" returned: 0 in 0.425s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:24:18 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e69ec5a3-c1b9-4ce4-9111-38c2380f9804 tempest-VolumesTestJSON-940777586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e1818da4-0faf-446e-b097-0e581d2b0d99 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:24:18 devstack sudo[94943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e1818da4-0faf-446e-b097-0e581d2b0d99 Sep 16 20:24:18 devstack sudo[94943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:24:18 devstack sudo[94936]: pam_unix(sudo:session): session closed for user root Sep 16 20:24:18 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f82a3a49-0e66-478c-b892-efbd0e243dfe tempest-VolumesSnapshotListTestJSON-1719130302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5" returned: 0 in 0.416s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:24:18 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f82a3a49-0e66-478c-b892-efbd0e243dfe tempest-VolumesSnapshotListTestJSON-1719130302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5.7224d463-ab9e-4459-b8a6-4e0c64b571f4 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:24:18 devstack sudo[94948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5.7224d463-ab9e-4459-b8a6-4e0c64b571f4 Sep 16 20:24:18 devstack sudo[94948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:24:18 devstack sudo[94943]: pam_unix(sudo:session): session closed for user root Sep 16 20:24:18 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e69ec5a3-c1b9-4ce4-9111-38c2380f9804 tempest-VolumesTestJSON-940777586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e1818da4-0faf-446e-b097-0e581d2b0d99" returned: 0 in 0.304s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:24:18 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-e69ec5a3-c1b9-4ce4-9111-38c2380f9804 tempest-VolumesTestJSON-940777586 None] Lock "cinder-quobyte-e1818da4-0faf-446e-b097-0e581d2b0d99" released by "delete_volume" :: held 0.783s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:24:18 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-e69ec5a3-c1b9-4ce4-9111-38c2380f9804 tempest-VolumesTestJSON-940777586 None] Created reservations ['bbec59ab-c4ad-4407-8fb6-540f408d33e1', '7b218fa5-1ca1-4381-ad74-88d6832b2575', 'fe933061-b3ce-4967-a964-b8308d40e622', '88acce43-96b2-4d7d-9315-98cdead68e81'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:24:18 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-e69ec5a3-c1b9-4ce4-9111-38c2380f9804 tempest-VolumesTestJSON-940777586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:24:18 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-e69ec5a3-c1b9-4ce4-9111-38c2380f9804 tempest-VolumesTestJSON-940777586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:24:18 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-e69ec5a3-c1b9-4ce4-9111-38c2380f9804 tempest-VolumesTestJSON-940777586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:24:18 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-e69ec5a3-c1b9-4ce4-9111-38c2380f9804 tempest-VolumesTestJSON-940777586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:24:18 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-e69ec5a3-c1b9-4ce4-9111-38c2380f9804 tempest-VolumesTestJSON-940777586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:24:18 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e69ec5a3-c1b9-4ce4-9111-38c2380f9804 tempest-VolumesTestJSON-940777586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:24:18 devstack sudo[94958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:24:18 devstack sudo[94958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:24:18 devstack sudo[94948]: pam_unix(sudo:session): session closed for user root Sep 16 20:24:18 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f82a3a49-0e66-478c-b892-efbd0e243dfe tempest-VolumesSnapshotListTestJSON-1719130302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5.7224d463-ab9e-4459-b8a6-4e0c64b571f4" returned: 0 in 0.372s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:24:18 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f82a3a49-0e66-478c-b892-efbd0e243dfe tempest-VolumesSnapshotListTestJSON-1719130302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5.7224d463-ab9e-4459-b8a6-4e0c64b571f4 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:24:18 devstack sudo[94960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5.7224d463-ab9e-4459-b8a6-4e0c64b571f4 Sep 16 20:24:18 devstack sudo[94960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:24:18 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-386dc54c-062d-4943-8949-1b101068c6af tempest-VolumesTestJSON-940777586 None] Acquiring lock "cinder-aa94d3cc-0ac9-40d6-9354-9981fda24d34-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:24:18 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-386dc54c-062d-4943-8949-1b101068c6af tempest-VolumesTestJSON-940777586 None] Lock "cinder-aa94d3cc-0ac9-40d6-9354-9981fda24d34-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:24:19 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-386dc54c-062d-4943-8949-1b101068c6af tempest-VolumesTestJSON-940777586 None] Acquiring lock "cinder-quobyte-aa94d3cc-0ac9-40d6-9354-9981fda24d34" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:24:19 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-386dc54c-062d-4943-8949-1b101068c6af tempest-VolumesTestJSON-940777586 None] Lock "cinder-quobyte-aa94d3cc-0ac9-40d6-9354-9981fda24d34" acquired by "delete_volume" :: waited 0.022s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:24:19 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef074c1e-a5ad-4b2b-bdaa-6dad5cca39d3]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:24:19 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-386dc54c-062d-4943-8949-1b101068c6af tempest-VolumesTestJSON-940777586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-aa94d3cc-0ac9-40d6-9354-9981fda24d34 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:24:19 devstack sudo[94958]: pam_unix(sudo:session): session closed for user root Sep 16 20:24:19 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e69ec5a3-c1b9-4ce4-9111-38c2380f9804 tempest-VolumesTestJSON-940777586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.308s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:24:19 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-e69ec5a3-c1b9-4ce4-9111-38c2380f9804 tempest-VolumesTestJSON-940777586 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:24:19 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-e69ec5a3-c1b9-4ce4-9111-38c2380f9804 tempest-VolumesTestJSON-940777586 None] Deleted volume successfully. Sep 16 20:24:19 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-e69ec5a3-c1b9-4ce4-9111-38c2380f9804 tempest-VolumesTestJSON-940777586 None] Lock "cinder-e1818da4-0faf-446e-b097-0e581d2b0d99-delete_volume" released by "delete_volume" :: held 1.333s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:24:19 devstack sudo[94960]: pam_unix(sudo:session): session closed for user root Sep 16 20:24:19 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f82a3a49-0e66-478c-b892-efbd0e243dfe tempest-VolumesSnapshotListTestJSON-1719130302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5.7224d463-ab9e-4459-b8a6-4e0c64b571f4" returned: 0 in 0.371s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:24:19 devstack sudo[94963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-aa94d3cc-0ac9-40d6-9354-9981fda24d34 Sep 16 20:24:19 devstack sudo[94963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:24:19 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-f82a3a49-0e66-478c-b892-efbd0e243dfe tempest-VolumesSnapshotListTestJSON-1719130302 None] Lock "cinder-quobyte-7224d463-ab9e-4459-b8a6-4e0c64b571f4" released by "_delete_snapshot" :: held 1.810s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:24:19 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-f82a3a49-0e66-478c-b892-efbd0e243dfe tempest-VolumesSnapshotListTestJSON-1719130302 None] Lock "cinder-quobyte-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5" released by "delete_snapshot" :: held 1.846s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:24:19 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-f82a3a49-0e66-478c-b892-efbd0e243dfe tempest-VolumesSnapshotListTestJSON-1719130302 None] Created reservations ['3321c9d4-3527-4012-a9fe-7a17338002b1', '7c0eebee-a02c-48e3-8525-340d25922c44', '95ee9e1a-6ee3-44d1-a089-edae4342679b', 'a29089d6-97af-4de3-ad58-6f0ec6e63fb8'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:24:19 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-f82a3a49-0e66-478c-b892-efbd0e243dfe tempest-VolumesSnapshotListTestJSON-1719130302 None] Delete snapshot completed successfully. Sep 16 20:24:19 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-f82a3a49-0e66-478c-b892-efbd0e243dfe tempest-VolumesSnapshotListTestJSON-1719130302 None] Lock "cinder-7224d463-ab9e-4459-b8a6-4e0c64b571f4-delete_snapshot" released by "delete_snapshot" :: held 2.046s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:24:19 devstack sudo[94963]: pam_unix(sudo:session): session closed for user root Sep 16 20:24:19 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-386dc54c-062d-4943-8949-1b101068c6af tempest-VolumesTestJSON-940777586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-aa94d3cc-0ac9-40d6-9354-9981fda24d34" returned: 0 in 0.553s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:24:19 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-386dc54c-062d-4943-8949-1b101068c6af tempest-VolumesTestJSON-940777586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-aa94d3cc-0ac9-40d6-9354-9981fda24d34 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:24:19 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-630bc754-0d4b-4011-a4e8-01987998c8fe tempest-VolumesSnapshotListTestJSON-1719130302 None] Acquiring lock "cinder-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:24:19 devstack sudo[94969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-aa94d3cc-0ac9-40d6-9354-9981fda24d34 Sep 16 20:24:19 devstack sudo[94969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:24:19 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-630bc754-0d4b-4011-a4e8-01987998c8fe tempest-VolumesSnapshotListTestJSON-1719130302 None] Lock "cinder-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:24:19 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-630bc754-0d4b-4011-a4e8-01987998c8fe tempest-VolumesSnapshotListTestJSON-1719130302 None] Acquiring lock "cinder-quobyte-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:24:19 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-630bc754-0d4b-4011-a4e8-01987998c8fe tempest-VolumesSnapshotListTestJSON-1719130302 None] Lock "cinder-quobyte-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5" acquired by "delete_volume" :: waited 0.027s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:24:19 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[c497c5d7-d9f0-4d15-9db4-1c7d97bf55a2]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:24:19 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-630bc754-0d4b-4011-a4e8-01987998c8fe tempest-VolumesSnapshotListTestJSON-1719130302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:24:19 devstack sudo[94972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5 Sep 16 20:24:19 devstack sudo[94972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:24:19 devstack sudo[94969]: pam_unix(sudo:session): session closed for user root Sep 16 20:24:19 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-386dc54c-062d-4943-8949-1b101068c6af tempest-VolumesTestJSON-940777586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-aa94d3cc-0ac9-40d6-9354-9981fda24d34" returned: 0 in 0.312s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:24:19 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-386dc54c-062d-4943-8949-1b101068c6af tempest-VolumesTestJSON-940777586 None] Lock "cinder-quobyte-aa94d3cc-0ac9-40d6-9354-9981fda24d34" released by "delete_volume" :: held 0.916s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:24:20 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-386dc54c-062d-4943-8949-1b101068c6af tempest-VolumesTestJSON-940777586 None] Created reservations ['d2b46693-5b72-403b-9803-b42f0b2f67be', '75988a76-3511-4b1b-838e-6ffa331fbfcf', '7a633a6f-114e-4994-b5c6-7034d7257cd6', '1cb67ef2-965d-415d-9412-b9b1e6da787f'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:24:20 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-386dc54c-062d-4943-8949-1b101068c6af tempest-VolumesTestJSON-940777586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:24:20 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-386dc54c-062d-4943-8949-1b101068c6af tempest-VolumesTestJSON-940777586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:24:20 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-386dc54c-062d-4943-8949-1b101068c6af tempest-VolumesTestJSON-940777586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:24:20 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-386dc54c-062d-4943-8949-1b101068c6af tempest-VolumesTestJSON-940777586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:24:20 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-386dc54c-062d-4943-8949-1b101068c6af tempest-VolumesTestJSON-940777586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:24:20 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-386dc54c-062d-4943-8949-1b101068c6af tempest-VolumesTestJSON-940777586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:24:20 devstack sudo[94989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:24:20 devstack sudo[94989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:24:20 devstack sudo[94972]: pam_unix(sudo:session): session closed for user root Sep 16 20:24:20 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-630bc754-0d4b-4011-a4e8-01987998c8fe tempest-VolumesSnapshotListTestJSON-1719130302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5" returned: 0 in 0.622s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:24:20 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-630bc754-0d4b-4011-a4e8-01987998c8fe tempest-VolumesSnapshotListTestJSON-1719130302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:24:20 devstack sudo[94999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5 Sep 16 20:24:20 devstack sudo[94999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:24:20 devstack sudo[94989]: pam_unix(sudo:session): session closed for user root Sep 16 20:24:20 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-386dc54c-062d-4943-8949-1b101068c6af tempest-VolumesTestJSON-940777586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.343s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:24:20 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-386dc54c-062d-4943-8949-1b101068c6af tempest-VolumesTestJSON-940777586 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:24:20 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-386dc54c-062d-4943-8949-1b101068c6af tempest-VolumesTestJSON-940777586 None] Deleted volume successfully. Sep 16 20:24:20 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-386dc54c-062d-4943-8949-1b101068c6af tempest-VolumesTestJSON-940777586 None] Lock "cinder-aa94d3cc-0ac9-40d6-9354-9981fda24d34-delete_volume" released by "delete_volume" :: held 1.687s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:24:20 devstack sudo[94999]: pam_unix(sudo:session): session closed for user root Sep 16 20:24:20 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-630bc754-0d4b-4011-a4e8-01987998c8fe tempest-VolumesSnapshotListTestJSON-1719130302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5" returned: 0 in 0.269s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:24:20 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-630bc754-0d4b-4011-a4e8-01987998c8fe tempest-VolumesSnapshotListTestJSON-1719130302 None] Lock "cinder-quobyte-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5" released by "delete_volume" :: held 0.971s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:24:20 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-630bc754-0d4b-4011-a4e8-01987998c8fe tempest-VolumesSnapshotListTestJSON-1719130302 None] Created reservations ['ba3e204c-90ae-4188-bbb3-dd0d5404349f', '3654f2e7-443d-4ff9-8b56-be26417cf175', '08efae84-953e-429a-abad-c116ed80b32a', '768657e8-bbd4-46cb-a69f-54f565382428'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:24:20 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-630bc754-0d4b-4011-a4e8-01987998c8fe tempest-VolumesSnapshotListTestJSON-1719130302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:24:20 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-630bc754-0d4b-4011-a4e8-01987998c8fe tempest-VolumesSnapshotListTestJSON-1719130302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:24:20 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-630bc754-0d4b-4011-a4e8-01987998c8fe tempest-VolumesSnapshotListTestJSON-1719130302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:24:20 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-630bc754-0d4b-4011-a4e8-01987998c8fe tempest-VolumesSnapshotListTestJSON-1719130302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:24:20 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-630bc754-0d4b-4011-a4e8-01987998c8fe tempest-VolumesSnapshotListTestJSON-1719130302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:24:20 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-630bc754-0d4b-4011-a4e8-01987998c8fe tempest-VolumesSnapshotListTestJSON-1719130302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:24:20 devstack sudo[95003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:24:20 devstack sudo[95003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:24:21 devstack sudo[95003]: pam_unix(sudo:session): session closed for user root Sep 16 20:24:21 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-630bc754-0d4b-4011-a4e8-01987998c8fe tempest-VolumesSnapshotListTestJSON-1719130302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.278s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:24:21 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-630bc754-0d4b-4011-a4e8-01987998c8fe tempest-VolumesSnapshotListTestJSON-1719130302 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:24:21 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-630bc754-0d4b-4011-a4e8-01987998c8fe tempest-VolumesSnapshotListTestJSON-1719130302 None] Deleted volume successfully. Sep 16 20:24:21 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-630bc754-0d4b-4011-a4e8-01987998c8fe tempest-VolumesSnapshotListTestJSON-1719130302 None] Lock "cinder-d74a6d2e-290f-4f82-b93b-0e0737e5d2e5-delete_volume" released by "delete_volume" :: held 1.515s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:24:21 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-0211e5c0-5970-4438-8d4a-13b97147723a tempest-VolumesTestJSON-940777586 None] Acquiring lock "cinder-42eb3bc4-9440-41d4-a9bc-9e277444cb64-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:24:21 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-0211e5c0-5970-4438-8d4a-13b97147723a tempest-VolumesTestJSON-940777586 None] Lock "cinder-42eb3bc4-9440-41d4-a9bc-9e277444cb64-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:24:21 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-0211e5c0-5970-4438-8d4a-13b97147723a tempest-VolumesTestJSON-940777586 None] Acquiring lock "cinder-quobyte-42eb3bc4-9440-41d4-a9bc-9e277444cb64" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:24:21 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-0211e5c0-5970-4438-8d4a-13b97147723a tempest-VolumesTestJSON-940777586 None] Lock "cinder-quobyte-42eb3bc4-9440-41d4-a9bc-9e277444cb64" acquired by "delete_volume" :: waited 0.016s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:24:21 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b6ab729-e9b7-409e-82da-93a5208b2f9e]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:24:21 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-0211e5c0-5970-4438-8d4a-13b97147723a tempest-VolumesTestJSON-940777586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-42eb3bc4-9440-41d4-a9bc-9e277444cb64 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:24:21 devstack sudo[95006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-42eb3bc4-9440-41d4-a9bc-9e277444cb64 Sep 16 20:24:21 devstack sudo[95006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:24:21 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [req-79ac6f70-8b28-4da3-a6d6-96c4535e62c3 req-bb4a63e0-75de-4214-8d46-28e50799e19b tempest-AttachVolumeShelveTestJSON-649703128 None] No connector for attachment 1a3fe1e4-ea26-4d5b-b810-989c66436553; skipping storage backend terminate_connection call. {{(pid=86188) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 16 20:24:21 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [req-79ac6f70-8b28-4da3-a6d6-96c4535e62c3 req-bb4a63e0-75de-4214-8d46-28e50799e19b tempest-AttachVolumeShelveTestJSON-649703128 None] Deleting attachment 1a3fe1e4-ea26-4d5b-b810-989c66436553. {{(pid=86188) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 16 20:24:21 devstack sudo[95006]: pam_unix(sudo:session): session closed for user root Sep 16 20:24:21 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-0211e5c0-5970-4438-8d4a-13b97147723a tempest-VolumesTestJSON-940777586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-42eb3bc4-9440-41d4-a9bc-9e277444cb64" returned: 0 in 0.405s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:24:21 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-0211e5c0-5970-4438-8d4a-13b97147723a tempest-VolumesTestJSON-940777586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-42eb3bc4-9440-41d4-a9bc-9e277444cb64 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:24:21 devstack sudo[95012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-42eb3bc4-9440-41d4-a9bc-9e277444cb64 Sep 16 20:24:21 devstack sudo[95012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:24:22 devstack sudo[95012]: pam_unix(sudo:session): session closed for user root Sep 16 20:24:22 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-0211e5c0-5970-4438-8d4a-13b97147723a tempest-VolumesTestJSON-940777586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-42eb3bc4-9440-41d4-a9bc-9e277444cb64" returned: 0 in 0.385s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:24:22 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-0211e5c0-5970-4438-8d4a-13b97147723a tempest-VolumesTestJSON-940777586 None] Lock "cinder-quobyte-42eb3bc4-9440-41d4-a9bc-9e277444cb64" released by "delete_volume" :: held 0.855s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:24:22 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-0211e5c0-5970-4438-8d4a-13b97147723a tempest-VolumesTestJSON-940777586 None] Created reservations ['d3d703bf-155a-4159-8213-f972c640cc14', 'b6f7a0a1-4d7d-4fea-9442-c9b9285f587a', '1e302ea7-d470-42d0-9a68-4e5e8f5dcd85', '7422ce96-902d-42d2-9e82-303c2dcad379'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:24:22 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-0211e5c0-5970-4438-8d4a-13b97147723a tempest-VolumesTestJSON-940777586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:24:22 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-0211e5c0-5970-4438-8d4a-13b97147723a tempest-VolumesTestJSON-940777586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:24:22 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-0211e5c0-5970-4438-8d4a-13b97147723a tempest-VolumesTestJSON-940777586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:24:22 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-0211e5c0-5970-4438-8d4a-13b97147723a tempest-VolumesTestJSON-940777586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:24:22 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-0211e5c0-5970-4438-8d4a-13b97147723a tempest-VolumesTestJSON-940777586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:24:22 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-0211e5c0-5970-4438-8d4a-13b97147723a tempest-VolumesTestJSON-940777586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:24:22 devstack sudo[95016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:24:22 devstack sudo[95016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:24:22 devstack sudo[95016]: pam_unix(sudo:session): session closed for user root Sep 16 20:24:22 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-0211e5c0-5970-4438-8d4a-13b97147723a tempest-VolumesTestJSON-940777586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.298s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:24:22 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-0211e5c0-5970-4438-8d4a-13b97147723a tempest-VolumesTestJSON-940777586 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:24:22 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-0211e5c0-5970-4438-8d4a-13b97147723a tempest-VolumesTestJSON-940777586 None] Deleted volume successfully. Sep 16 20:24:22 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-0211e5c0-5970-4438-8d4a-13b97147723a tempest-VolumesTestJSON-940777586 None] Lock "cinder-42eb3bc4-9440-41d4-a9bc-9e277444cb64-delete_volume" released by "delete_volume" :: held 1.592s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:24:26 devstack cinder-volume[86188]: DEBUG dbcounter [-] [86188] Writing DB stats cinder:UPDATE=138,cinder:SELECT=124,cinder:INSERT=42,cinder:DELETE=15 {{(pid=86188) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 20:24:26 devstack cinder-volume[86188]: DEBUG dbcounter [-] [86188] Writing DB stats cinder:SELECT=115,cinder:UPDATE=147,cinder:INSERT=38,cinder:DELETE=8 {{(pid=86188) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 20:24:26 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ea9f402-ba7d-42bc-a4ae-e207f590693a tempest-AttachVolumeTestJSON-1467622944 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:24:26 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-7ea9f402-ba7d-42bc-a4ae-e207f590693a tempest-AttachVolumeTestJSON-1467622944 None] Flow 'volume_create_manager' (cd0a1455-6684-4840-8e29-fdbf81ad3e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:24:26 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-7ea9f402-ba7d-42bc-a4ae-e207f590693a tempest-AttachVolumeTestJSON-1467622944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f66f22f0-28b3-48c0-9fa8-4f6bb5f9b4fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:24:26 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-7ea9f402-ba7d-42bc-a4ae-e207f590693a tempest-AttachVolumeTestJSON-1467622944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f66f22f0-28b3-48c0-9fa8-4f6bb5f9b4fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:24:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-24915622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab8e718b-2be2-46b0-a4bb-575999d08fec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60ff89b3e3eb4e7285068cffd56e1463',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:24:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:24:26Z,use_quota=True,user_id='1f5bea0dd7ad4abdb4916eaf9bf51306',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:24:26 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-7ea9f402-ba7d-42bc-a4ae-e207f590693a tempest-AttachVolumeTestJSON-1467622944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c3c760a-3a6e-478b-ae62-a6a1e72ac8d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:24:26 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-7ea9f402-ba7d-42bc-a4ae-e207f590693a tempest-AttachVolumeTestJSON-1467622944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c3c760a-3a6e-478b-ae62-a6a1e72ac8d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:24:26 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-7ea9f402-ba7d-42bc-a4ae-e207f590693a tempest-AttachVolumeTestJSON-1467622944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d5f5414-1c5a-4d87-a0ec-aa5eca72834b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:24:26 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-7ea9f402-ba7d-42bc-a4ae-e207f590693a tempest-AttachVolumeTestJSON-1467622944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d5f5414-1c5a-4d87-a0ec-aa5eca72834b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab8e718b-2be2-46b0-a4bb-575999d08fec', 'volume_name': 'volume-ab8e718b-2be2-46b0-a4bb-575999d08fec', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:24:26 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-7ea9f402-ba7d-42bc-a4ae-e207f590693a tempest-AttachVolumeTestJSON-1467622944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19022442-5661-45d2-a62e-227e228e4a38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:24:26 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-7ea9f402-ba7d-42bc-a4ae-e207f590693a tempest-AttachVolumeTestJSON-1467622944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19022442-5661-45d2-a62e-227e228e4a38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:24:26 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-7ea9f402-ba7d-42bc-a4ae-e207f590693a tempest-AttachVolumeTestJSON-1467622944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85ee4d91-2571-49c2-92dc-b7ecc1f8aa73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:24:26 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-7ea9f402-ba7d-42bc-a4ae-e207f590693a tempest-AttachVolumeTestJSON-1467622944 None] Volume ab8e718b-2be2-46b0-a4bb-575999d08fec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab8e718b-2be2-46b0-a4bb-575999d08fec', 'volume_size': 1} Sep 16 20:24:26 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-7ea9f402-ba7d-42bc-a4ae-e207f590693a tempest-AttachVolumeTestJSON-1467622944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:24:26 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-7ea9f402-ba7d-42bc-a4ae-e207f590693a tempest-AttachVolumeTestJSON-1467622944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:24:26 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-7ea9f402-ba7d-42bc-a4ae-e207f590693a tempest-AttachVolumeTestJSON-1467622944 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:24:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-24915622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab8e718b-2be2-46b0-a4bb-575999d08fec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60ff89b3e3eb4e7285068cffd56e1463',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:24:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:24:26Z,use_quota=True,user_id='1f5bea0dd7ad4abdb4916eaf9bf51306',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:24:26 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-7ea9f402-ba7d-42bc-a4ae-e207f590693a tempest-AttachVolumeTestJSON-1467622944 None] Creating volume ab8e718b-2be2-46b0-a4bb-575999d08fec {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:24:26 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-7ea9f402-ba7d-42bc-a4ae-e207f590693a tempest-AttachVolumeTestJSON-1467622944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:24:26 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-7ea9f402-ba7d-42bc-a4ae-e207f590693a tempest-AttachVolumeTestJSON-1467622944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:24:26 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-7ea9f402-ba7d-42bc-a4ae-e207f590693a tempest-AttachVolumeTestJSON-1467622944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:24:26 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-7ea9f402-ba7d-42bc-a4ae-e207f590693a tempest-AttachVolumeTestJSON-1467622944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:24:26 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-7ea9f402-ba7d-42bc-a4ae-e207f590693a tempest-AttachVolumeTestJSON-1467622944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:24:26 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-7ea9f402-ba7d-42bc-a4ae-e207f590693a tempest-AttachVolumeTestJSON-1467622944 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:24:26 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-7ea9f402-ba7d-42bc-a4ae-e207f590693a tempest-AttachVolumeTestJSON-1467622944 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:24:26 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-7ea9f402-ba7d-42bc-a4ae-e207f590693a tempest-AttachVolumeTestJSON-1467622944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ab8e718b-2be2-46b0-a4bb-575999d08fec 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:24:26 devstack sudo[95025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ab8e718b-2be2-46b0-a4bb-575999d08fec 1073741824 Sep 16 20:24:26 devstack sudo[95025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:24:26 devstack sudo[95025]: pam_unix(sudo:session): session closed for user root Sep 16 20:24:26 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-7ea9f402-ba7d-42bc-a4ae-e207f590693a tempest-AttachVolumeTestJSON-1467622944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ab8e718b-2be2-46b0-a4bb-575999d08fec 1073741824" returned: 0 in 0.648s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:24:27 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-7ea9f402-ba7d-42bc-a4ae-e207f590693a tempest-AttachVolumeTestJSON-1467622944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ab8e718b-2be2-46b0-a4bb-575999d08fec {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:24:27 devstack sudo[95030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ab8e718b-2be2-46b0-a4bb-575999d08fec Sep 16 20:24:27 devstack sudo[95030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:24:27 devstack sudo[95030]: pam_unix(sudo:session): session closed for user root Sep 16 20:24:27 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-7ea9f402-ba7d-42bc-a4ae-e207f590693a tempest-AttachVolumeTestJSON-1467622944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ab8e718b-2be2-46b0-a4bb-575999d08fec" returned: 0 in 0.389s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:24:27 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-7ea9f402-ba7d-42bc-a4ae-e207f590693a tempest-AttachVolumeTestJSON-1467622944 None] <== create_volume: return (1110ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:24:27 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-7ea9f402-ba7d-42bc-a4ae-e207f590693a tempest-AttachVolumeTestJSON-1467622944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.116s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:24:27 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-7ea9f402-ba7d-42bc-a4ae-e207f590693a tempest-AttachVolumeTestJSON-1467622944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85ee4d91-2571-49c2-92dc-b7ecc1f8aa73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab8e718b-2be2-46b0-a4bb-575999d08fec', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:24:27 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-7ea9f402-ba7d-42bc-a4ae-e207f590693a tempest-AttachVolumeTestJSON-1467622944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5dcc77c-e65c-4ea3-834d-ee6c3110b130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:24:27 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-7ea9f402-ba7d-42bc-a4ae-e207f590693a tempest-AttachVolumeTestJSON-1467622944 None] Volume volume-ab8e718b-2be2-46b0-a4bb-575999d08fec (ab8e718b-2be2-46b0-a4bb-575999d08fec): created successfully Sep 16 20:24:27 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-7ea9f402-ba7d-42bc-a4ae-e207f590693a tempest-AttachVolumeTestJSON-1467622944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5dcc77c-e65c-4ea3-834d-ee6c3110b130) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:24:27 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-7ea9f402-ba7d-42bc-a4ae-e207f590693a tempest-AttachVolumeTestJSON-1467622944 None] Flow 'volume_create_manager' (cd0a1455-6684-4840-8e29-fdbf81ad3e98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:24:27 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-7ea9f402-ba7d-42bc-a4ae-e207f590693a tempest-AttachVolumeTestJSON-1467622944 None] Created volume successfully. Sep 16 20:24:29 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [req-52500f49-272c-4aed-a067-a920b9b595f5 req-f1181c10-cadf-41c7-bf7a-09a27f626d67 tempest-AttachVolumeTestJSON-1467622944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:24:29 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [req-52500f49-272c-4aed-a067-a920b9b595f5 req-f1181c10-cadf-41c7-bf7a-09a27f626d67 tempest-AttachVolumeTestJSON-1467622944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:24:29 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [req-52500f49-272c-4aed-a067-a920b9b595f5 req-f1181c10-cadf-41c7-bf7a-09a27f626d67 tempest-AttachVolumeTestJSON-1467622944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:24:29 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [req-52500f49-272c-4aed-a067-a920b9b595f5 req-f1181c10-cadf-41c7-bf7a-09a27f626d67 tempest-AttachVolumeTestJSON-1467622944 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81', 'name': 'volume-ab8e718b-2be2-46b0-a4bb-575999d08fec', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9d5535f2-ae39-4843-a220-cb12fcc7eb3b', 'enforce_multipath': True} {{(pid=86188) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 16 20:24:29 devstack cinder-volume[86188]: INFO cinder.volume.manager [req-52500f49-272c-4aed-a067-a920b9b595f5 req-f1181c10-cadf-41c7-bf7a-09a27f626d67 tempest-AttachVolumeTestJSON-1467622944 None] attachment_update completed successfully. Sep 16 20:24:32 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-9aa92548-7f2d-483d-9492-727fefc24df2 tempest-AttachVolumeTestJSON-1467622944 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:24:32 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-9aa92548-7f2d-483d-9492-727fefc24df2 tempest-AttachVolumeTestJSON-1467622944 None] Flow 'volume_create_manager' (de117053-335f-45c4-aea8-aa934772ecb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:24:32 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-9aa92548-7f2d-483d-9492-727fefc24df2 tempest-AttachVolumeTestJSON-1467622944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa2dd24e-53e5-4252-93f3-f113ebcacee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:24:32 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-9aa92548-7f2d-483d-9492-727fefc24df2 tempest-AttachVolumeTestJSON-1467622944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa2dd24e-53e5-4252-93f3-f113ebcacee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:24:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1555546241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33e3a96c-c195-4cf0-8a23-30e2648374d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60ff89b3e3eb4e7285068cffd56e1463',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:24:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:24:32Z,use_quota=True,user_id='1f5bea0dd7ad4abdb4916eaf9bf51306',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:24:32 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-9aa92548-7f2d-483d-9492-727fefc24df2 tempest-AttachVolumeTestJSON-1467622944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf0973a3-16d6-4e3b-9c6f-6978fcfee972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:24:32 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-9aa92548-7f2d-483d-9492-727fefc24df2 tempest-AttachVolumeTestJSON-1467622944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf0973a3-16d6-4e3b-9c6f-6978fcfee972) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:24:32 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-9aa92548-7f2d-483d-9492-727fefc24df2 tempest-AttachVolumeTestJSON-1467622944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d9e5a71-4162-4498-9a58-097c5143f4e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:24:32 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-9aa92548-7f2d-483d-9492-727fefc24df2 tempest-AttachVolumeTestJSON-1467622944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d9e5a71-4162-4498-9a58-097c5143f4e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33e3a96c-c195-4cf0-8a23-30e2648374d5', 'volume_name': 'volume-33e3a96c-c195-4cf0-8a23-30e2648374d5', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:24:32 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-9aa92548-7f2d-483d-9492-727fefc24df2 tempest-AttachVolumeTestJSON-1467622944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d2ef0ed-1305-43e3-9d94-ee2487a12411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:24:32 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-9aa92548-7f2d-483d-9492-727fefc24df2 tempest-AttachVolumeTestJSON-1467622944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d2ef0ed-1305-43e3-9d94-ee2487a12411) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:24:32 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-9aa92548-7f2d-483d-9492-727fefc24df2 tempest-AttachVolumeTestJSON-1467622944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9af60577-c531-42f7-b04b-2fb7bb14f592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:24:32 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-9aa92548-7f2d-483d-9492-727fefc24df2 tempest-AttachVolumeTestJSON-1467622944 None] Volume 33e3a96c-c195-4cf0-8a23-30e2648374d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33e3a96c-c195-4cf0-8a23-30e2648374d5', 'volume_size': 1} Sep 16 20:24:32 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-9aa92548-7f2d-483d-9492-727fefc24df2 tempest-AttachVolumeTestJSON-1467622944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:24:32 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-9aa92548-7f2d-483d-9492-727fefc24df2 tempest-AttachVolumeTestJSON-1467622944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:24:32 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-9aa92548-7f2d-483d-9492-727fefc24df2 tempest-AttachVolumeTestJSON-1467622944 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:24:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1555546241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33e3a96c-c195-4cf0-8a23-30e2648374d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60ff89b3e3eb4e7285068cffd56e1463',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:24:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:24:32Z,use_quota=True,user_id='1f5bea0dd7ad4abdb4916eaf9bf51306',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:24:32 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-9aa92548-7f2d-483d-9492-727fefc24df2 tempest-AttachVolumeTestJSON-1467622944 None] Creating volume 33e3a96c-c195-4cf0-8a23-30e2648374d5 {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:24:32 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-9aa92548-7f2d-483d-9492-727fefc24df2 tempest-AttachVolumeTestJSON-1467622944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:24:32 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-9aa92548-7f2d-483d-9492-727fefc24df2 tempest-AttachVolumeTestJSON-1467622944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:24:32 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-9aa92548-7f2d-483d-9492-727fefc24df2 tempest-AttachVolumeTestJSON-1467622944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:24:32 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-9aa92548-7f2d-483d-9492-727fefc24df2 tempest-AttachVolumeTestJSON-1467622944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:24:32 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-9aa92548-7f2d-483d-9492-727fefc24df2 tempest-AttachVolumeTestJSON-1467622944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:24:32 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-9aa92548-7f2d-483d-9492-727fefc24df2 tempest-AttachVolumeTestJSON-1467622944 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:24:32 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-9aa92548-7f2d-483d-9492-727fefc24df2 tempest-AttachVolumeTestJSON-1467622944 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:24:32 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-9aa92548-7f2d-483d-9492-727fefc24df2 tempest-AttachVolumeTestJSON-1467622944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-33e3a96c-c195-4cf0-8a23-30e2648374d5 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:24:32 devstack sudo[95493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-33e3a96c-c195-4cf0-8a23-30e2648374d5 1073741824 Sep 16 20:24:32 devstack sudo[95493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:24:33 devstack sudo[95493]: pam_unix(sudo:session): session closed for user root Sep 16 20:24:33 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-9aa92548-7f2d-483d-9492-727fefc24df2 tempest-AttachVolumeTestJSON-1467622944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-33e3a96c-c195-4cf0-8a23-30e2648374d5 1073741824" returned: 0 in 0.709s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:24:33 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-9aa92548-7f2d-483d-9492-727fefc24df2 tempest-AttachVolumeTestJSON-1467622944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-33e3a96c-c195-4cf0-8a23-30e2648374d5 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:24:33 devstack sudo[95515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-33e3a96c-c195-4cf0-8a23-30e2648374d5 Sep 16 20:24:33 devstack sudo[95515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:24:33 devstack sudo[95515]: pam_unix(sudo:session): session closed for user root Sep 16 20:24:33 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-9aa92548-7f2d-483d-9492-727fefc24df2 tempest-AttachVolumeTestJSON-1467622944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-33e3a96c-c195-4cf0-8a23-30e2648374d5" returned: 0 in 0.704s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:24:33 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-9aa92548-7f2d-483d-9492-727fefc24df2 tempest-AttachVolumeTestJSON-1467622944 None] <== create_volume: return (1496ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:24:33 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-9aa92548-7f2d-483d-9492-727fefc24df2 tempest-AttachVolumeTestJSON-1467622944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.501s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:24:33 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-9aa92548-7f2d-483d-9492-727fefc24df2 tempest-AttachVolumeTestJSON-1467622944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9af60577-c531-42f7-b04b-2fb7bb14f592) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33e3a96c-c195-4cf0-8a23-30e2648374d5', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:24:33 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-9aa92548-7f2d-483d-9492-727fefc24df2 tempest-AttachVolumeTestJSON-1467622944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65349a02-7d09-421f-8095-576a58498865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:24:33 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-9aa92548-7f2d-483d-9492-727fefc24df2 tempest-AttachVolumeTestJSON-1467622944 None] Volume volume-33e3a96c-c195-4cf0-8a23-30e2648374d5 (33e3a96c-c195-4cf0-8a23-30e2648374d5): created successfully Sep 16 20:24:33 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-9aa92548-7f2d-483d-9492-727fefc24df2 tempest-AttachVolumeTestJSON-1467622944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65349a02-7d09-421f-8095-576a58498865) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:24:33 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-9aa92548-7f2d-483d-9492-727fefc24df2 tempest-AttachVolumeTestJSON-1467622944 None] Flow 'volume_create_manager' (de117053-335f-45c4-aea8-aa934772ecb9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:24:34 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-9aa92548-7f2d-483d-9492-727fefc24df2 tempest-AttachVolumeTestJSON-1467622944 None] Created volume successfully. Sep 16 20:24:35 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [req-4507b331-9522-4243-9c97-3261750e0619 req-96836551-081b-4d9d-ae0a-890c064f0a24 tempest-AttachVolumeTestJSON-1467622944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:24:35 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [req-4507b331-9522-4243-9c97-3261750e0619 req-96836551-081b-4d9d-ae0a-890c064f0a24 tempest-AttachVolumeTestJSON-1467622944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:24:35 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [req-4507b331-9522-4243-9c97-3261750e0619 req-96836551-081b-4d9d-ae0a-890c064f0a24 tempest-AttachVolumeTestJSON-1467622944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:24:36 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [req-4507b331-9522-4243-9c97-3261750e0619 req-96836551-081b-4d9d-ae0a-890c064f0a24 tempest-AttachVolumeTestJSON-1467622944 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81', 'name': 'volume-33e3a96c-c195-4cf0-8a23-30e2648374d5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8acc5b37-16d5-4d34-9dcb-df6e21434d3f', 'enforce_multipath': True} {{(pid=86188) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 16 20:24:36 devstack cinder-volume[86188]: INFO cinder.volume.manager [req-4507b331-9522-4243-9c97-3261750e0619 req-96836551-081b-4d9d-ae0a-890c064f0a24 tempest-AttachVolumeTestJSON-1467622944 None] attachment_update completed successfully. Sep 16 20:24:38 devstack cinder-volume[86188]: INFO cinder.volume.manager [req-1aa0fe52-cf87-4dbe-bcf1-26168d584ba2 req-daa62e50-2fe9-45c9-bd70-c78f6480e874 tempest-AttachVolumeTestJSON-1467622944 None] Terminate volume connection completed successfully. Sep 16 20:24:38 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [req-1aa0fe52-cf87-4dbe-bcf1-26168d584ba2 req-daa62e50-2fe9-45c9-bd70-c78f6480e874 tempest-AttachVolumeTestJSON-1467622944 None] Deleting attachment 9d5535f2-ae39-4843-a220-cb12fcc7eb3b. {{(pid=86188) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 16 20:24:40 devstack cinder-volume[86188]: INFO cinder.volume.manager [req-7ee52aa8-cc84-4316-837d-697658c4963a req-dfe5ee53-3419-4c31-a020-7b561ee3a397 tempest-AttachVolumeTestJSON-1467622944 None] Terminate volume connection completed successfully. Sep 16 20:24:40 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [req-7ee52aa8-cc84-4316-837d-697658c4963a req-dfe5ee53-3419-4c31-a020-7b561ee3a397 tempest-AttachVolumeTestJSON-1467622944 None] Deleting attachment 8acc5b37-16d5-4d34-9dcb-df6e21434d3f. {{(pid=86188) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 16 20:24:46 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-bee252a8-12c0-44f1-bd4b-1ef00eed10e2 tempest-AttachVolumeTestJSON-1467622944 None] Acquiring lock "cinder-33e3a96c-c195-4cf0-8a23-30e2648374d5-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:24:46 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-bee252a8-12c0-44f1-bd4b-1ef00eed10e2 tempest-AttachVolumeTestJSON-1467622944 None] Lock "cinder-33e3a96c-c195-4cf0-8a23-30e2648374d5-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:24:46 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-bee252a8-12c0-44f1-bd4b-1ef00eed10e2 tempest-AttachVolumeTestJSON-1467622944 None] Acquiring lock "cinder-quobyte-33e3a96c-c195-4cf0-8a23-30e2648374d5" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:24:46 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-bee252a8-12c0-44f1-bd4b-1ef00eed10e2 tempest-AttachVolumeTestJSON-1467622944 None] Lock "cinder-quobyte-33e3a96c-c195-4cf0-8a23-30e2648374d5" acquired by "delete_volume" :: waited 0.055s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:24:47 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6e48e2c-2eaf-4d6f-ac4b-c52c1b1a50b5]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:24:47 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-bee252a8-12c0-44f1-bd4b-1ef00eed10e2 tempest-AttachVolumeTestJSON-1467622944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-33e3a96c-c195-4cf0-8a23-30e2648374d5 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:24:47 devstack sudo[95643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-33e3a96c-c195-4cf0-8a23-30e2648374d5 Sep 16 20:24:47 devstack sudo[95643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:24:47 devstack sudo[95643]: pam_unix(sudo:session): session closed for user root Sep 16 20:24:47 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-bee252a8-12c0-44f1-bd4b-1ef00eed10e2 tempest-AttachVolumeTestJSON-1467622944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-33e3a96c-c195-4cf0-8a23-30e2648374d5" returned: 0 in 0.518s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:24:47 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-bee252a8-12c0-44f1-bd4b-1ef00eed10e2 tempest-AttachVolumeTestJSON-1467622944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-33e3a96c-c195-4cf0-8a23-30e2648374d5 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:24:47 devstack sudo[95651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-33e3a96c-c195-4cf0-8a23-30e2648374d5 Sep 16 20:24:47 devstack sudo[95651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:24:47 devstack sudo[95651]: pam_unix(sudo:session): session closed for user root Sep 16 20:24:47 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-bee252a8-12c0-44f1-bd4b-1ef00eed10e2 tempest-AttachVolumeTestJSON-1467622944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-33e3a96c-c195-4cf0-8a23-30e2648374d5" returned: 0 in 0.316s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:24:47 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-bee252a8-12c0-44f1-bd4b-1ef00eed10e2 tempest-AttachVolumeTestJSON-1467622944 None] Lock "cinder-quobyte-33e3a96c-c195-4cf0-8a23-30e2648374d5" released by "delete_volume" :: held 0.911s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:24:47 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-bee252a8-12c0-44f1-bd4b-1ef00eed10e2 tempest-AttachVolumeTestJSON-1467622944 None] Created reservations ['3ba5df26-7e26-401e-90a4-a428a9bf0845', '7803576a-4ec8-4c65-9d1c-1dae6273d8fe', 'a9d842a1-1514-46ef-adc0-aac38e4199f9', '87ca65f8-3482-429a-97d2-12385326a10e'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:24:48 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-bee252a8-12c0-44f1-bd4b-1ef00eed10e2 tempest-AttachVolumeTestJSON-1467622944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:24:48 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-bee252a8-12c0-44f1-bd4b-1ef00eed10e2 tempest-AttachVolumeTestJSON-1467622944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:24:48 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-bee252a8-12c0-44f1-bd4b-1ef00eed10e2 tempest-AttachVolumeTestJSON-1467622944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:24:48 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-bee252a8-12c0-44f1-bd4b-1ef00eed10e2 tempest-AttachVolumeTestJSON-1467622944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:24:48 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-bee252a8-12c0-44f1-bd4b-1ef00eed10e2 tempest-AttachVolumeTestJSON-1467622944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:24:48 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-bee252a8-12c0-44f1-bd4b-1ef00eed10e2 tempest-AttachVolumeTestJSON-1467622944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:24:48 devstack sudo[95654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:24:48 devstack sudo[95654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:24:48 devstack sudo[95654]: pam_unix(sudo:session): session closed for user root Sep 16 20:24:48 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-bee252a8-12c0-44f1-bd4b-1ef00eed10e2 tempest-AttachVolumeTestJSON-1467622944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.292s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:24:48 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-bee252a8-12c0-44f1-bd4b-1ef00eed10e2 tempest-AttachVolumeTestJSON-1467622944 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:24:48 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-bee252a8-12c0-44f1-bd4b-1ef00eed10e2 tempest-AttachVolumeTestJSON-1467622944 None] Deleted volume successfully. Sep 16 20:24:48 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-bee252a8-12c0-44f1-bd4b-1ef00eed10e2 tempest-AttachVolumeTestJSON-1467622944 None] Lock "cinder-33e3a96c-c195-4cf0-8a23-30e2648374d5-delete_volume" released by "delete_volume" :: held 1.538s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:24:49 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-a7ebfc94-d25a-4213-877b-0e57cb7a39b3 tempest-AttachVolumeTestJSON-1467622944 None] Acquiring lock "cinder-ab8e718b-2be2-46b0-a4bb-575999d08fec-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:24:49 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-a7ebfc94-d25a-4213-877b-0e57cb7a39b3 tempest-AttachVolumeTestJSON-1467622944 None] Lock "cinder-ab8e718b-2be2-46b0-a4bb-575999d08fec-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:24:49 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-a7ebfc94-d25a-4213-877b-0e57cb7a39b3 tempest-AttachVolumeTestJSON-1467622944 None] Acquiring lock "cinder-quobyte-ab8e718b-2be2-46b0-a4bb-575999d08fec" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:24:49 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-a7ebfc94-d25a-4213-877b-0e57cb7a39b3 tempest-AttachVolumeTestJSON-1467622944 None] Lock "cinder-quobyte-ab8e718b-2be2-46b0-a4bb-575999d08fec" acquired by "delete_volume" :: waited 0.020s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:24:49 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd32d168-9aa3-4985-8990-0fdcf3078cfd]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:24:49 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a7ebfc94-d25a-4213-877b-0e57cb7a39b3 tempest-AttachVolumeTestJSON-1467622944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ab8e718b-2be2-46b0-a4bb-575999d08fec {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:24:49 devstack sudo[95658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ab8e718b-2be2-46b0-a4bb-575999d08fec Sep 16 20:24:49 devstack sudo[95658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:24:49 devstack sudo[95658]: pam_unix(sudo:session): session closed for user root Sep 16 20:24:49 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a7ebfc94-d25a-4213-877b-0e57cb7a39b3 tempest-AttachVolumeTestJSON-1467622944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ab8e718b-2be2-46b0-a4bb-575999d08fec" returned: 0 in 0.436s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:24:49 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a7ebfc94-d25a-4213-877b-0e57cb7a39b3 tempest-AttachVolumeTestJSON-1467622944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ab8e718b-2be2-46b0-a4bb-575999d08fec {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:24:49 devstack sudo[95663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ab8e718b-2be2-46b0-a4bb-575999d08fec Sep 16 20:24:49 devstack sudo[95663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:24:49 devstack sudo[95663]: pam_unix(sudo:session): session closed for user root Sep 16 20:24:49 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a7ebfc94-d25a-4213-877b-0e57cb7a39b3 tempest-AttachVolumeTestJSON-1467622944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ab8e718b-2be2-46b0-a4bb-575999d08fec" returned: 0 in 0.264s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:24:49 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-a7ebfc94-d25a-4213-877b-0e57cb7a39b3 tempest-AttachVolumeTestJSON-1467622944 None] Lock "cinder-quobyte-ab8e718b-2be2-46b0-a4bb-575999d08fec" released by "delete_volume" :: held 0.753s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:24:50 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-a7ebfc94-d25a-4213-877b-0e57cb7a39b3 tempest-AttachVolumeTestJSON-1467622944 None] Created reservations ['e88d3d3d-088e-41cc-a5e6-f1e3965dfc6f', '8bb28e11-d4c8-4fd4-9bdd-6ee087f40f91', 'f1ad110f-3a45-4fd1-bbd1-d507b90c1e6b', '93a10b4f-114c-4f45-a4fa-6c1101b5ddc8'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:24:50 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a7ebfc94-d25a-4213-877b-0e57cb7a39b3 tempest-AttachVolumeTestJSON-1467622944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:24:50 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a7ebfc94-d25a-4213-877b-0e57cb7a39b3 tempest-AttachVolumeTestJSON-1467622944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:24:50 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-a7ebfc94-d25a-4213-877b-0e57cb7a39b3 tempest-AttachVolumeTestJSON-1467622944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:24:50 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-a7ebfc94-d25a-4213-877b-0e57cb7a39b3 tempest-AttachVolumeTestJSON-1467622944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:24:50 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a7ebfc94-d25a-4213-877b-0e57cb7a39b3 tempest-AttachVolumeTestJSON-1467622944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:24:50 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a7ebfc94-d25a-4213-877b-0e57cb7a39b3 tempest-AttachVolumeTestJSON-1467622944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:24:50 devstack sudo[95666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:24:50 devstack sudo[95666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:24:50 devstack sudo[95666]: pam_unix(sudo:session): session closed for user root Sep 16 20:24:50 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a7ebfc94-d25a-4213-877b-0e57cb7a39b3 tempest-AttachVolumeTestJSON-1467622944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.302s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:24:50 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-a7ebfc94-d25a-4213-877b-0e57cb7a39b3 tempest-AttachVolumeTestJSON-1467622944 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:24:50 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-a7ebfc94-d25a-4213-877b-0e57cb7a39b3 tempest-AttachVolumeTestJSON-1467622944 None] Deleted volume successfully. Sep 16 20:24:50 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-a7ebfc94-d25a-4213-877b-0e57cb7a39b3 tempest-AttachVolumeTestJSON-1467622944 None] Lock "cinder-ab8e718b-2be2-46b0-a4bb-575999d08fec-delete_volume" released by "delete_volume" :: held 1.292s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:24:50 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-3ab8fa63-8adb-473c-bb18-b52120ded72b tempest-AttachVolumeTestJSON-1467622944 None] Acquiring lock "cinder-b08c9997-5fb7-46a2-8a70-f69a3c6fc470-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:24:50 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-3ab8fa63-8adb-473c-bb18-b52120ded72b tempest-AttachVolumeTestJSON-1467622944 None] Lock "cinder-b08c9997-5fb7-46a2-8a70-f69a3c6fc470-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:24:50 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-3ab8fa63-8adb-473c-bb18-b52120ded72b tempest-AttachVolumeTestJSON-1467622944 None] Acquiring lock "cinder-quobyte-b08c9997-5fb7-46a2-8a70-f69a3c6fc470" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:24:50 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-3ab8fa63-8adb-473c-bb18-b52120ded72b tempest-AttachVolumeTestJSON-1467622944 None] Lock "cinder-quobyte-b08c9997-5fb7-46a2-8a70-f69a3c6fc470" acquired by "delete_volume" :: waited 0.019s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:24:50 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1e042a2-dc9d-418c-ab50-faea994cbe26]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:24:50 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-3ab8fa63-8adb-473c-bb18-b52120ded72b tempest-AttachVolumeTestJSON-1467622944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b08c9997-5fb7-46a2-8a70-f69a3c6fc470 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:24:50 devstack sudo[95669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b08c9997-5fb7-46a2-8a70-f69a3c6fc470 Sep 16 20:24:50 devstack sudo[95669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:24:51 devstack sudo[95669]: pam_unix(sudo:session): session closed for user root Sep 16 20:24:51 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-3ab8fa63-8adb-473c-bb18-b52120ded72b tempest-AttachVolumeTestJSON-1467622944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b08c9997-5fb7-46a2-8a70-f69a3c6fc470" returned: 0 in 0.465s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:24:51 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-3ab8fa63-8adb-473c-bb18-b52120ded72b tempest-AttachVolumeTestJSON-1467622944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b08c9997-5fb7-46a2-8a70-f69a3c6fc470 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:24:51 devstack sudo[95674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b08c9997-5fb7-46a2-8a70-f69a3c6fc470 Sep 16 20:24:51 devstack sudo[95674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:24:51 devstack sudo[95674]: pam_unix(sudo:session): session closed for user root Sep 16 20:24:51 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-3ab8fa63-8adb-473c-bb18-b52120ded72b tempest-AttachVolumeTestJSON-1467622944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b08c9997-5fb7-46a2-8a70-f69a3c6fc470" returned: 0 in 0.283s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:24:51 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-3ab8fa63-8adb-473c-bb18-b52120ded72b tempest-AttachVolumeTestJSON-1467622944 None] Lock "cinder-quobyte-b08c9997-5fb7-46a2-8a70-f69a3c6fc470" released by "delete_volume" :: held 0.803s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:24:51 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-3ab8fa63-8adb-473c-bb18-b52120ded72b tempest-AttachVolumeTestJSON-1467622944 None] Created reservations ['8e35abfd-a786-4abc-8ed5-ddf020ae782f', 'acd9d5a1-283f-432e-9937-389b0c9984ca', '5bc2a3d1-b9ee-427d-aa08-84efa7f1c409', 'c61a15df-0923-44d5-953b-60717b074ca5'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:24:51 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-3ab8fa63-8adb-473c-bb18-b52120ded72b tempest-AttachVolumeTestJSON-1467622944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:24:51 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-3ab8fa63-8adb-473c-bb18-b52120ded72b tempest-AttachVolumeTestJSON-1467622944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:24:51 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-3ab8fa63-8adb-473c-bb18-b52120ded72b tempest-AttachVolumeTestJSON-1467622944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:24:51 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-3ab8fa63-8adb-473c-bb18-b52120ded72b tempest-AttachVolumeTestJSON-1467622944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:24:51 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-3ab8fa63-8adb-473c-bb18-b52120ded72b tempest-AttachVolumeTestJSON-1467622944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:24:51 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-3ab8fa63-8adb-473c-bb18-b52120ded72b tempest-AttachVolumeTestJSON-1467622944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:24:51 devstack sudo[95677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:24:51 devstack sudo[95677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:24:51 devstack sudo[95677]: pam_unix(sudo:session): session closed for user root Sep 16 20:24:51 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-3ab8fa63-8adb-473c-bb18-b52120ded72b tempest-AttachVolumeTestJSON-1467622944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.328s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:24:51 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-3ab8fa63-8adb-473c-bb18-b52120ded72b tempest-AttachVolumeTestJSON-1467622944 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:24:51 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-3ab8fa63-8adb-473c-bb18-b52120ded72b tempest-AttachVolumeTestJSON-1467622944 None] Deleted volume successfully. Sep 16 20:24:51 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-3ab8fa63-8adb-473c-bb18-b52120ded72b tempest-AttachVolumeTestJSON-1467622944 None] Lock "cinder-b08c9997-5fb7-46a2-8a70-f69a3c6fc470-delete_volume" released by "delete_volume" :: held 1.379s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:24:52 devstack cinder-volume[86188]: DEBUG oslo_service.periodic_task [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86188) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 20:24:52 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:24:52 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:24:52 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:24:53 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:24:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:24:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:24:53 devstack sudo[95680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:24:53 devstack sudo[95680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:24:53 devstack sudo[95680]: pam_unix(sudo:session): session closed for user root Sep 16 20:24:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.384s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:24:53 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:24:53 devstack cinder-volume[86188]: DEBUG oslo_service.periodic_task [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Running periodic task VolumeManager._thread_info {{(pid=86188) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 20:24:53 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] thread count: 28 {{(pid=86188) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 16 20:24:53 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] thread info: [<_MainThread(MainThread, started 139858124406912)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86188) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 16 20:25:01 devstack cinder-volume[86188]: DEBUG dbcounter [-] [86188] Writing DB stats cinder:UPDATE=36,cinder:SELECT=33,cinder:DELETE=2,cinder:INSERT=7 {{(pid=86188) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 20:25:01 devstack cinder-volume[86188]: DEBUG dbcounter [-] [86188] Writing DB stats cinder:SELECT=34,cinder:INSERT=7,cinder:UPDATE=29,cinder:DELETE=3 {{(pid=86188) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 20:25:04 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ebe287e-4184-4638-b919-a236114ed1f9 tempest-VolumeRetypeWithoutMigrationTest-1424986236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:25:04 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-5ebe287e-4184-4638-b919-a236114ed1f9 tempest-VolumeRetypeWithoutMigrationTest-1424986236 None] Flow 'volume_create_manager' (69966704-ef47-4f45-9e2c-f6743a59ab4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:25:04 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-5ebe287e-4184-4638-b919-a236114ed1f9 tempest-VolumeRetypeWithoutMigrationTest-1424986236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f291503d-b7f6-462a-ad1e-57c6ec2023cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:25:04 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-5ebe287e-4184-4638-b919-a236114ed1f9 tempest-VolumeRetypeWithoutMigrationTest-1424986236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f291503d-b7f6-462a-ad1e-57c6ec2023cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:25:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1073509658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8dff9c8-6710-42d3-ab7d-9a5069749e38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be51c82789ed4ee892ec1128955ccc6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:25:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:25:04Z,use_quota=True,user_id='c565b8f60ca34587b664c3c9203c3375',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(108d05fe-52dd-4956-90e8-5cbd800e62f4),volume_type_id=108d05fe-52dd-4956-90e8-5cbd800e62f4)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:25:04 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-5ebe287e-4184-4638-b919-a236114ed1f9 tempest-VolumeRetypeWithoutMigrationTest-1424986236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ac490a0-f868-4083-960d-5734314f1e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:25:04 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-5ebe287e-4184-4638-b919-a236114ed1f9 tempest-VolumeRetypeWithoutMigrationTest-1424986236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ac490a0-f868-4083-960d-5734314f1e09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:25:04 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-5ebe287e-4184-4638-b919-a236114ed1f9 tempest-VolumeRetypeWithoutMigrationTest-1424986236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d41969e0-0cba-410a-9a66-2572bc343567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:25:04 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-5ebe287e-4184-4638-b919-a236114ed1f9 tempest-VolumeRetypeWithoutMigrationTest-1424986236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d41969e0-0cba-410a-9a66-2572bc343567) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8dff9c8-6710-42d3-ab7d-9a5069749e38', 'volume_name': 'volume-e8dff9c8-6710-42d3-ab7d-9a5069749e38', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:25:04 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-5ebe287e-4184-4638-b919-a236114ed1f9 tempest-VolumeRetypeWithoutMigrationTest-1424986236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ec24598-6cf5-47ed-84df-f73d9102953d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:25:04 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-5ebe287e-4184-4638-b919-a236114ed1f9 tempest-VolumeRetypeWithoutMigrationTest-1424986236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ec24598-6cf5-47ed-84df-f73d9102953d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:25:04 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-5ebe287e-4184-4638-b919-a236114ed1f9 tempest-VolumeRetypeWithoutMigrationTest-1424986236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9f7cbc8-c96d-4dc5-9647-2642bb9115da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:25:04 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-5ebe287e-4184-4638-b919-a236114ed1f9 tempest-VolumeRetypeWithoutMigrationTest-1424986236 None] Volume e8dff9c8-6710-42d3-ab7d-9a5069749e38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8dff9c8-6710-42d3-ab7d-9a5069749e38', 'volume_size': 1} Sep 16 20:25:04 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-5ebe287e-4184-4638-b919-a236114ed1f9 tempest-VolumeRetypeWithoutMigrationTest-1424986236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:25:04 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-5ebe287e-4184-4638-b919-a236114ed1f9 tempest-VolumeRetypeWithoutMigrationTest-1424986236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:25:04 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-5ebe287e-4184-4638-b919-a236114ed1f9 tempest-VolumeRetypeWithoutMigrationTest-1424986236 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:25:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1073509658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8dff9c8-6710-42d3-ab7d-9a5069749e38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be51c82789ed4ee892ec1128955ccc6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:25:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:25:04Z,use_quota=True,user_id='c565b8f60ca34587b664c3c9203c3375',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(108d05fe-52dd-4956-90e8-5cbd800e62f4),volume_type_id=108d05fe-52dd-4956-90e8-5cbd800e62f4)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:25:04 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-5ebe287e-4184-4638-b919-a236114ed1f9 tempest-VolumeRetypeWithoutMigrationTest-1424986236 None] Creating volume e8dff9c8-6710-42d3-ab7d-9a5069749e38 {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:25:04 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-5ebe287e-4184-4638-b919-a236114ed1f9 tempest-VolumeRetypeWithoutMigrationTest-1424986236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:25:04 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-5ebe287e-4184-4638-b919-a236114ed1f9 tempest-VolumeRetypeWithoutMigrationTest-1424986236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:25:04 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-5ebe287e-4184-4638-b919-a236114ed1f9 tempest-VolumeRetypeWithoutMigrationTest-1424986236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:25:04 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-5ebe287e-4184-4638-b919-a236114ed1f9 tempest-VolumeRetypeWithoutMigrationTest-1424986236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:25:04 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-5ebe287e-4184-4638-b919-a236114ed1f9 tempest-VolumeRetypeWithoutMigrationTest-1424986236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:25:04 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-5ebe287e-4184-4638-b919-a236114ed1f9 tempest-VolumeRetypeWithoutMigrationTest-1424986236 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:25:04 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-5ebe287e-4184-4638-b919-a236114ed1f9 tempest-VolumeRetypeWithoutMigrationTest-1424986236 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:25:04 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-5ebe287e-4184-4638-b919-a236114ed1f9 tempest-VolumeRetypeWithoutMigrationTest-1424986236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e8dff9c8-6710-42d3-ab7d-9a5069749e38 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:25:04 devstack sudo[96091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e8dff9c8-6710-42d3-ab7d-9a5069749e38 1073741824 Sep 16 20:25:04 devstack sudo[96091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:25:05 devstack sudo[96091]: pam_unix(sudo:session): session closed for user root Sep 16 20:25:05 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-5ebe287e-4184-4638-b919-a236114ed1f9 tempest-VolumeRetypeWithoutMigrationTest-1424986236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e8dff9c8-6710-42d3-ab7d-9a5069749e38 1073741824" returned: 0 in 1.001s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:25:05 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-5ebe287e-4184-4638-b919-a236114ed1f9 tempest-VolumeRetypeWithoutMigrationTest-1424986236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e8dff9c8-6710-42d3-ab7d-9a5069749e38 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:25:05 devstack sudo[96098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e8dff9c8-6710-42d3-ab7d-9a5069749e38 Sep 16 20:25:05 devstack sudo[96098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:25:05 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-a79a85e0-3dfd-4e21-877b-3f0791094f10 tempest-AttachVolumeShelveTestJSON-649703128 None] Acquiring lock "cinder-02ec95b7-2155-4b2a-8392-ce83dd4b78d7-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:25:05 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-a79a85e0-3dfd-4e21-877b-3f0791094f10 tempest-AttachVolumeShelveTestJSON-649703128 None] Lock "cinder-02ec95b7-2155-4b2a-8392-ce83dd4b78d7-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:25:06 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-a79a85e0-3dfd-4e21-877b-3f0791094f10 tempest-AttachVolumeShelveTestJSON-649703128 None] Acquiring lock "cinder-quobyte-02ec95b7-2155-4b2a-8392-ce83dd4b78d7" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:25:06 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-a79a85e0-3dfd-4e21-877b-3f0791094f10 tempest-AttachVolumeShelveTestJSON-649703128 None] Lock "cinder-quobyte-02ec95b7-2155-4b2a-8392-ce83dd4b78d7" acquired by "delete_volume" :: waited 0.020s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:25:06 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0d81a7a-7430-457b-93b7-5c93ef1017a6]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:25:06 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a79a85e0-3dfd-4e21-877b-3f0791094f10 tempest-AttachVolumeShelveTestJSON-649703128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-02ec95b7-2155-4b2a-8392-ce83dd4b78d7 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:25:06 devstack sudo[96098]: pam_unix(sudo:session): session closed for user root Sep 16 20:25:06 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-5ebe287e-4184-4638-b919-a236114ed1f9 tempest-VolumeRetypeWithoutMigrationTest-1424986236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e8dff9c8-6710-42d3-ab7d-9a5069749e38" returned: 0 in 0.520s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:25:06 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-5ebe287e-4184-4638-b919-a236114ed1f9 tempest-VolumeRetypeWithoutMigrationTest-1424986236 None] <== create_volume: return (1621ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:25:06 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-5ebe287e-4184-4638-b919-a236114ed1f9 tempest-VolumeRetypeWithoutMigrationTest-1424986236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.626s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:25:06 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-5ebe287e-4184-4638-b919-a236114ed1f9 tempest-VolumeRetypeWithoutMigrationTest-1424986236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9f7cbc8-c96d-4dc5-9647-2642bb9115da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8dff9c8-6710-42d3-ab7d-9a5069749e38', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:25:06 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-5ebe287e-4184-4638-b919-a236114ed1f9 tempest-VolumeRetypeWithoutMigrationTest-1424986236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4df5d791-8de2-4d99-b38d-5559ce96e4e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:25:06 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-5ebe287e-4184-4638-b919-a236114ed1f9 tempest-VolumeRetypeWithoutMigrationTest-1424986236 None] Volume volume-e8dff9c8-6710-42d3-ab7d-9a5069749e38 (e8dff9c8-6710-42d3-ab7d-9a5069749e38): created successfully Sep 16 20:25:06 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-5ebe287e-4184-4638-b919-a236114ed1f9 tempest-VolumeRetypeWithoutMigrationTest-1424986236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4df5d791-8de2-4d99-b38d-5559ce96e4e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:25:06 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-5ebe287e-4184-4638-b919-a236114ed1f9 tempest-VolumeRetypeWithoutMigrationTest-1424986236 None] Flow 'volume_create_manager' (69966704-ef47-4f45-9e2c-f6743a59ab4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:25:06 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a6f67e2d-fedc-42fe-bfd7-ec0ea1dd04d7 tempest-BackendsCapabilitiesAdminTestsJSON-498665025 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.861484527588, 'free_capacity_gb': 1775.861484527588, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86188) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 16 20:25:06 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-5ebe287e-4184-4638-b919-a236114ed1f9 tempest-VolumeRetypeWithoutMigrationTest-1424986236 None] Created volume successfully. Sep 16 20:25:06 devstack sudo[96105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-02ec95b7-2155-4b2a-8392-ce83dd4b78d7 Sep 16 20:25:06 devstack sudo[96105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:25:06 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-2190c7b2-a9ec-4ad2-9a09-08145db12408 tempest-BackendsCapabilitiesAdminTestsJSON-498665025 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.861484527588, 'free_capacity_gb': 1775.861484527588, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86188) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 16 20:25:06 devstack sudo[96105]: pam_unix(sudo:session): session closed for user root Sep 16 20:25:06 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a79a85e0-3dfd-4e21-877b-3f0791094f10 tempest-AttachVolumeShelveTestJSON-649703128 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-02ec95b7-2155-4b2a-8392-ce83dd4b78d7" returned: 0 in 0.524s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:25:06 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a79a85e0-3dfd-4e21-877b-3f0791094f10 tempest-AttachVolumeShelveTestJSON-649703128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-02ec95b7-2155-4b2a-8392-ce83dd4b78d7 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:25:06 devstack sudo[96120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-02ec95b7-2155-4b2a-8392-ce83dd4b78d7 Sep 16 20:25:06 devstack sudo[96120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:25:07 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-c58f86e1-640d-4317-a431-06dfc8fb512c tempest-VolumeRetypeWithoutMigrationTest-1424986236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:25:07 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-c58f86e1-640d-4317-a431-06dfc8fb512c tempest-VolumeRetypeWithoutMigrationTest-1424986236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:25:07 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-c58f86e1-640d-4317-a431-06dfc8fb512c tempest-VolumeRetypeWithoutMigrationTest-1424986236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:25:07 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-c58f86e1-640d-4317-a431-06dfc8fb512c tempest-VolumeRetypeWithoutMigrationTest-1424986236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:25:07 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-c58f86e1-640d-4317-a431-06dfc8fb512c tempest-VolumeRetypeWithoutMigrationTest-1424986236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:25:07 devstack sudo[96120]: pam_unix(sudo:session): session closed for user root Sep 16 20:25:07 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-c58f86e1-640d-4317-a431-06dfc8fb512c tempest-VolumeRetypeWithoutMigrationTest-1424986236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:25:07 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a79a85e0-3dfd-4e21-877b-3f0791094f10 tempest-AttachVolumeShelveTestJSON-649703128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-02ec95b7-2155-4b2a-8392-ce83dd4b78d7" returned: 0 in 0.582s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:25:07 devstack sudo[96137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:25:07 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-a79a85e0-3dfd-4e21-877b-3f0791094f10 tempest-AttachVolumeShelveTestJSON-649703128 None] Lock "cinder-quobyte-02ec95b7-2155-4b2a-8392-ce83dd4b78d7" released by "delete_volume" :: held 1.192s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:25:07 devstack sudo[96137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:25:07 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-a79a85e0-3dfd-4e21-877b-3f0791094f10 tempest-AttachVolumeShelveTestJSON-649703128 None] Created reservations ['f82cd366-288a-49be-b31d-91645c983741', '49fdce27-5c47-4026-b7aa-a8863b58a0c9', '383fa2eb-4e15-41b0-aed8-895d8e058e2e', '29ffa7df-0b82-4ddf-adce-53e5cc0566f0'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:25:07 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a79a85e0-3dfd-4e21-877b-3f0791094f10 tempest-AttachVolumeShelveTestJSON-649703128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:25:07 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a79a85e0-3dfd-4e21-877b-3f0791094f10 tempest-AttachVolumeShelveTestJSON-649703128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:25:07 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-a79a85e0-3dfd-4e21-877b-3f0791094f10 tempest-AttachVolumeShelveTestJSON-649703128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:25:07 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-a79a85e0-3dfd-4e21-877b-3f0791094f10 tempest-AttachVolumeShelveTestJSON-649703128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:25:07 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a79a85e0-3dfd-4e21-877b-3f0791094f10 tempest-AttachVolumeShelveTestJSON-649703128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:25:07 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a79a85e0-3dfd-4e21-877b-3f0791094f10 tempest-AttachVolumeShelveTestJSON-649703128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:25:07 devstack sudo[96144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:25:07 devstack sudo[96144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:25:07 devstack sudo[96137]: pam_unix(sudo:session): session closed for user root Sep 16 20:25:07 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-c58f86e1-640d-4317-a431-06dfc8fb512c tempest-VolumeRetypeWithoutMigrationTest-1424986236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.441s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:25:07 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-c58f86e1-640d-4317-a431-06dfc8fb512c tempest-VolumeRetypeWithoutMigrationTest-1424986236 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:25:07 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-c58f86e1-640d-4317-a431-06dfc8fb512c tempest-VolumeRetypeWithoutMigrationTest-1424986236 None] Retype volume completed successfully. Sep 16 20:25:07 devstack sudo[96144]: pam_unix(sudo:session): session closed for user root Sep 16 20:25:07 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a79a85e0-3dfd-4e21-877b-3f0791094f10 tempest-AttachVolumeShelveTestJSON-649703128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.307s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:25:07 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-a79a85e0-3dfd-4e21-877b-3f0791094f10 tempest-AttachVolumeShelveTestJSON-649703128 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:25:07 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-a79a85e0-3dfd-4e21-877b-3f0791094f10 tempest-AttachVolumeShelveTestJSON-649703128 None] Deleted volume successfully. Sep 16 20:25:07 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-a79a85e0-3dfd-4e21-877b-3f0791094f10 tempest-AttachVolumeShelveTestJSON-649703128 None] Lock "cinder-02ec95b7-2155-4b2a-8392-ce83dd4b78d7-delete_volume" released by "delete_volume" :: held 1.907s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:25:08 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-5ac4919f-7967-44fc-b274-00d40a36ab0b tempest-VolumeRetypeWithoutMigrationTest-1424986236 None] Acquiring lock "cinder-e8dff9c8-6710-42d3-ab7d-9a5069749e38-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:25:08 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-5ac4919f-7967-44fc-b274-00d40a36ab0b tempest-VolumeRetypeWithoutMigrationTest-1424986236 None] Lock "cinder-e8dff9c8-6710-42d3-ab7d-9a5069749e38-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:25:08 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-5ac4919f-7967-44fc-b274-00d40a36ab0b tempest-VolumeRetypeWithoutMigrationTest-1424986236 None] Acquiring lock "cinder-quobyte-e8dff9c8-6710-42d3-ab7d-9a5069749e38" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:25:08 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-5ac4919f-7967-44fc-b274-00d40a36ab0b tempest-VolumeRetypeWithoutMigrationTest-1424986236 None] Lock "cinder-quobyte-e8dff9c8-6710-42d3-ab7d-9a5069749e38" acquired by "delete_volume" :: waited 0.026s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:25:08 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[95aae362-1e37-4edf-ab03-58598b5b5dd0]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:25:08 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-5ac4919f-7967-44fc-b274-00d40a36ab0b tempest-VolumeRetypeWithoutMigrationTest-1424986236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e8dff9c8-6710-42d3-ab7d-9a5069749e38 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:25:08 devstack sudo[96164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e8dff9c8-6710-42d3-ab7d-9a5069749e38 Sep 16 20:25:08 devstack sudo[96164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:25:09 devstack sudo[96164]: pam_unix(sudo:session): session closed for user root Sep 16 20:25:09 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-5ac4919f-7967-44fc-b274-00d40a36ab0b tempest-VolumeRetypeWithoutMigrationTest-1424986236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e8dff9c8-6710-42d3-ab7d-9a5069749e38" returned: 0 in 0.589s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:25:09 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-5ac4919f-7967-44fc-b274-00d40a36ab0b tempest-VolumeRetypeWithoutMigrationTest-1424986236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e8dff9c8-6710-42d3-ab7d-9a5069749e38 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:25:09 devstack sudo[96212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e8dff9c8-6710-42d3-ab7d-9a5069749e38 Sep 16 20:25:09 devstack sudo[96212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:25:09 devstack sudo[96212]: pam_unix(sudo:session): session closed for user root Sep 16 20:25:09 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-5ac4919f-7967-44fc-b274-00d40a36ab0b tempest-VolumeRetypeWithoutMigrationTest-1424986236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e8dff9c8-6710-42d3-ab7d-9a5069749e38" returned: 0 in 0.475s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:25:09 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-5ac4919f-7967-44fc-b274-00d40a36ab0b tempest-VolumeRetypeWithoutMigrationTest-1424986236 None] Lock "cinder-quobyte-e8dff9c8-6710-42d3-ab7d-9a5069749e38" released by "delete_volume" :: held 1.145s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:25:09 devstack cinder-volume[86188]: WARNING cinder.quota [None req-5ac4919f-7967-44fc-b274-00d40a36ab0b tempest-VolumeRetypeWithoutMigrationTest-1424986236 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 16 20:25:09 devstack cinder-volume[86188]: WARNING cinder.quota [None req-5ac4919f-7967-44fc-b274-00d40a36ab0b tempest-VolumeRetypeWithoutMigrationTest-1424986236 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 16 20:25:09 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-5ac4919f-7967-44fc-b274-00d40a36ab0b tempest-VolumeRetypeWithoutMigrationTest-1424986236 None] Created reservations ['b49eef71-be8c-4767-a9ac-0f79a23a5a0a', 'e458ba62-151e-436c-87bb-e951c5a0a46a', 'ffe52b29-4faa-4dc5-b018-ca059fb2b18d', '783559cc-f4b2-42cc-b0e6-54fc519e1b45'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:25:10 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-5ac4919f-7967-44fc-b274-00d40a36ab0b tempest-VolumeRetypeWithoutMigrationTest-1424986236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:25:10 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-5ac4919f-7967-44fc-b274-00d40a36ab0b tempest-VolumeRetypeWithoutMigrationTest-1424986236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:25:10 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-5ac4919f-7967-44fc-b274-00d40a36ab0b tempest-VolumeRetypeWithoutMigrationTest-1424986236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:25:10 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-5ac4919f-7967-44fc-b274-00d40a36ab0b tempest-VolumeRetypeWithoutMigrationTest-1424986236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:25:10 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-5ac4919f-7967-44fc-b274-00d40a36ab0b tempest-VolumeRetypeWithoutMigrationTest-1424986236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:25:10 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-5ac4919f-7967-44fc-b274-00d40a36ab0b tempest-VolumeRetypeWithoutMigrationTest-1424986236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:25:10 devstack sudo[96222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:25:10 devstack sudo[96222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:25:10 devstack sudo[96222]: pam_unix(sudo:session): session closed for user root Sep 16 20:25:10 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-5ac4919f-7967-44fc-b274-00d40a36ab0b tempest-VolumeRetypeWithoutMigrationTest-1424986236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.420s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:25:10 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-5ac4919f-7967-44fc-b274-00d40a36ab0b tempest-VolumeRetypeWithoutMigrationTest-1424986236 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:25:10 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-5ac4919f-7967-44fc-b274-00d40a36ab0b tempest-VolumeRetypeWithoutMigrationTest-1424986236 None] Deleted volume successfully. Sep 16 20:25:10 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-5ac4919f-7967-44fc-b274-00d40a36ab0b tempest-VolumeRetypeWithoutMigrationTest-1424986236 None] Lock "cinder-e8dff9c8-6710-42d3-ab7d-9a5069749e38-delete_volume" released by "delete_volume" :: held 2.117s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:25:15 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-54cbf414-0cde-405c-abc2-11a669dfa811 tempest-TestMinimumBasicScenario-2081577986 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:25:15 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-54cbf414-0cde-405c-abc2-11a669dfa811 tempest-TestMinimumBasicScenario-2081577986 None] Flow 'volume_create_manager' (cac73361-010a-44e0-b8af-37ed989419ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:25:15 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-54cbf414-0cde-405c-abc2-11a669dfa811 tempest-TestMinimumBasicScenario-2081577986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebe9d99f-e337-41ac-8a48-94c9a57e4938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:25:15 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-54cbf414-0cde-405c-abc2-11a669dfa811 tempest-TestMinimumBasicScenario-2081577986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebe9d99f-e337-41ac-8a48-94c9a57e4938) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:25:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-149044693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=800c5efe-2db9-4ccf-ac6a-b9915008b32c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4e2c1ec4b8942ada77de5b28ec7b34b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:25:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:25:16Z,use_quota=True,user_id='d709aef5bc6245a0a58dd675cacdf124',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:25:15 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-54cbf414-0cde-405c-abc2-11a669dfa811 tempest-TestMinimumBasicScenario-2081577986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d44d215-80ff-43c5-bca7-4368929ce11a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:25:15 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-54cbf414-0cde-405c-abc2-11a669dfa811 tempest-TestMinimumBasicScenario-2081577986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d44d215-80ff-43c5-bca7-4368929ce11a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:25:15 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-54cbf414-0cde-405c-abc2-11a669dfa811 tempest-TestMinimumBasicScenario-2081577986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac572c0d-76bf-4c0f-bb3f-fa1e3be578be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:25:15 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-54cbf414-0cde-405c-abc2-11a669dfa811 tempest-TestMinimumBasicScenario-2081577986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac572c0d-76bf-4c0f-bb3f-fa1e3be578be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '800c5efe-2db9-4ccf-ac6a-b9915008b32c', 'volume_name': 'volume-800c5efe-2db9-4ccf-ac6a-b9915008b32c', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:25:15 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-54cbf414-0cde-405c-abc2-11a669dfa811 tempest-TestMinimumBasicScenario-2081577986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0359e2b-31a5-4f7e-bc0e-ec8c53d7dd73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:25:15 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-54cbf414-0cde-405c-abc2-11a669dfa811 tempest-TestMinimumBasicScenario-2081577986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0359e2b-31a5-4f7e-bc0e-ec8c53d7dd73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:25:15 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-54cbf414-0cde-405c-abc2-11a669dfa811 tempest-TestMinimumBasicScenario-2081577986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bf6bb6e-fbae-494c-a688-7a6e0df71718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:25:15 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-54cbf414-0cde-405c-abc2-11a669dfa811 tempest-TestMinimumBasicScenario-2081577986 None] Volume 800c5efe-2db9-4ccf-ac6a-b9915008b32c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-800c5efe-2db9-4ccf-ac6a-b9915008b32c', 'volume_size': 1} Sep 16 20:25:15 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-54cbf414-0cde-405c-abc2-11a669dfa811 tempest-TestMinimumBasicScenario-2081577986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:25:15 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-54cbf414-0cde-405c-abc2-11a669dfa811 tempest-TestMinimumBasicScenario-2081577986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:25:15 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-54cbf414-0cde-405c-abc2-11a669dfa811 tempest-TestMinimumBasicScenario-2081577986 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:25:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-149044693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=800c5efe-2db9-4ccf-ac6a-b9915008b32c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4e2c1ec4b8942ada77de5b28ec7b34b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:25:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:25:16Z,use_quota=True,user_id='d709aef5bc6245a0a58dd675cacdf124',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:25:15 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-54cbf414-0cde-405c-abc2-11a669dfa811 tempest-TestMinimumBasicScenario-2081577986 None] Creating volume 800c5efe-2db9-4ccf-ac6a-b9915008b32c {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:25:15 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-54cbf414-0cde-405c-abc2-11a669dfa811 tempest-TestMinimumBasicScenario-2081577986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:25:15 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-54cbf414-0cde-405c-abc2-11a669dfa811 tempest-TestMinimumBasicScenario-2081577986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:25:15 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-54cbf414-0cde-405c-abc2-11a669dfa811 tempest-TestMinimumBasicScenario-2081577986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:25:15 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-54cbf414-0cde-405c-abc2-11a669dfa811 tempest-TestMinimumBasicScenario-2081577986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:25:15 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-54cbf414-0cde-405c-abc2-11a669dfa811 tempest-TestMinimumBasicScenario-2081577986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:25:15 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-54cbf414-0cde-405c-abc2-11a669dfa811 tempest-TestMinimumBasicScenario-2081577986 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:25:15 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-54cbf414-0cde-405c-abc2-11a669dfa811 tempest-TestMinimumBasicScenario-2081577986 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:25:15 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-54cbf414-0cde-405c-abc2-11a669dfa811 tempest-TestMinimumBasicScenario-2081577986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-800c5efe-2db9-4ccf-ac6a-b9915008b32c 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:25:15 devstack sudo[96230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-800c5efe-2db9-4ccf-ac6a-b9915008b32c 1073741824 Sep 16 20:25:15 devstack sudo[96230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:25:16 devstack sudo[96230]: pam_unix(sudo:session): session closed for user root Sep 16 20:25:16 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-54cbf414-0cde-405c-abc2-11a669dfa811 tempest-TestMinimumBasicScenario-2081577986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-800c5efe-2db9-4ccf-ac6a-b9915008b32c 1073741824" returned: 0 in 0.868s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:25:16 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-54cbf414-0cde-405c-abc2-11a669dfa811 tempest-TestMinimumBasicScenario-2081577986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-800c5efe-2db9-4ccf-ac6a-b9915008b32c {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:25:16 devstack sudo[96236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-800c5efe-2db9-4ccf-ac6a-b9915008b32c Sep 16 20:25:16 devstack sudo[96236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:25:17 devstack sudo[96236]: pam_unix(sudo:session): session closed for user root Sep 16 20:25:17 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-54cbf414-0cde-405c-abc2-11a669dfa811 tempest-TestMinimumBasicScenario-2081577986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-800c5efe-2db9-4ccf-ac6a-b9915008b32c" returned: 0 in 0.441s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:25:17 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-54cbf414-0cde-405c-abc2-11a669dfa811 tempest-TestMinimumBasicScenario-2081577986 None] <== create_volume: return (1385ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:25:17 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-54cbf414-0cde-405c-abc2-11a669dfa811 tempest-TestMinimumBasicScenario-2081577986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.387s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:25:17 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-54cbf414-0cde-405c-abc2-11a669dfa811 tempest-TestMinimumBasicScenario-2081577986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bf6bb6e-fbae-494c-a688-7a6e0df71718) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-800c5efe-2db9-4ccf-ac6a-b9915008b32c', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:25:17 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-54cbf414-0cde-405c-abc2-11a669dfa811 tempest-TestMinimumBasicScenario-2081577986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89762804-9ca9-4ac6-97df-e0f1643dbedc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:25:17 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-54cbf414-0cde-405c-abc2-11a669dfa811 tempest-TestMinimumBasicScenario-2081577986 None] Volume volume-800c5efe-2db9-4ccf-ac6a-b9915008b32c (800c5efe-2db9-4ccf-ac6a-b9915008b32c): created successfully Sep 16 20:25:17 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-54cbf414-0cde-405c-abc2-11a669dfa811 tempest-TestMinimumBasicScenario-2081577986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89762804-9ca9-4ac6-97df-e0f1643dbedc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:25:17 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-54cbf414-0cde-405c-abc2-11a669dfa811 tempest-TestMinimumBasicScenario-2081577986 None] Flow 'volume_create_manager' (cac73361-010a-44e0-b8af-37ed989419ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:25:17 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-54cbf414-0cde-405c-abc2-11a669dfa811 tempest-TestMinimumBasicScenario-2081577986 None] Created volume successfully. Sep 16 20:25:19 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [req-1a40df61-e19d-4792-a7c2-a3a600fc374a req-61241c82-b8de-48e9-96b0-05224ed7c4e3 tempest-TestMinimumBasicScenario-2081577986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:25:19 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [req-1a40df61-e19d-4792-a7c2-a3a600fc374a req-61241c82-b8de-48e9-96b0-05224ed7c4e3 tempest-TestMinimumBasicScenario-2081577986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:25:19 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [req-1a40df61-e19d-4792-a7c2-a3a600fc374a req-61241c82-b8de-48e9-96b0-05224ed7c4e3 tempest-TestMinimumBasicScenario-2081577986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:25:19 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [req-1a40df61-e19d-4792-a7c2-a3a600fc374a req-61241c82-b8de-48e9-96b0-05224ed7c4e3 tempest-TestMinimumBasicScenario-2081577986 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81', 'name': 'volume-800c5efe-2db9-4ccf-ac6a-b9915008b32c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9e29f127-5cf4-48aa-aca7-00c5698ac693', 'enforce_multipath': True} {{(pid=86188) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 16 20:25:19 devstack cinder-volume[86188]: INFO cinder.volume.manager [req-1a40df61-e19d-4792-a7c2-a3a600fc374a req-61241c82-b8de-48e9-96b0-05224ed7c4e3 tempest-TestMinimumBasicScenario-2081577986 None] attachment_update completed successfully. Sep 16 20:25:22 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [req-8a035078-ef08-4788-b386-13ba52fb412e req-51c025f8-27cf-41df-b5d1-cc0af4d983ef tempest-VolumesSnapshotsTestJSON-2081265657 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:25:22 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [req-8a035078-ef08-4788-b386-13ba52fb412e req-51c025f8-27cf-41df-b5d1-cc0af4d983ef tempest-VolumesSnapshotsTestJSON-2081265657 None] Flow 'volume_create_manager' (61e7cc38-b395-4318-a1e3-ec6bd34b3356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:25:22 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [req-8a035078-ef08-4788-b386-13ba52fb412e req-51c025f8-27cf-41df-b5d1-cc0af4d983ef tempest-VolumesSnapshotsTestJSON-2081265657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7b0cad5-7b72-401b-a80a-188acc1ee8eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:25:22 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [req-8a035078-ef08-4788-b386-13ba52fb412e req-51c025f8-27cf-41df-b5d1-cc0af4d983ef tempest-VolumesSnapshotsTestJSON-2081265657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7b0cad5-7b72-401b-a80a-188acc1ee8eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:25:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-747867748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e19091c-df65-4785-a202-695b45cd4574,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='651399ad7aba4e358bfd33c1a0ddd6e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:25:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:25:23Z,use_quota=True,user_id='48b09ef45c604dfc9de518443f430aaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:25:22 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [req-8a035078-ef08-4788-b386-13ba52fb412e req-51c025f8-27cf-41df-b5d1-cc0af4d983ef tempest-VolumesSnapshotsTestJSON-2081265657 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e2f6e24-9900-4f1a-8a49-9e1ffe40c5a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:25:22 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [req-8a035078-ef08-4788-b386-13ba52fb412e req-51c025f8-27cf-41df-b5d1-cc0af4d983ef tempest-VolumesSnapshotsTestJSON-2081265657 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e2f6e24-9900-4f1a-8a49-9e1ffe40c5a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:25:22 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [req-8a035078-ef08-4788-b386-13ba52fb412e req-51c025f8-27cf-41df-b5d1-cc0af4d983ef tempest-VolumesSnapshotsTestJSON-2081265657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee5ff553-f70e-49c7-8239-b92b7555f398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:25:22 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [req-8a035078-ef08-4788-b386-13ba52fb412e req-51c025f8-27cf-41df-b5d1-cc0af4d983ef tempest-VolumesSnapshotsTestJSON-2081265657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee5ff553-f70e-49c7-8239-b92b7555f398) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e19091c-df65-4785-a202-695b45cd4574', 'volume_name': 'volume-7e19091c-df65-4785-a202-695b45cd4574', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:25:22 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [req-8a035078-ef08-4788-b386-13ba52fb412e req-51c025f8-27cf-41df-b5d1-cc0af4d983ef tempest-VolumesSnapshotsTestJSON-2081265657 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1743d836-bad1-430b-b622-b9d2c5b94748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:25:22 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [req-8a035078-ef08-4788-b386-13ba52fb412e req-51c025f8-27cf-41df-b5d1-cc0af4d983ef tempest-VolumesSnapshotsTestJSON-2081265657 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1743d836-bad1-430b-b622-b9d2c5b94748) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:25:22 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [req-8a035078-ef08-4788-b386-13ba52fb412e req-51c025f8-27cf-41df-b5d1-cc0af4d983ef tempest-VolumesSnapshotsTestJSON-2081265657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8f394f1-1860-424c-bfba-c523b341e0fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:25:22 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [req-8a035078-ef08-4788-b386-13ba52fb412e req-51c025f8-27cf-41df-b5d1-cc0af4d983ef tempest-VolumesSnapshotsTestJSON-2081265657 None] Volume 7e19091c-df65-4785-a202-695b45cd4574: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e19091c-df65-4785-a202-695b45cd4574', 'volume_size': 1} Sep 16 20:25:22 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [req-8a035078-ef08-4788-b386-13ba52fb412e req-51c025f8-27cf-41df-b5d1-cc0af4d983ef tempest-VolumesSnapshotsTestJSON-2081265657 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:25:22 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [req-8a035078-ef08-4788-b386-13ba52fb412e req-51c025f8-27cf-41df-b5d1-cc0af4d983ef tempest-VolumesSnapshotsTestJSON-2081265657 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:25:22 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [req-8a035078-ef08-4788-b386-13ba52fb412e req-51c025f8-27cf-41df-b5d1-cc0af4d983ef tempest-VolumesSnapshotsTestJSON-2081265657 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:25:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-747867748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e19091c-df65-4785-a202-695b45cd4574,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='651399ad7aba4e358bfd33c1a0ddd6e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:25:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:25:23Z,use_quota=True,user_id='48b09ef45c604dfc9de518443f430aaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:25:22 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [req-8a035078-ef08-4788-b386-13ba52fb412e req-51c025f8-27cf-41df-b5d1-cc0af4d983ef tempest-VolumesSnapshotsTestJSON-2081265657 None] Creating volume 7e19091c-df65-4785-a202-695b45cd4574 {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:25:22 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [req-8a035078-ef08-4788-b386-13ba52fb412e req-51c025f8-27cf-41df-b5d1-cc0af4d983ef tempest-VolumesSnapshotsTestJSON-2081265657 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:25:22 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [req-8a035078-ef08-4788-b386-13ba52fb412e req-51c025f8-27cf-41df-b5d1-cc0af4d983ef tempest-VolumesSnapshotsTestJSON-2081265657 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:25:22 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [req-8a035078-ef08-4788-b386-13ba52fb412e req-51c025f8-27cf-41df-b5d1-cc0af4d983ef tempest-VolumesSnapshotsTestJSON-2081265657 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:25:22 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [req-8a035078-ef08-4788-b386-13ba52fb412e req-51c025f8-27cf-41df-b5d1-cc0af4d983ef tempest-VolumesSnapshotsTestJSON-2081265657 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:25:22 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [req-8a035078-ef08-4788-b386-13ba52fb412e req-51c025f8-27cf-41df-b5d1-cc0af4d983ef tempest-VolumesSnapshotsTestJSON-2081265657 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:25:22 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [req-8a035078-ef08-4788-b386-13ba52fb412e req-51c025f8-27cf-41df-b5d1-cc0af4d983ef tempest-VolumesSnapshotsTestJSON-2081265657 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:25:22 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [req-8a035078-ef08-4788-b386-13ba52fb412e req-51c025f8-27cf-41df-b5d1-cc0af4d983ef tempest-VolumesSnapshotsTestJSON-2081265657 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:25:22 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [req-8a035078-ef08-4788-b386-13ba52fb412e req-51c025f8-27cf-41df-b5d1-cc0af4d983ef tempest-VolumesSnapshotsTestJSON-2081265657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-7e19091c-df65-4785-a202-695b45cd4574 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:25:22 devstack sudo[96751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-7e19091c-df65-4785-a202-695b45cd4574 1073741824 Sep 16 20:25:22 devstack sudo[96751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:25:23 devstack sudo[96751]: pam_unix(sudo:session): session closed for user root Sep 16 20:25:23 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [req-8a035078-ef08-4788-b386-13ba52fb412e req-51c025f8-27cf-41df-b5d1-cc0af4d983ef tempest-VolumesSnapshotsTestJSON-2081265657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-7e19091c-df65-4785-a202-695b45cd4574 1073741824" returned: 0 in 0.845s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:25:23 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [req-8a035078-ef08-4788-b386-13ba52fb412e req-51c025f8-27cf-41df-b5d1-cc0af4d983ef tempest-VolumesSnapshotsTestJSON-2081265657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-7e19091c-df65-4785-a202-695b45cd4574 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:25:23 devstack sudo[96776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-7e19091c-df65-4785-a202-695b45cd4574 Sep 16 20:25:23 devstack sudo[96776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:25:24 devstack sudo[96776]: pam_unix(sudo:session): session closed for user root Sep 16 20:25:24 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [req-8a035078-ef08-4788-b386-13ba52fb412e req-51c025f8-27cf-41df-b5d1-cc0af4d983ef tempest-VolumesSnapshotsTestJSON-2081265657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-7e19091c-df65-4785-a202-695b45cd4574" returned: 0 in 0.349s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:25:24 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [req-8a035078-ef08-4788-b386-13ba52fb412e req-51c025f8-27cf-41df-b5d1-cc0af4d983ef tempest-VolumesSnapshotsTestJSON-2081265657 None] <== create_volume: return (1270ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:25:24 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [req-8a035078-ef08-4788-b386-13ba52fb412e req-51c025f8-27cf-41df-b5d1-cc0af4d983ef tempest-VolumesSnapshotsTestJSON-2081265657 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.273s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:25:24 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [req-8a035078-ef08-4788-b386-13ba52fb412e req-51c025f8-27cf-41df-b5d1-cc0af4d983ef tempest-VolumesSnapshotsTestJSON-2081265657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8f394f1-1860-424c-bfba-c523b341e0fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e19091c-df65-4785-a202-695b45cd4574', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:25:24 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [req-8a035078-ef08-4788-b386-13ba52fb412e req-51c025f8-27cf-41df-b5d1-cc0af4d983ef tempest-VolumesSnapshotsTestJSON-2081265657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd9252f7-260b-4032-bc92-f86bb841135b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:25:24 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [req-8a035078-ef08-4788-b386-13ba52fb412e req-51c025f8-27cf-41df-b5d1-cc0af4d983ef tempest-VolumesSnapshotsTestJSON-2081265657 None] Volume volume-7e19091c-df65-4785-a202-695b45cd4574 (7e19091c-df65-4785-a202-695b45cd4574): created successfully Sep 16 20:25:24 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [req-8a035078-ef08-4788-b386-13ba52fb412e req-51c025f8-27cf-41df-b5d1-cc0af4d983ef tempest-VolumesSnapshotsTestJSON-2081265657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd9252f7-260b-4032-bc92-f86bb841135b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:25:24 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [req-8a035078-ef08-4788-b386-13ba52fb412e req-51c025f8-27cf-41df-b5d1-cc0af4d983ef tempest-VolumesSnapshotsTestJSON-2081265657 None] Flow 'volume_create_manager' (61e7cc38-b395-4318-a1e3-ec6bd34b3356) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:25:24 devstack cinder-volume[86188]: INFO cinder.volume.manager [req-8a035078-ef08-4788-b386-13ba52fb412e req-51c025f8-27cf-41df-b5d1-cc0af4d983ef tempest-VolumesSnapshotsTestJSON-2081265657 None] Created volume successfully. Sep 16 20:25:25 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [req-d972e6b4-7f6c-46ed-a7dc-c6bbf6d4fa10 req-3c24787c-9d21-4401-98d2-4a5c9d1b2d01 tempest-VolumesSnapshotsTestJSON-2081265657 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:25:25 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [req-d972e6b4-7f6c-46ed-a7dc-c6bbf6d4fa10 req-3c24787c-9d21-4401-98d2-4a5c9d1b2d01 tempest-VolumesSnapshotsTestJSON-2081265657 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:25:25 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [req-d972e6b4-7f6c-46ed-a7dc-c6bbf6d4fa10 req-3c24787c-9d21-4401-98d2-4a5c9d1b2d01 tempest-VolumesSnapshotsTestJSON-2081265657 None] Creating offline snapshot 73ccdaac-d479-4a7b-a683-b3c9ba2ca23e of volume 7e19091c-df65-4785-a202-695b45cd4574 {{(pid=86188) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 20:25:25 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c93bdce-5ec5-43a3-925a-637d3cc56293]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:25:25 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [req-d972e6b4-7f6c-46ed-a7dc-c6bbf6d4fa10 req-3c24787c-9d21-4401-98d2-4a5c9d1b2d01 tempest-VolumesSnapshotsTestJSON-2081265657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-7e19091c-df65-4785-a202-695b45cd4574 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:25:25 devstack sudo[96780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-7e19091c-df65-4785-a202-695b45cd4574 Sep 16 20:25:25 devstack sudo[96780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:25:25 devstack sudo[96780]: pam_unix(sudo:session): session closed for user root Sep 16 20:25:25 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [req-d972e6b4-7f6c-46ed-a7dc-c6bbf6d4fa10 req-3c24787c-9d21-4401-98d2-4a5c9d1b2d01 tempest-VolumesSnapshotsTestJSON-2081265657 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-7e19091c-df65-4785-a202-695b45cd4574" returned: 0 in 0.498s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:25:25 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [req-d972e6b4-7f6c-46ed-a7dc-c6bbf6d4fa10 req-3c24787c-9d21-4401-98d2-4a5c9d1b2d01 tempest-VolumesSnapshotsTestJSON-2081265657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-7e19091c-df65-4785-a202-695b45cd4574,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-7e19091c-df65-4785-a202-695b45cd4574.73ccdaac-d479-4a7b-a683-b3c9ba2ca23e 1G {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:25:25 devstack sudo[96786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-7e19091c-df65-4785-a202-695b45cd4574,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-7e19091c-df65-4785-a202-695b45cd4574.73ccdaac-d479-4a7b-a683-b3c9ba2ca23e 1G Sep 16 20:25:25 devstack sudo[96786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:25:26 devstack sudo[96786]: pam_unix(sudo:session): session closed for user root Sep 16 20:25:26 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [req-d972e6b4-7f6c-46ed-a7dc-c6bbf6d4fa10 req-3c24787c-9d21-4401-98d2-4a5c9d1b2d01 tempest-VolumesSnapshotsTestJSON-2081265657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-7e19091c-df65-4785-a202-695b45cd4574,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-7e19091c-df65-4785-a202-695b45cd4574.73ccdaac-d479-4a7b-a683-b3c9ba2ca23e 1G" returned: 0 in 0.587s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:25:26 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [req-d972e6b4-7f6c-46ed-a7dc-c6bbf6d4fa10 req-3c24787c-9d21-4401-98d2-4a5c9d1b2d01 tempest-VolumesSnapshotsTestJSON-2081265657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e19091c-df65-4785-a202-695b45cd4574 -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-7e19091c-df65-4785-a202-695b45cd4574.73ccdaac-d479-4a7b-a683-b3c9ba2ca23e {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:25:26 devstack sudo[96793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e19091c-df65-4785-a202-695b45cd4574 -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-7e19091c-df65-4785-a202-695b45cd4574.73ccdaac-d479-4a7b-a683-b3c9ba2ca23e Sep 16 20:25:26 devstack sudo[96793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:25:26 devstack sudo[96793]: pam_unix(sudo:session): session closed for user root Sep 16 20:25:26 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [req-d972e6b4-7f6c-46ed-a7dc-c6bbf6d4fa10 req-3c24787c-9d21-4401-98d2-4a5c9d1b2d01 tempest-VolumesSnapshotsTestJSON-2081265657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e19091c-df65-4785-a202-695b45cd4574 -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-7e19091c-df65-4785-a202-695b45cd4574.73ccdaac-d479-4a7b-a683-b3c9ba2ca23e" returned: 0 in 0.471s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:25:26 devstack cinder-volume[86188]: WARNING cinder.volume.drivers.remotefs [req-d972e6b4-7f6c-46ed-a7dc-c6bbf6d4fa10 req-3c24787c-9d21-4401-98d2-4a5c9d1b2d01 tempest-VolumesSnapshotsTestJSON-2081265657 None] /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-7e19091c-df65-4785-a202-695b45cd4574.73ccdaac-d479-4a7b-a683-b3c9ba2ca23e is being set with open permissions: ugo+rw Sep 16 20:25:26 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [req-d972e6b4-7f6c-46ed-a7dc-c6bbf6d4fa10 req-3c24787c-9d21-4401-98d2-4a5c9d1b2d01 tempest-VolumesSnapshotsTestJSON-2081265657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-7e19091c-df65-4785-a202-695b45cd4574.73ccdaac-d479-4a7b-a683-b3c9ba2ca23e {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:25:26 devstack sudo[96800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-7e19091c-df65-4785-a202-695b45cd4574.73ccdaac-d479-4a7b-a683-b3c9ba2ca23e Sep 16 20:25:26 devstack sudo[96800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:25:27 devstack sudo[96800]: pam_unix(sudo:session): session closed for user root Sep 16 20:25:27 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [req-d972e6b4-7f6c-46ed-a7dc-c6bbf6d4fa10 req-3c24787c-9d21-4401-98d2-4a5c9d1b2d01 tempest-VolumesSnapshotsTestJSON-2081265657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-7e19091c-df65-4785-a202-695b45cd4574.73ccdaac-d479-4a7b-a683-b3c9ba2ca23e" returned: 0 in 0.317s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:25:27 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [req-d972e6b4-7f6c-46ed-a7dc-c6bbf6d4fa10 req-3c24787c-9d21-4401-98d2-4a5c9d1b2d01 tempest-VolumesSnapshotsTestJSON-2081265657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-7e19091c-df65-4785-a202-695b45cd4574.info {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:25:27 devstack sudo[96803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-7e19091c-df65-4785-a202-695b45cd4574.info Sep 16 20:25:27 devstack sudo[96803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:25:27 devstack sudo[96803]: pam_unix(sudo:session): session closed for user root Sep 16 20:25:27 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [req-d972e6b4-7f6c-46ed-a7dc-c6bbf6d4fa10 req-3c24787c-9d21-4401-98d2-4a5c9d1b2d01 tempest-VolumesSnapshotsTestJSON-2081265657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-7e19091c-df65-4785-a202-695b45cd4574.info" returned: 0 in 0.326s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:25:27 devstack cinder-volume[86188]: WARNING cinder.volume.drivers.remotefs [req-d972e6b4-7f6c-46ed-a7dc-c6bbf6d4fa10 req-3c24787c-9d21-4401-98d2-4a5c9d1b2d01 tempest-VolumesSnapshotsTestJSON-2081265657 None] /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-7e19091c-df65-4785-a202-695b45cd4574.info is being set with open permissions: ugo+rw Sep 16 20:25:27 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [req-d972e6b4-7f6c-46ed-a7dc-c6bbf6d4fa10 req-3c24787c-9d21-4401-98d2-4a5c9d1b2d01 tempest-VolumesSnapshotsTestJSON-2081265657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-7e19091c-df65-4785-a202-695b45cd4574.info {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:25:27 devstack sudo[96806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-7e19091c-df65-4785-a202-695b45cd4574.info Sep 16 20:25:27 devstack sudo[96806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:25:27 devstack sudo[96806]: pam_unix(sudo:session): session closed for user root Sep 16 20:25:27 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [req-d972e6b4-7f6c-46ed-a7dc-c6bbf6d4fa10 req-3c24787c-9d21-4401-98d2-4a5c9d1b2d01 tempest-VolumesSnapshotsTestJSON-2081265657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-7e19091c-df65-4785-a202-695b45cd4574.info" returned: 0 in 0.361s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:25:27 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [req-d972e6b4-7f6c-46ed-a7dc-c6bbf6d4fa10 req-3c24787c-9d21-4401-98d2-4a5c9d1b2d01 tempest-VolumesSnapshotsTestJSON-2081265657 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.696s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:25:27 devstack cinder-volume[86188]: INFO cinder.volume.manager [req-d972e6b4-7f6c-46ed-a7dc-c6bbf6d4fa10 req-3c24787c-9d21-4401-98d2-4a5c9d1b2d01 tempest-VolumesSnapshotsTestJSON-2081265657 None] Create snapshot completed successfully Sep 16 20:25:27 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-1271243a-dea4-43ff-bc16-a403231aa38e tempest-GroupsTest-714793610 None] Group tempest-Group1-121943289: creating Sep 16 20:25:28 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-1271243a-dea4-43ff-bc16-a403231aa38e tempest-GroupsTest-714793610 None] Group tempest-Group1-121943289: created successfully Sep 16 20:25:28 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-1271243a-dea4-43ff-bc16-a403231aa38e tempest-GroupsTest-714793610 None] Create group completed successfully. Sep 16 20:25:29 devstack cinder-volume[86188]: DEBUG cinder.coordination [req-665eecf5-44e9-4e70-a4eb-cb6d64a101da req-bbbba0cc-2f7b-4eb9-a19f-6514af9eca9d tempest-VolumesSnapshotsTestJSON-2081265657 None] Acquiring lock "cinder-73ccdaac-d479-4a7b-a683-b3c9ba2ca23e-delete_snapshot" by "delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:25:29 devstack cinder-volume[86188]: DEBUG cinder.coordination [req-665eecf5-44e9-4e70-a4eb-cb6d64a101da req-bbbba0cc-2f7b-4eb9-a19f-6514af9eca9d tempest-VolumesSnapshotsTestJSON-2081265657 None] Lock "cinder-73ccdaac-d479-4a7b-a683-b3c9ba2ca23e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:25:29 devstack cinder-volume[86188]: DEBUG cinder.coordination [req-665eecf5-44e9-4e70-a4eb-cb6d64a101da req-bbbba0cc-2f7b-4eb9-a19f-6514af9eca9d tempest-VolumesSnapshotsTestJSON-2081265657 None] Acquiring lock "cinder-quobyte-7e19091c-df65-4785-a202-695b45cd4574" by "delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:25:29 devstack cinder-volume[86188]: DEBUG cinder.coordination [req-665eecf5-44e9-4e70-a4eb-cb6d64a101da req-bbbba0cc-2f7b-4eb9-a19f-6514af9eca9d tempest-VolumesSnapshotsTestJSON-2081265657 None] Lock "cinder-quobyte-7e19091c-df65-4785-a202-695b45cd4574" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:25:29 devstack cinder-volume[86188]: DEBUG cinder.coordination [req-665eecf5-44e9-4e70-a4eb-cb6d64a101da req-bbbba0cc-2f7b-4eb9-a19f-6514af9eca9d tempest-VolumesSnapshotsTestJSON-2081265657 None] Acquiring lock "cinder-quobyte-73ccdaac-d479-4a7b-a683-b3c9ba2ca23e" by "_delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:25:29 devstack cinder-volume[86188]: DEBUG cinder.coordination [req-665eecf5-44e9-4e70-a4eb-cb6d64a101da req-bbbba0cc-2f7b-4eb9-a19f-6514af9eca9d tempest-VolumesSnapshotsTestJSON-2081265657 None] Lock "cinder-quobyte-73ccdaac-d479-4a7b-a683-b3c9ba2ca23e" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:25:29 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [req-665eecf5-44e9-4e70-a4eb-cb6d64a101da req-bbbba0cc-2f7b-4eb9-a19f-6514af9eca9d tempest-VolumesSnapshotsTestJSON-2081265657 None] Deleting offline snapshot 73ccdaac-d479-4a7b-a683-b3c9ba2ca23e of volume 7e19091c-df65-4785-a202-695b45cd4574 {{(pid=86188) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 20:25:29 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [req-665eecf5-44e9-4e70-a4eb-cb6d64a101da req-bbbba0cc-2f7b-4eb9-a19f-6514af9eca9d tempest-VolumesSnapshotsTestJSON-2081265657 None] snapshot_file for this snap is: volume-7e19091c-df65-4785-a202-695b45cd4574.73ccdaac-d479-4a7b-a683-b3c9ba2ca23e {{(pid=86188) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 20:25:29 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[d770d7fb-0c49-440a-985e-375844093d89]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:25:29 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [req-665eecf5-44e9-4e70-a4eb-cb6d64a101da req-bbbba0cc-2f7b-4eb9-a19f-6514af9eca9d tempest-VolumesSnapshotsTestJSON-2081265657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-7e19091c-df65-4785-a202-695b45cd4574.73ccdaac-d479-4a7b-a683-b3c9ba2ca23e {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:25:29 devstack sudo[96810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-7e19091c-df65-4785-a202-695b45cd4574.73ccdaac-d479-4a7b-a683-b3c9ba2ca23e Sep 16 20:25:29 devstack sudo[96810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:25:29 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-d8a56f5a-5b44-4ff3-9345-95b71dd8617e tempest-GroupsTest-714793610 None] Group tempest-Group2-1248581354: creating Sep 16 20:25:29 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-d8a56f5a-5b44-4ff3-9345-95b71dd8617e tempest-GroupsTest-714793610 None] Group tempest-Group2-1248581354: created successfully Sep 16 20:25:29 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-d8a56f5a-5b44-4ff3-9345-95b71dd8617e tempest-GroupsTest-714793610 None] Create group completed successfully. Sep 16 20:25:29 devstack sudo[96810]: pam_unix(sudo:session): session closed for user root Sep 16 20:25:29 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [req-665eecf5-44e9-4e70-a4eb-cb6d64a101da req-bbbba0cc-2f7b-4eb9-a19f-6514af9eca9d tempest-VolumesSnapshotsTestJSON-2081265657 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-7e19091c-df65-4785-a202-695b45cd4574.73ccdaac-d479-4a7b-a683-b3c9ba2ca23e" returned: 0 in 0.598s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:25:29 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [req-665eecf5-44e9-4e70-a4eb-cb6d64a101da req-bbbba0cc-2f7b-4eb9-a19f-6514af9eca9d tempest-VolumesSnapshotsTestJSON-2081265657 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7e19091c-df65-4785-a202-695b45cd4574(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86188) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 20:25:29 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c889512-35e1-48bb-919a-66a4926d3fc3]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:25:29 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [req-665eecf5-44e9-4e70-a4eb-cb6d64a101da req-bbbba0cc-2f7b-4eb9-a19f-6514af9eca9d tempest-VolumesSnapshotsTestJSON-2081265657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-7e19091c-df65-4785-a202-695b45cd4574 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:25:29 devstack sudo[96816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-7e19091c-df65-4785-a202-695b45cd4574 Sep 16 20:25:29 devstack sudo[96816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:25:30 devstack sudo[96816]: pam_unix(sudo:session): session closed for user root Sep 16 20:25:30 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [req-665eecf5-44e9-4e70-a4eb-cb6d64a101da req-bbbba0cc-2f7b-4eb9-a19f-6514af9eca9d tempest-VolumesSnapshotsTestJSON-2081265657 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-7e19091c-df65-4785-a202-695b45cd4574" returned: 0 in 0.522s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:25:30 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [req-665eecf5-44e9-4e70-a4eb-cb6d64a101da req-bbbba0cc-2f7b-4eb9-a19f-6514af9eca9d tempest-VolumesSnapshotsTestJSON-2081265657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-7e19091c-df65-4785-a202-695b45cd4574.73ccdaac-d479-4a7b-a683-b3c9ba2ca23e {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:25:30 devstack sudo[96822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-7e19091c-df65-4785-a202-695b45cd4574.73ccdaac-d479-4a7b-a683-b3c9ba2ca23e Sep 16 20:25:30 devstack sudo[96822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:25:30 devstack sudo[96822]: pam_unix(sudo:session): session closed for user root Sep 16 20:25:30 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [req-665eecf5-44e9-4e70-a4eb-cb6d64a101da req-bbbba0cc-2f7b-4eb9-a19f-6514af9eca9d tempest-VolumesSnapshotsTestJSON-2081265657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-7e19091c-df65-4785-a202-695b45cd4574.73ccdaac-d479-4a7b-a683-b3c9ba2ca23e" returned: 0 in 0.577s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:25:30 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [req-665eecf5-44e9-4e70-a4eb-cb6d64a101da req-bbbba0cc-2f7b-4eb9-a19f-6514af9eca9d tempest-VolumesSnapshotsTestJSON-2081265657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-7e19091c-df65-4785-a202-695b45cd4574.73ccdaac-d479-4a7b-a683-b3c9ba2ca23e {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:25:30 devstack sudo[96827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-7e19091c-df65-4785-a202-695b45cd4574.73ccdaac-d479-4a7b-a683-b3c9ba2ca23e Sep 16 20:25:30 devstack sudo[96827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:25:31 devstack sudo[96827]: pam_unix(sudo:session): session closed for user root Sep 16 20:25:31 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [req-665eecf5-44e9-4e70-a4eb-cb6d64a101da req-bbbba0cc-2f7b-4eb9-a19f-6514af9eca9d tempest-VolumesSnapshotsTestJSON-2081265657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-7e19091c-df65-4785-a202-695b45cd4574.73ccdaac-d479-4a7b-a683-b3c9ba2ca23e" returned: 0 in 0.384s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:25:31 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b7e2d86-16c9-4794-b434-4149a9e80c91 tempest-GroupsTest-714793610 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:25:31 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-5b7e2d86-16c9-4794-b434-4149a9e80c91 tempest-GroupsTest-714793610 None] Flow 'volume_create_manager' (c70bf719-85b1-490b-a796-735768ac7549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:25:31 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-5b7e2d86-16c9-4794-b434-4149a9e80c91 tempest-GroupsTest-714793610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a71d7447-4cc3-4ac2-9aaf-8465ca241d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:25:31 devstack cinder-volume[86188]: DEBUG cinder.coordination [req-665eecf5-44e9-4e70-a4eb-cb6d64a101da req-bbbba0cc-2f7b-4eb9-a19f-6514af9eca9d tempest-VolumesSnapshotsTestJSON-2081265657 None] Lock "cinder-quobyte-73ccdaac-d479-4a7b-a683-b3c9ba2ca23e" released by "_delete_snapshot" :: held 2.304s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:25:31 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-5b7e2d86-16c9-4794-b434-4149a9e80c91 tempest-GroupsTest-714793610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a71d7447-4cc3-4ac2-9aaf-8465ca241d5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:25:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1557149759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f7f9d29a-6006-44da-ac40-ffe55859f948,host='devstack@QuobyteHD#QuobyteHD',id=b5445fc4-e28f-4aec-8133-245db581a9b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c761b58affe14292bf30617ba5cd0435',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:25:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:25:31Z,use_quota=True,user_id='8bc8f80d661e41d996bcc4b1ccf0a2ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1830492-a719-42c8-8c4f-bcc37d1980db),volume_type_id=c1830492-a719-42c8-8c4f-bcc37d1980db)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:25:31 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-5b7e2d86-16c9-4794-b434-4149a9e80c91 tempest-GroupsTest-714793610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (810840b6-0993-43f0-9c57-bae29b702647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:25:31 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-5b7e2d86-16c9-4794-b434-4149a9e80c91 tempest-GroupsTest-714793610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (810840b6-0993-43f0-9c57-bae29b702647) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:25:31 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-5b7e2d86-16c9-4794-b434-4149a9e80c91 tempest-GroupsTest-714793610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dfd2ffb-2293-400b-9b5c-682bc0934a8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:25:31 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-5b7e2d86-16c9-4794-b434-4149a9e80c91 tempest-GroupsTest-714793610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dfd2ffb-2293-400b-9b5c-682bc0934a8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5445fc4-e28f-4aec-8133-245db581a9b7', 'volume_name': 'volume-b5445fc4-e28f-4aec-8133-245db581a9b7', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:25:31 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-5b7e2d86-16c9-4794-b434-4149a9e80c91 tempest-GroupsTest-714793610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08ceb2cb-e69e-40ef-812e-23e4621d3b5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:25:31 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-5b7e2d86-16c9-4794-b434-4149a9e80c91 tempest-GroupsTest-714793610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08ceb2cb-e69e-40ef-812e-23e4621d3b5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:25:31 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-5b7e2d86-16c9-4794-b434-4149a9e80c91 tempest-GroupsTest-714793610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85ad68a8-9dbf-499c-a5f2-3daa39164a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:25:31 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-5b7e2d86-16c9-4794-b434-4149a9e80c91 tempest-GroupsTest-714793610 None] Volume b5445fc4-e28f-4aec-8133-245db581a9b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5445fc4-e28f-4aec-8133-245db581a9b7', 'volume_size': 1} Sep 16 20:25:31 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-5b7e2d86-16c9-4794-b434-4149a9e80c91 tempest-GroupsTest-714793610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:25:31 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-5b7e2d86-16c9-4794-b434-4149a9e80c91 tempest-GroupsTest-714793610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:25:31 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-5b7e2d86-16c9-4794-b434-4149a9e80c91 tempest-GroupsTest-714793610 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f7f9d29a-6006-44da-ac40-ffe55859f948,created_at=2026-09-16T18:25:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1557149759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f7f9d29a-6006-44da-ac40-ffe55859f948,host='devstack@QuobyteHD#QuobyteHD',id=b5445fc4-e28f-4aec-8133-245db581a9b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c761b58affe14292bf30617ba5cd0435',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:25:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:25:31Z,use_quota=True,user_id='8bc8f80d661e41d996bcc4b1ccf0a2ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1830492-a719-42c8-8c4f-bcc37d1980db),volume_type_id=c1830492-a719-42c8-8c4f-bcc37d1980db)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:25:31 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-5b7e2d86-16c9-4794-b434-4149a9e80c91 tempest-GroupsTest-714793610 None] Creating volume b5445fc4-e28f-4aec-8133-245db581a9b7 {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:25:31 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-5b7e2d86-16c9-4794-b434-4149a9e80c91 tempest-GroupsTest-714793610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:25:31 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-5b7e2d86-16c9-4794-b434-4149a9e80c91 tempest-GroupsTest-714793610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:25:31 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-5b7e2d86-16c9-4794-b434-4149a9e80c91 tempest-GroupsTest-714793610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:25:31 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-5b7e2d86-16c9-4794-b434-4149a9e80c91 tempest-GroupsTest-714793610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:25:31 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-5b7e2d86-16c9-4794-b434-4149a9e80c91 tempest-GroupsTest-714793610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:25:31 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-5b7e2d86-16c9-4794-b434-4149a9e80c91 tempest-GroupsTest-714793610 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:25:31 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-5b7e2d86-16c9-4794-b434-4149a9e80c91 tempest-GroupsTest-714793610 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:25:31 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-5b7e2d86-16c9-4794-b434-4149a9e80c91 tempest-GroupsTest-714793610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b5445fc4-e28f-4aec-8133-245db581a9b7 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:25:31 devstack cinder-volume[86188]: DEBUG cinder.coordination [req-665eecf5-44e9-4e70-a4eb-cb6d64a101da req-bbbba0cc-2f7b-4eb9-a19f-6514af9eca9d tempest-VolumesSnapshotsTestJSON-2081265657 None] Lock "cinder-quobyte-7e19091c-df65-4785-a202-695b45cd4574" released by "delete_snapshot" :: held 2.442s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:25:31 devstack sudo[96830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b5445fc4-e28f-4aec-8133-245db581a9b7 1073741824 Sep 16 20:25:31 devstack sudo[96830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:25:31 devstack cinder-volume[86188]: DEBUG cinder.quota [req-665eecf5-44e9-4e70-a4eb-cb6d64a101da req-bbbba0cc-2f7b-4eb9-a19f-6514af9eca9d tempest-VolumesSnapshotsTestJSON-2081265657 None] Created reservations ['f8caff0b-81cf-4cac-9457-96a286714351', 'd4dd5d11-1018-4dcb-a9b9-dd9013ea5ad0', '02fa9f81-6bf7-4cf3-a9e3-0685c89e713a', '16a14e28-dbb8-4523-ab0f-1330a6ca08d6'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:25:31 devstack cinder-volume[86188]: INFO cinder.volume.manager [req-665eecf5-44e9-4e70-a4eb-cb6d64a101da req-bbbba0cc-2f7b-4eb9-a19f-6514af9eca9d tempest-VolumesSnapshotsTestJSON-2081265657 None] Delete snapshot completed successfully. Sep 16 20:25:31 devstack cinder-volume[86188]: DEBUG cinder.coordination [req-665eecf5-44e9-4e70-a4eb-cb6d64a101da req-bbbba0cc-2f7b-4eb9-a19f-6514af9eca9d tempest-VolumesSnapshotsTestJSON-2081265657 None] Lock "cinder-73ccdaac-d479-4a7b-a683-b3c9ba2ca23e-delete_snapshot" released by "delete_snapshot" :: held 2.663s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:25:32 devstack sudo[96830]: pam_unix(sudo:session): session closed for user root Sep 16 20:25:32 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-5b7e2d86-16c9-4794-b434-4149a9e80c91 tempest-GroupsTest-714793610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b5445fc4-e28f-4aec-8133-245db581a9b7 1073741824" returned: 0 in 0.547s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:25:32 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-5b7e2d86-16c9-4794-b434-4149a9e80c91 tempest-GroupsTest-714793610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b5445fc4-e28f-4aec-8133-245db581a9b7 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:25:32 devstack sudo[96836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b5445fc4-e28f-4aec-8133-245db581a9b7 Sep 16 20:25:32 devstack sudo[96836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:25:32 devstack sudo[96836]: pam_unix(sudo:session): session closed for user root Sep 16 20:25:32 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-5b7e2d86-16c9-4794-b434-4149a9e80c91 tempest-GroupsTest-714793610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b5445fc4-e28f-4aec-8133-245db581a9b7" returned: 0 in 0.264s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:25:32 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-5b7e2d86-16c9-4794-b434-4149a9e80c91 tempest-GroupsTest-714793610 None] <== create_volume: return (858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:25:32 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-5b7e2d86-16c9-4794-b434-4149a9e80c91 tempest-GroupsTest-714793610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.861s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:25:32 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-5b7e2d86-16c9-4794-b434-4149a9e80c91 tempest-GroupsTest-714793610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85ad68a8-9dbf-499c-a5f2-3daa39164a5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5445fc4-e28f-4aec-8133-245db581a9b7', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:25:32 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-5b7e2d86-16c9-4794-b434-4149a9e80c91 tempest-GroupsTest-714793610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a63a1b78-907a-45b5-95b5-a25f3b2b6c3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:25:32 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-5b7e2d86-16c9-4794-b434-4149a9e80c91 tempest-GroupsTest-714793610 None] Volume volume-b5445fc4-e28f-4aec-8133-245db581a9b7 (b5445fc4-e28f-4aec-8133-245db581a9b7): created successfully Sep 16 20:25:32 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-5b7e2d86-16c9-4794-b434-4149a9e80c91 tempest-GroupsTest-714793610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a63a1b78-907a-45b5-95b5-a25f3b2b6c3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:25:32 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-5b7e2d86-16c9-4794-b434-4149a9e80c91 tempest-GroupsTest-714793610 None] Flow 'volume_create_manager' (c70bf719-85b1-490b-a796-735768ac7549) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:25:32 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-5b7e2d86-16c9-4794-b434-4149a9e80c91 tempest-GroupsTest-714793610 None] Created volume successfully. Sep 16 20:25:32 devstack cinder-volume[86188]: DEBUG cinder.coordination [req-3af4c6e6-0a8b-4cc0-882a-bdfb70f888d3 req-e4da29fa-1e96-4d37-8b98-ffd38bbe7619 tempest-VolumesSnapshotsTestJSON-2081265657 None] Acquiring lock "cinder-7e19091c-df65-4785-a202-695b45cd4574-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:25:32 devstack cinder-volume[86188]: DEBUG cinder.coordination [req-3af4c6e6-0a8b-4cc0-882a-bdfb70f888d3 req-e4da29fa-1e96-4d37-8b98-ffd38bbe7619 tempest-VolumesSnapshotsTestJSON-2081265657 None] Lock "cinder-7e19091c-df65-4785-a202-695b45cd4574-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:25:32 devstack cinder-volume[86188]: DEBUG cinder.coordination [req-3af4c6e6-0a8b-4cc0-882a-bdfb70f888d3 req-e4da29fa-1e96-4d37-8b98-ffd38bbe7619 tempest-VolumesSnapshotsTestJSON-2081265657 None] Acquiring lock "cinder-quobyte-7e19091c-df65-4785-a202-695b45cd4574" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:25:32 devstack cinder-volume[86188]: DEBUG cinder.coordination [req-3af4c6e6-0a8b-4cc0-882a-bdfb70f888d3 req-e4da29fa-1e96-4d37-8b98-ffd38bbe7619 tempest-VolumesSnapshotsTestJSON-2081265657 None] Lock "cinder-quobyte-7e19091c-df65-4785-a202-695b45cd4574" acquired by "delete_volume" :: waited 0.037s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:25:32 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e2dacc3-588f-4934-8e47-debe35518140]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:25:32 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [req-3af4c6e6-0a8b-4cc0-882a-bdfb70f888d3 req-e4da29fa-1e96-4d37-8b98-ffd38bbe7619 tempest-VolumesSnapshotsTestJSON-2081265657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-7e19091c-df65-4785-a202-695b45cd4574 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:25:32 devstack sudo[96841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-7e19091c-df65-4785-a202-695b45cd4574 Sep 16 20:25:32 devstack sudo[96841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:25:33 devstack sudo[96841]: pam_unix(sudo:session): session closed for user root Sep 16 20:25:33 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [req-3af4c6e6-0a8b-4cc0-882a-bdfb70f888d3 req-e4da29fa-1e96-4d37-8b98-ffd38bbe7619 tempest-VolumesSnapshotsTestJSON-2081265657 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-7e19091c-df65-4785-a202-695b45cd4574" returned: 0 in 0.567s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:25:33 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [req-3af4c6e6-0a8b-4cc0-882a-bdfb70f888d3 req-e4da29fa-1e96-4d37-8b98-ffd38bbe7619 tempest-VolumesSnapshotsTestJSON-2081265657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-7e19091c-df65-4785-a202-695b45cd4574 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:25:33 devstack sudo[96846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-7e19091c-df65-4785-a202-695b45cd4574 Sep 16 20:25:33 devstack sudo[96846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:25:33 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-93685d7e-83af-4f6d-9112-ffb73af0f74f tempest-GroupsTest-714793610 None] Acquiring lock "cinder-quobyte-b5445fc4-e28f-4aec-8133-245db581a9b7" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:25:33 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-93685d7e-83af-4f6d-9112-ffb73af0f74f tempest-GroupsTest-714793610 None] Lock "cinder-quobyte-b5445fc4-e28f-4aec-8133-245db581a9b7" acquired by "delete_volume" :: waited 0.031s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:25:33 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[570a9386-c25b-4de6-a853-34e2198f6312]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:25:33 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-93685d7e-83af-4f6d-9112-ffb73af0f74f tempest-GroupsTest-714793610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b5445fc4-e28f-4aec-8133-245db581a9b7 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:25:33 devstack sudo[96846]: pam_unix(sudo:session): session closed for user root Sep 16 20:25:33 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [req-3af4c6e6-0a8b-4cc0-882a-bdfb70f888d3 req-e4da29fa-1e96-4d37-8b98-ffd38bbe7619 tempest-VolumesSnapshotsTestJSON-2081265657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-7e19091c-df65-4785-a202-695b45cd4574" returned: 0 in 0.331s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:25:33 devstack cinder-volume[86188]: DEBUG cinder.coordination [req-3af4c6e6-0a8b-4cc0-882a-bdfb70f888d3 req-e4da29fa-1e96-4d37-8b98-ffd38bbe7619 tempest-VolumesSnapshotsTestJSON-2081265657 None] Lock "cinder-quobyte-7e19091c-df65-4785-a202-695b45cd4574" released by "delete_volume" :: held 0.995s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:25:33 devstack sudo[96848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b5445fc4-e28f-4aec-8133-245db581a9b7 Sep 16 20:25:33 devstack sudo[96848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:25:33 devstack cinder-volume[86188]: DEBUG cinder.quota [req-3af4c6e6-0a8b-4cc0-882a-bdfb70f888d3 req-e4da29fa-1e96-4d37-8b98-ffd38bbe7619 tempest-VolumesSnapshotsTestJSON-2081265657 None] Created reservations ['253bfaa0-d15d-49b3-b6b3-0a74129aac73', '5ad2b852-b201-417a-99ac-22822f7d6773', '2715031d-ed38-46c3-bd9b-c054fb58c34a', 'c32eeeba-3060-4e51-91b9-690b2c8ac83b'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:25:33 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [req-3af4c6e6-0a8b-4cc0-882a-bdfb70f888d3 req-e4da29fa-1e96-4d37-8b98-ffd38bbe7619 tempest-VolumesSnapshotsTestJSON-2081265657 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:25:33 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [req-3af4c6e6-0a8b-4cc0-882a-bdfb70f888d3 req-e4da29fa-1e96-4d37-8b98-ffd38bbe7619 tempest-VolumesSnapshotsTestJSON-2081265657 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:25:33 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [req-3af4c6e6-0a8b-4cc0-882a-bdfb70f888d3 req-e4da29fa-1e96-4d37-8b98-ffd38bbe7619 tempest-VolumesSnapshotsTestJSON-2081265657 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:25:33 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [req-3af4c6e6-0a8b-4cc0-882a-bdfb70f888d3 req-e4da29fa-1e96-4d37-8b98-ffd38bbe7619 tempest-VolumesSnapshotsTestJSON-2081265657 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:25:33 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [req-3af4c6e6-0a8b-4cc0-882a-bdfb70f888d3 req-e4da29fa-1e96-4d37-8b98-ffd38bbe7619 tempest-VolumesSnapshotsTestJSON-2081265657 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:25:33 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [req-3af4c6e6-0a8b-4cc0-882a-bdfb70f888d3 req-e4da29fa-1e96-4d37-8b98-ffd38bbe7619 tempest-VolumesSnapshotsTestJSON-2081265657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:25:33 devstack sudo[96851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:25:33 devstack sudo[96851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:25:34 devstack sudo[96848]: pam_unix(sudo:session): session closed for user root Sep 16 20:25:34 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-93685d7e-83af-4f6d-9112-ffb73af0f74f tempest-GroupsTest-714793610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b5445fc4-e28f-4aec-8133-245db581a9b7" returned: 0 in 0.490s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:25:34 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-93685d7e-83af-4f6d-9112-ffb73af0f74f tempest-GroupsTest-714793610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b5445fc4-e28f-4aec-8133-245db581a9b7 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:25:34 devstack sudo[96856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b5445fc4-e28f-4aec-8133-245db581a9b7 Sep 16 20:25:34 devstack sudo[96856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:25:34 devstack sudo[96851]: pam_unix(sudo:session): session closed for user root Sep 16 20:25:34 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [req-3af4c6e6-0a8b-4cc0-882a-bdfb70f888d3 req-e4da29fa-1e96-4d37-8b98-ffd38bbe7619 tempest-VolumesSnapshotsTestJSON-2081265657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.327s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:25:34 devstack cinder-volume[86188]: DEBUG cinder.manager [req-3af4c6e6-0a8b-4cc0-882a-bdfb70f888d3 req-e4da29fa-1e96-4d37-8b98-ffd38bbe7619 tempest-VolumesSnapshotsTestJSON-2081265657 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:25:34 devstack cinder-volume[86188]: INFO cinder.volume.manager [req-3af4c6e6-0a8b-4cc0-882a-bdfb70f888d3 req-e4da29fa-1e96-4d37-8b98-ffd38bbe7619 tempest-VolumesSnapshotsTestJSON-2081265657 None] Deleted volume successfully. Sep 16 20:25:34 devstack cinder-volume[86188]: DEBUG cinder.coordination [req-3af4c6e6-0a8b-4cc0-882a-bdfb70f888d3 req-e4da29fa-1e96-4d37-8b98-ffd38bbe7619 tempest-VolumesSnapshotsTestJSON-2081265657 None] Lock "cinder-7e19091c-df65-4785-a202-695b45cd4574-delete_volume" released by "delete_volume" :: held 1.673s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:25:34 devstack sudo[96856]: pam_unix(sudo:session): session closed for user root Sep 16 20:25:34 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-93685d7e-83af-4f6d-9112-ffb73af0f74f tempest-GroupsTest-714793610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b5445fc4-e28f-4aec-8133-245db581a9b7" returned: 0 in 0.324s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:25:34 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-93685d7e-83af-4f6d-9112-ffb73af0f74f tempest-GroupsTest-714793610 None] Lock "cinder-quobyte-b5445fc4-e28f-4aec-8133-245db581a9b7" released by "delete_volume" :: held 0.894s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:25:34 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-93685d7e-83af-4f6d-9112-ffb73af0f74f tempest-GroupsTest-714793610 None] Created reservations ['7a7fb15c-53cd-49cc-9849-e4ad27c74261'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:25:34 devstack cinder-volume[86188]: WARNING cinder.quota [None req-93685d7e-83af-4f6d-9112-ffb73af0f74f tempest-GroupsTest-714793610 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-812371357 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-812371357, it is now deprecated. Please use the default quota class for default quota. Sep 16 20:25:34 devstack cinder-volume[86188]: WARNING cinder.quota [None req-93685d7e-83af-4f6d-9112-ffb73af0f74f tempest-GroupsTest-714793610 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-812371357 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-812371357, it is now deprecated. Please use the default quota class for default quota. Sep 16 20:25:34 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-93685d7e-83af-4f6d-9112-ffb73af0f74f tempest-GroupsTest-714793610 None] Created reservations ['0321c10f-7fe8-4c56-bf13-3d90664eb10c', '7f61b734-41fa-4980-bd61-beb28b4cf136', '7bb891da-ca5a-4f48-9509-aa5e37cb23fb', 'd6bbb304-a6ac-4476-944e-0814061dcf60'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:25:34 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-93685d7e-83af-4f6d-9112-ffb73af0f74f tempest-GroupsTest-714793610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:25:34 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-93685d7e-83af-4f6d-9112-ffb73af0f74f tempest-GroupsTest-714793610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:25:34 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-93685d7e-83af-4f6d-9112-ffb73af0f74f tempest-GroupsTest-714793610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:25:34 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-93685d7e-83af-4f6d-9112-ffb73af0f74f tempest-GroupsTest-714793610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:25:34 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-93685d7e-83af-4f6d-9112-ffb73af0f74f tempest-GroupsTest-714793610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:25:34 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-93685d7e-83af-4f6d-9112-ffb73af0f74f tempest-GroupsTest-714793610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:25:34 devstack sudo[96860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:25:34 devstack sudo[96860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:25:35 devstack sudo[96860]: pam_unix(sudo:session): session closed for user root Sep 16 20:25:35 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-93685d7e-83af-4f6d-9112-ffb73af0f74f tempest-GroupsTest-714793610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.345s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:25:35 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-93685d7e-83af-4f6d-9112-ffb73af0f74f tempest-GroupsTest-714793610 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:25:35 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-93685d7e-83af-4f6d-9112-ffb73af0f74f tempest-GroupsTest-714793610 None] Delete group completed successfully. Sep 16 20:25:35 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-b58d822c-7ae6-4632-8f2f-ee89bf4e252a tempest-GroupsTest-714793610 None] Created reservations ['e391e9f8-68c7-47c0-a57b-607cf2f49707'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:25:36 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-b58d822c-7ae6-4632-8f2f-ee89bf4e252a tempest-GroupsTest-714793610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:25:36 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-b58d822c-7ae6-4632-8f2f-ee89bf4e252a tempest-GroupsTest-714793610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:25:36 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-b58d822c-7ae6-4632-8f2f-ee89bf4e252a tempest-GroupsTest-714793610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:25:36 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-b58d822c-7ae6-4632-8f2f-ee89bf4e252a tempest-GroupsTest-714793610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:25:36 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-b58d822c-7ae6-4632-8f2f-ee89bf4e252a tempest-GroupsTest-714793610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:25:36 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b58d822c-7ae6-4632-8f2f-ee89bf4e252a tempest-GroupsTest-714793610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:25:36 devstack sudo[96863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:25:36 devstack sudo[96863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:25:36 devstack sudo[96863]: pam_unix(sudo:session): session closed for user root Sep 16 20:25:36 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b58d822c-7ae6-4632-8f2f-ee89bf4e252a tempest-GroupsTest-714793610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.308s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:25:36 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-b58d822c-7ae6-4632-8f2f-ee89bf4e252a tempest-GroupsTest-714793610 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:25:36 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-b58d822c-7ae6-4632-8f2f-ee89bf4e252a tempest-GroupsTest-714793610 None] Delete group completed successfully. Sep 16 20:25:37 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-1e6ea2d6-2b69-40d3-881f-7d31888a753a tempest-GroupsTest-714793610 None] Group tempest-GroupsTest-Group-1124885733: creating Sep 16 20:25:37 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-1e6ea2d6-2b69-40d3-881f-7d31888a753a tempest-GroupsTest-714793610 None] Group tempest-GroupsTest-Group-1124885733: created successfully Sep 16 20:25:37 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-1e6ea2d6-2b69-40d3-881f-7d31888a753a tempest-GroupsTest-714793610 None] Create group completed successfully. Sep 16 20:25:40 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-24413e81-0547-4436-b67f-edda50519f4f tempest-GroupsTest-714793610 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:25:40 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-24413e81-0547-4436-b67f-edda50519f4f tempest-GroupsTest-714793610 None] Flow 'volume_create_manager' (129dd3d8-d893-442e-8d6c-476b657c031c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:25:40 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-24413e81-0547-4436-b67f-edda50519f4f tempest-GroupsTest-714793610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (589cb49d-827c-4437-bc45-ed756f3200e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:25:40 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-24413e81-0547-4436-b67f-edda50519f4f tempest-GroupsTest-714793610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (589cb49d-827c-4437-bc45-ed756f3200e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:25:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1262857082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=17d21fd7-020b-4535-b7e9-2f7a58ce523b,host='devstack@QuobyteHD#QuobyteHD',id=364c20ab-8d71-49a6-8ce9-5ced417c2bd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c761b58affe14292bf30617ba5cd0435',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:25:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:25:40Z,use_quota=True,user_id='8bc8f80d661e41d996bcc4b1ccf0a2ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca75ec3e-2f0c-4cd4-b312-426355577a0e),volume_type_id=ca75ec3e-2f0c-4cd4-b312-426355577a0e)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:25:40 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-24413e81-0547-4436-b67f-edda50519f4f tempest-GroupsTest-714793610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a87cdc2-8587-424d-8a51-717bfac6beb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:25:40 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-24413e81-0547-4436-b67f-edda50519f4f tempest-GroupsTest-714793610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a87cdc2-8587-424d-8a51-717bfac6beb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:25:40 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-24413e81-0547-4436-b67f-edda50519f4f tempest-GroupsTest-714793610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86012f06-a721-4ea5-a8bf-5512ccc672e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:25:40 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-24413e81-0547-4436-b67f-edda50519f4f tempest-GroupsTest-714793610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86012f06-a721-4ea5-a8bf-5512ccc672e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '364c20ab-8d71-49a6-8ce9-5ced417c2bd7', 'volume_name': 'volume-364c20ab-8d71-49a6-8ce9-5ced417c2bd7', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:25:40 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-24413e81-0547-4436-b67f-edda50519f4f tempest-GroupsTest-714793610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87841c0f-433a-4beb-8505-8491813f49a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:25:40 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-24413e81-0547-4436-b67f-edda50519f4f tempest-GroupsTest-714793610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87841c0f-433a-4beb-8505-8491813f49a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:25:40 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-24413e81-0547-4436-b67f-edda50519f4f tempest-GroupsTest-714793610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05379849-73d8-4598-bcb2-824c66c5a551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:25:40 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-24413e81-0547-4436-b67f-edda50519f4f tempest-GroupsTest-714793610 None] Volume 364c20ab-8d71-49a6-8ce9-5ced417c2bd7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-364c20ab-8d71-49a6-8ce9-5ced417c2bd7', 'volume_size': 1} Sep 16 20:25:40 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-24413e81-0547-4436-b67f-edda50519f4f tempest-GroupsTest-714793610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:25:40 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-24413e81-0547-4436-b67f-edda50519f4f tempest-GroupsTest-714793610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:25:40 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-24413e81-0547-4436-b67f-edda50519f4f tempest-GroupsTest-714793610 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=17d21fd7-020b-4535-b7e9-2f7a58ce523b,created_at=2026-09-16T18:25:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1262857082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=17d21fd7-020b-4535-b7e9-2f7a58ce523b,host='devstack@QuobyteHD#QuobyteHD',id=364c20ab-8d71-49a6-8ce9-5ced417c2bd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c761b58affe14292bf30617ba5cd0435',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:25:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:25:40Z,use_quota=True,user_id='8bc8f80d661e41d996bcc4b1ccf0a2ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca75ec3e-2f0c-4cd4-b312-426355577a0e),volume_type_id=ca75ec3e-2f0c-4cd4-b312-426355577a0e)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:25:40 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-24413e81-0547-4436-b67f-edda50519f4f tempest-GroupsTest-714793610 None] Creating volume 364c20ab-8d71-49a6-8ce9-5ced417c2bd7 {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:25:40 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-24413e81-0547-4436-b67f-edda50519f4f tempest-GroupsTest-714793610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:25:40 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-24413e81-0547-4436-b67f-edda50519f4f tempest-GroupsTest-714793610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:25:40 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-24413e81-0547-4436-b67f-edda50519f4f tempest-GroupsTest-714793610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:25:40 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-24413e81-0547-4436-b67f-edda50519f4f tempest-GroupsTest-714793610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:25:40 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-24413e81-0547-4436-b67f-edda50519f4f tempest-GroupsTest-714793610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:25:40 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-24413e81-0547-4436-b67f-edda50519f4f tempest-GroupsTest-714793610 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:25:40 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-24413e81-0547-4436-b67f-edda50519f4f tempest-GroupsTest-714793610 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:25:40 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-24413e81-0547-4436-b67f-edda50519f4f tempest-GroupsTest-714793610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-364c20ab-8d71-49a6-8ce9-5ced417c2bd7 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:25:40 devstack sudo[96920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-364c20ab-8d71-49a6-8ce9-5ced417c2bd7 1073741824 Sep 16 20:25:40 devstack sudo[96920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:25:40 devstack sudo[96920]: pam_unix(sudo:session): session closed for user root Sep 16 20:25:40 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-24413e81-0547-4436-b67f-edda50519f4f tempest-GroupsTest-714793610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-364c20ab-8d71-49a6-8ce9-5ced417c2bd7 1073741824" returned: 0 in 0.626s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:25:40 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-24413e81-0547-4436-b67f-edda50519f4f tempest-GroupsTest-714793610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-364c20ab-8d71-49a6-8ce9-5ced417c2bd7 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:25:40 devstack sudo[96926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-364c20ab-8d71-49a6-8ce9-5ced417c2bd7 Sep 16 20:25:40 devstack sudo[96926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:25:41 devstack sudo[96926]: pam_unix(sudo:session): session closed for user root Sep 16 20:25:41 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-24413e81-0547-4436-b67f-edda50519f4f tempest-GroupsTest-714793610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-364c20ab-8d71-49a6-8ce9-5ced417c2bd7" returned: 0 in 0.513s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:25:41 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-24413e81-0547-4436-b67f-edda50519f4f tempest-GroupsTest-714793610 None] <== create_volume: return (1205ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:25:41 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-24413e81-0547-4436-b67f-edda50519f4f tempest-GroupsTest-714793610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.212s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:25:41 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-24413e81-0547-4436-b67f-edda50519f4f tempest-GroupsTest-714793610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05379849-73d8-4598-bcb2-824c66c5a551) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-364c20ab-8d71-49a6-8ce9-5ced417c2bd7', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:25:41 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-24413e81-0547-4436-b67f-edda50519f4f tempest-GroupsTest-714793610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (391680a7-c5ad-4ee2-9b77-7d0fdbdf615c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:25:41 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-24413e81-0547-4436-b67f-edda50519f4f tempest-GroupsTest-714793610 None] Volume volume-364c20ab-8d71-49a6-8ce9-5ced417c2bd7 (364c20ab-8d71-49a6-8ce9-5ced417c2bd7): created successfully Sep 16 20:25:41 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-24413e81-0547-4436-b67f-edda50519f4f tempest-GroupsTest-714793610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (391680a7-c5ad-4ee2-9b77-7d0fdbdf615c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:25:41 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-24413e81-0547-4436-b67f-edda50519f4f tempest-GroupsTest-714793610 None] Flow 'volume_create_manager' (129dd3d8-d893-442e-8d6c-476b657c031c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:25:41 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-24413e81-0547-4436-b67f-edda50519f4f tempest-GroupsTest-714793610 None] Created volume successfully. Sep 16 20:25:43 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-0075e170-260f-4b90-8ff8-8440aae70050 tempest-GroupsTest-714793610 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:25:43 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-0075e170-260f-4b90-8ff8-8440aae70050 tempest-GroupsTest-714793610 None] Flow 'volume_create_manager' (4d5fa947-1923-4a3a-aa5f-b6acae652a08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:25:43 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-0075e170-260f-4b90-8ff8-8440aae70050 tempest-GroupsTest-714793610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e6719be-9dee-4dbc-a470-e1af2d44b64d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:25:43 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-0075e170-260f-4b90-8ff8-8440aae70050 tempest-GroupsTest-714793610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e6719be-9dee-4dbc-a470-e1af2d44b64d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:25:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-458924479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=17d21fd7-020b-4535-b7e9-2f7a58ce523b,host='devstack@QuobyteHD#QuobyteHD',id=fcf5c3af-4038-4922-973d-b8173d3588dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c761b58affe14292bf30617ba5cd0435',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:25:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:25:43Z,use_quota=True,user_id='8bc8f80d661e41d996bcc4b1ccf0a2ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca75ec3e-2f0c-4cd4-b312-426355577a0e),volume_type_id=ca75ec3e-2f0c-4cd4-b312-426355577a0e)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:25:43 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-0075e170-260f-4b90-8ff8-8440aae70050 tempest-GroupsTest-714793610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dab5b024-42a8-4cd3-8929-1fbf37868bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:25:43 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-0075e170-260f-4b90-8ff8-8440aae70050 tempest-GroupsTest-714793610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dab5b024-42a8-4cd3-8929-1fbf37868bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:25:43 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-0075e170-260f-4b90-8ff8-8440aae70050 tempest-GroupsTest-714793610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b17ab31-464b-4c1a-adce-a110dca83287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:25:43 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-0075e170-260f-4b90-8ff8-8440aae70050 tempest-GroupsTest-714793610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b17ab31-464b-4c1a-adce-a110dca83287) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fcf5c3af-4038-4922-973d-b8173d3588dd', 'volume_name': 'volume-fcf5c3af-4038-4922-973d-b8173d3588dd', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:25:43 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-0075e170-260f-4b90-8ff8-8440aae70050 tempest-GroupsTest-714793610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51317e5d-3cfa-41b3-b605-cda7bff4e846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:25:43 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-0075e170-260f-4b90-8ff8-8440aae70050 tempest-GroupsTest-714793610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51317e5d-3cfa-41b3-b605-cda7bff4e846) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:25:43 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-0075e170-260f-4b90-8ff8-8440aae70050 tempest-GroupsTest-714793610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f252128e-3b90-4ed6-9a1a-bf2490614a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:25:43 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-0075e170-260f-4b90-8ff8-8440aae70050 tempest-GroupsTest-714793610 None] Volume fcf5c3af-4038-4922-973d-b8173d3588dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fcf5c3af-4038-4922-973d-b8173d3588dd', 'volume_size': 1} Sep 16 20:25:43 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-0075e170-260f-4b90-8ff8-8440aae70050 tempest-GroupsTest-714793610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:25:43 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-0075e170-260f-4b90-8ff8-8440aae70050 tempest-GroupsTest-714793610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:25:43 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-0075e170-260f-4b90-8ff8-8440aae70050 tempest-GroupsTest-714793610 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=17d21fd7-020b-4535-b7e9-2f7a58ce523b,created_at=2026-09-16T18:25:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-458924479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=17d21fd7-020b-4535-b7e9-2f7a58ce523b,host='devstack@QuobyteHD#QuobyteHD',id=fcf5c3af-4038-4922-973d-b8173d3588dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c761b58affe14292bf30617ba5cd0435',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:25:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:25:43Z,use_quota=True,user_id='8bc8f80d661e41d996bcc4b1ccf0a2ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca75ec3e-2f0c-4cd4-b312-426355577a0e),volume_type_id=ca75ec3e-2f0c-4cd4-b312-426355577a0e)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:25:43 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-0075e170-260f-4b90-8ff8-8440aae70050 tempest-GroupsTest-714793610 None] Creating volume fcf5c3af-4038-4922-973d-b8173d3588dd {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:25:43 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-0075e170-260f-4b90-8ff8-8440aae70050 tempest-GroupsTest-714793610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:25:43 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-0075e170-260f-4b90-8ff8-8440aae70050 tempest-GroupsTest-714793610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:25:43 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-0075e170-260f-4b90-8ff8-8440aae70050 tempest-GroupsTest-714793610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:25:43 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-0075e170-260f-4b90-8ff8-8440aae70050 tempest-GroupsTest-714793610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:25:43 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-0075e170-260f-4b90-8ff8-8440aae70050 tempest-GroupsTest-714793610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:25:43 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-0075e170-260f-4b90-8ff8-8440aae70050 tempest-GroupsTest-714793610 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:25:43 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-0075e170-260f-4b90-8ff8-8440aae70050 tempest-GroupsTest-714793610 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:25:43 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-0075e170-260f-4b90-8ff8-8440aae70050 tempest-GroupsTest-714793610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-fcf5c3af-4038-4922-973d-b8173d3588dd 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:25:43 devstack sudo[96929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-fcf5c3af-4038-4922-973d-b8173d3588dd 1073741824 Sep 16 20:25:43 devstack sudo[96929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:25:44 devstack sudo[96929]: pam_unix(sudo:session): session closed for user root Sep 16 20:25:44 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-0075e170-260f-4b90-8ff8-8440aae70050 tempest-GroupsTest-714793610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-fcf5c3af-4038-4922-973d-b8173d3588dd 1073741824" returned: 0 in 0.648s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:25:44 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-0075e170-260f-4b90-8ff8-8440aae70050 tempest-GroupsTest-714793610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-fcf5c3af-4038-4922-973d-b8173d3588dd {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:25:44 devstack sudo[96935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-fcf5c3af-4038-4922-973d-b8173d3588dd Sep 16 20:25:44 devstack sudo[96935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:25:44 devstack sudo[96935]: pam_unix(sudo:session): session closed for user root Sep 16 20:25:44 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-0075e170-260f-4b90-8ff8-8440aae70050 tempest-GroupsTest-714793610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-fcf5c3af-4038-4922-973d-b8173d3588dd" returned: 0 in 0.328s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:25:44 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-0075e170-260f-4b90-8ff8-8440aae70050 tempest-GroupsTest-714793610 None] <== create_volume: return (1039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:25:44 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-0075e170-260f-4b90-8ff8-8440aae70050 tempest-GroupsTest-714793610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.042s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:25:44 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-0075e170-260f-4b90-8ff8-8440aae70050 tempest-GroupsTest-714793610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f252128e-3b90-4ed6-9a1a-bf2490614a48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fcf5c3af-4038-4922-973d-b8173d3588dd', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:25:44 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-0075e170-260f-4b90-8ff8-8440aae70050 tempest-GroupsTest-714793610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c72edafe-fbb2-46bc-be2f-5361ebdc251d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:25:44 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-0075e170-260f-4b90-8ff8-8440aae70050 tempest-GroupsTest-714793610 None] Volume volume-fcf5c3af-4038-4922-973d-b8173d3588dd (fcf5c3af-4038-4922-973d-b8173d3588dd): created successfully Sep 16 20:25:44 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-0075e170-260f-4b90-8ff8-8440aae70050 tempest-GroupsTest-714793610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c72edafe-fbb2-46bc-be2f-5361ebdc251d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:25:44 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-0075e170-260f-4b90-8ff8-8440aae70050 tempest-GroupsTest-714793610 None] Flow 'volume_create_manager' (4d5fa947-1923-4a3a-aa5f-b6acae652a08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:25:44 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-0075e170-260f-4b90-8ff8-8440aae70050 tempest-GroupsTest-714793610 None] Created volume successfully. Sep 16 20:25:46 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-0295c450-62e8-42f3-8102-d11e4727a609 tempest-GroupsTest-714793610 None] Update group completed successfully. Sep 16 20:25:47 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-b8891640-b72f-4840-a9e1-793b3aa1a9c5 tempest-GroupsTest-714793610 None] Update group completed successfully. Sep 16 20:25:49 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-4af2905f-398c-4de4-962b-cec7b818bfc5 tempest-GroupsTest-714793610 None] Acquiring lock "cinder-quobyte-364c20ab-8d71-49a6-8ce9-5ced417c2bd7" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:25:49 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-4af2905f-398c-4de4-962b-cec7b818bfc5 tempest-GroupsTest-714793610 None] Lock "cinder-quobyte-364c20ab-8d71-49a6-8ce9-5ced417c2bd7" acquired by "delete_volume" :: waited 0.044s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:25:49 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[9255f396-6123-4ace-8c23-c9b00944e7ad]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:25:49 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-4af2905f-398c-4de4-962b-cec7b818bfc5 tempest-GroupsTest-714793610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-364c20ab-8d71-49a6-8ce9-5ced417c2bd7 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:25:50 devstack sudo[96939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-364c20ab-8d71-49a6-8ce9-5ced417c2bd7 Sep 16 20:25:50 devstack sudo[96939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:25:50 devstack sudo[96939]: pam_unix(sudo:session): session closed for user root Sep 16 20:25:50 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-4af2905f-398c-4de4-962b-cec7b818bfc5 tempest-GroupsTest-714793610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-364c20ab-8d71-49a6-8ce9-5ced417c2bd7" returned: 0 in 0.635s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:25:50 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-4af2905f-398c-4de4-962b-cec7b818bfc5 tempest-GroupsTest-714793610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-364c20ab-8d71-49a6-8ce9-5ced417c2bd7 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:25:50 devstack sudo[96944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-364c20ab-8d71-49a6-8ce9-5ced417c2bd7 Sep 16 20:25:50 devstack sudo[96944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:25:50 devstack sudo[96944]: pam_unix(sudo:session): session closed for user root Sep 16 20:25:50 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-4af2905f-398c-4de4-962b-cec7b818bfc5 tempest-GroupsTest-714793610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-364c20ab-8d71-49a6-8ce9-5ced417c2bd7" returned: 0 in 0.375s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:25:50 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-4af2905f-398c-4de4-962b-cec7b818bfc5 tempest-GroupsTest-714793610 None] Lock "cinder-quobyte-364c20ab-8d71-49a6-8ce9-5ced417c2bd7" released by "delete_volume" :: held 1.089s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:25:50 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-4af2905f-398c-4de4-962b-cec7b818bfc5 tempest-GroupsTest-714793610 None] Acquiring lock "cinder-quobyte-fcf5c3af-4038-4922-973d-b8173d3588dd" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:25:50 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-4af2905f-398c-4de4-962b-cec7b818bfc5 tempest-GroupsTest-714793610 None] Lock "cinder-quobyte-fcf5c3af-4038-4922-973d-b8173d3588dd" acquired by "delete_volume" :: waited 0.018s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:25:50 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[7886e9f3-8f7d-4393-a08a-a961b36b979d]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:25:50 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-4af2905f-398c-4de4-962b-cec7b818bfc5 tempest-GroupsTest-714793610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-fcf5c3af-4038-4922-973d-b8173d3588dd {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:25:51 devstack sudo[96947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-fcf5c3af-4038-4922-973d-b8173d3588dd Sep 16 20:25:51 devstack sudo[96947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:25:51 devstack sudo[96947]: pam_unix(sudo:session): session closed for user root Sep 16 20:25:51 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-4af2905f-398c-4de4-962b-cec7b818bfc5 tempest-GroupsTest-714793610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-fcf5c3af-4038-4922-973d-b8173d3588dd" returned: 0 in 0.624s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:25:51 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-4af2905f-398c-4de4-962b-cec7b818bfc5 tempest-GroupsTest-714793610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-fcf5c3af-4038-4922-973d-b8173d3588dd {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:25:51 devstack sudo[96952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-fcf5c3af-4038-4922-973d-b8173d3588dd Sep 16 20:25:51 devstack sudo[96952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:25:51 devstack sudo[96952]: pam_unix(sudo:session): session closed for user root Sep 16 20:25:51 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-4af2905f-398c-4de4-962b-cec7b818bfc5 tempest-GroupsTest-714793610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-fcf5c3af-4038-4922-973d-b8173d3588dd" returned: 0 in 0.375s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:25:51 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-4af2905f-398c-4de4-962b-cec7b818bfc5 tempest-GroupsTest-714793610 None] Lock "cinder-quobyte-fcf5c3af-4038-4922-973d-b8173d3588dd" released by "delete_volume" :: held 1.061s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:25:52 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-4af2905f-398c-4de4-962b-cec7b818bfc5 tempest-GroupsTest-714793610 None] Created reservations ['23a75291-3ee2-42b9-ad90-17217ab1b000'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:25:52 devstack cinder-volume[86188]: WARNING cinder.quota [None req-4af2905f-398c-4de4-962b-cec7b818bfc5 tempest-GroupsTest-714793610 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-848894909 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-848894909, it is now deprecated. Please use the default quota class for default quota. Sep 16 20:25:52 devstack cinder-volume[86188]: WARNING cinder.quota [None req-4af2905f-398c-4de4-962b-cec7b818bfc5 tempest-GroupsTest-714793610 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-848894909 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-848894909, it is now deprecated. Please use the default quota class for default quota. Sep 16 20:25:52 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-4af2905f-398c-4de4-962b-cec7b818bfc5 tempest-GroupsTest-714793610 None] Created reservations ['507c846b-aa77-466a-83a1-7f65d090d73a', '3a5db970-bf08-4352-9a37-a62856db91e3', '30a8a589-a5fd-408c-b34a-821b9526680b', 'a4f57ba5-ab1a-4fa6-8c08-1f796ecbb2ca'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:25:52 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-4af2905f-398c-4de4-962b-cec7b818bfc5 tempest-GroupsTest-714793610 None] Created reservations ['32408269-2ac2-4951-a3b6-d7f67db30b66', '0358ff49-7654-431b-9ced-b3b516d5f6aa', '5924460b-6c17-4b39-b616-442d5c3d655e', '1b8e4d8d-ad4e-4994-b139-0e6950ad3f39'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:25:52 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-4af2905f-398c-4de4-962b-cec7b818bfc5 tempest-GroupsTest-714793610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:25:52 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-4af2905f-398c-4de4-962b-cec7b818bfc5 tempest-GroupsTest-714793610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:25:52 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-4af2905f-398c-4de4-962b-cec7b818bfc5 tempest-GroupsTest-714793610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:25:52 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-4af2905f-398c-4de4-962b-cec7b818bfc5 tempest-GroupsTest-714793610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:25:52 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-4af2905f-398c-4de4-962b-cec7b818bfc5 tempest-GroupsTest-714793610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:25:52 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-4af2905f-398c-4de4-962b-cec7b818bfc5 tempest-GroupsTest-714793610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:25:52 devstack sudo[96957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:25:52 devstack sudo[96957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:25:52 devstack sudo[96957]: pam_unix(sudo:session): session closed for user root Sep 16 20:25:52 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-4af2905f-398c-4de4-962b-cec7b818bfc5 tempest-GroupsTest-714793610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.394s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:25:52 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-4af2905f-398c-4de4-962b-cec7b818bfc5 tempest-GroupsTest-714793610 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:25:52 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-4af2905f-398c-4de4-962b-cec7b818bfc5 tempest-GroupsTest-714793610 None] Delete group completed successfully. Sep 16 20:25:52 devstack cinder-volume[86188]: DEBUG oslo_service.periodic_task [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86188) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 20:25:52 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:25:52 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:25:52 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:25:53 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:25:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:25:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:25:53 devstack sudo[96960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:25:53 devstack sudo[96960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:25:53 devstack sudo[96960]: pam_unix(sudo:session): session closed for user root Sep 16 20:25:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.319s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:25:53 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:25:53 devstack cinder-volume[86188]: DEBUG oslo_service.periodic_task [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Running periodic task VolumeManager._thread_info {{(pid=86188) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 20:25:53 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] thread count: 28 {{(pid=86188) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 16 20:25:53 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] thread info: [<_MainThread(MainThread, started 139858124406912)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86188) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 16 20:25:56 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-27e96448-291c-4b03-8dc1-49be459c8295 tempest-VolumesServicesTestJSON-1023920716 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:25:56 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-27e96448-291c-4b03-8dc1-49be459c8295 tempest-VolumesServicesTestJSON-1023920716 None] Flow 'volume_create_manager' (d1a1f87f-a17f-412c-86b1-c53bd69b25df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:25:56 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-27e96448-291c-4b03-8dc1-49be459c8295 tempest-VolumesServicesTestJSON-1023920716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4edb5c7-4c19-4a90-aa03-e17c0ce6bda3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:25:56 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-27e96448-291c-4b03-8dc1-49be459c8295 tempest-VolumesServicesTestJSON-1023920716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4edb5c7-4c19-4a90-aa03-e17c0ce6bda3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:25:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1181807396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=349b3d6a-8a3e-4cb8-b6b9-de07605b9312,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d11f2f0abaf45d9b1d7acf5171f13fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:25:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:25:56Z,use_quota=True,user_id='6153a2d60a4e44c0855d07ec84205f53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:25:56 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-27e96448-291c-4b03-8dc1-49be459c8295 tempest-VolumesServicesTestJSON-1023920716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (380fc4e7-7e13-4611-8c05-571ce0242460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:25:56 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-27e96448-291c-4b03-8dc1-49be459c8295 tempest-VolumesServicesTestJSON-1023920716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (380fc4e7-7e13-4611-8c05-571ce0242460) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:25:56 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-27e96448-291c-4b03-8dc1-49be459c8295 tempest-VolumesServicesTestJSON-1023920716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6720c11-8b4b-4f69-94e7-2d9277e02d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:25:56 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-27e96448-291c-4b03-8dc1-49be459c8295 tempest-VolumesServicesTestJSON-1023920716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6720c11-8b4b-4f69-94e7-2d9277e02d4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '349b3d6a-8a3e-4cb8-b6b9-de07605b9312', 'volume_name': 'volume-349b3d6a-8a3e-4cb8-b6b9-de07605b9312', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:25:56 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-27e96448-291c-4b03-8dc1-49be459c8295 tempest-VolumesServicesTestJSON-1023920716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d81ea67-270d-47a9-8208-a91b2cae3a7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:25:56 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-27e96448-291c-4b03-8dc1-49be459c8295 tempest-VolumesServicesTestJSON-1023920716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d81ea67-270d-47a9-8208-a91b2cae3a7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:25:56 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-27e96448-291c-4b03-8dc1-49be459c8295 tempest-VolumesServicesTestJSON-1023920716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7731cde3-4c3d-4441-9aa3-b78efadc7340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:25:56 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-27e96448-291c-4b03-8dc1-49be459c8295 tempest-VolumesServicesTestJSON-1023920716 None] Volume 349b3d6a-8a3e-4cb8-b6b9-de07605b9312: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-349b3d6a-8a3e-4cb8-b6b9-de07605b9312', 'volume_size': 1} Sep 16 20:25:56 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-27e96448-291c-4b03-8dc1-49be459c8295 tempest-VolumesServicesTestJSON-1023920716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:25:56 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-27e96448-291c-4b03-8dc1-49be459c8295 tempest-VolumesServicesTestJSON-1023920716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:25:56 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-27e96448-291c-4b03-8dc1-49be459c8295 tempest-VolumesServicesTestJSON-1023920716 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:25:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1181807396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=349b3d6a-8a3e-4cb8-b6b9-de07605b9312,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d11f2f0abaf45d9b1d7acf5171f13fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:25:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:25:56Z,use_quota=True,user_id='6153a2d60a4e44c0855d07ec84205f53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:25:56 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-27e96448-291c-4b03-8dc1-49be459c8295 tempest-VolumesServicesTestJSON-1023920716 None] Creating volume 349b3d6a-8a3e-4cb8-b6b9-de07605b9312 {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:25:56 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-27e96448-291c-4b03-8dc1-49be459c8295 tempest-VolumesServicesTestJSON-1023920716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:25:56 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-27e96448-291c-4b03-8dc1-49be459c8295 tempest-VolumesServicesTestJSON-1023920716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:25:56 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-27e96448-291c-4b03-8dc1-49be459c8295 tempest-VolumesServicesTestJSON-1023920716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:25:56 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-27e96448-291c-4b03-8dc1-49be459c8295 tempest-VolumesServicesTestJSON-1023920716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:25:56 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-27e96448-291c-4b03-8dc1-49be459c8295 tempest-VolumesServicesTestJSON-1023920716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:25:56 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-27e96448-291c-4b03-8dc1-49be459c8295 tempest-VolumesServicesTestJSON-1023920716 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:25:56 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-27e96448-291c-4b03-8dc1-49be459c8295 tempest-VolumesServicesTestJSON-1023920716 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:25:56 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-27e96448-291c-4b03-8dc1-49be459c8295 tempest-VolumesServicesTestJSON-1023920716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-349b3d6a-8a3e-4cb8-b6b9-de07605b9312 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:25:56 devstack sudo[97002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-349b3d6a-8a3e-4cb8-b6b9-de07605b9312 1073741824 Sep 16 20:25:56 devstack sudo[97002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:25:56 devstack sudo[97002]: pam_unix(sudo:session): session closed for user root Sep 16 20:25:56 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-27e96448-291c-4b03-8dc1-49be459c8295 tempest-VolumesServicesTestJSON-1023920716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-349b3d6a-8a3e-4cb8-b6b9-de07605b9312 1073741824" returned: 0 in 0.545s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:25:56 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-27e96448-291c-4b03-8dc1-49be459c8295 tempest-VolumesServicesTestJSON-1023920716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-349b3d6a-8a3e-4cb8-b6b9-de07605b9312 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:25:56 devstack sudo[97008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-349b3d6a-8a3e-4cb8-b6b9-de07605b9312 Sep 16 20:25:56 devstack sudo[97008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:25:57 devstack sudo[97008]: pam_unix(sudo:session): session closed for user root Sep 16 20:25:57 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-27e96448-291c-4b03-8dc1-49be459c8295 tempest-VolumesServicesTestJSON-1023920716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-349b3d6a-8a3e-4cb8-b6b9-de07605b9312" returned: 0 in 0.282s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:25:57 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-27e96448-291c-4b03-8dc1-49be459c8295 tempest-VolumesServicesTestJSON-1023920716 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:25:57 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-27e96448-291c-4b03-8dc1-49be459c8295 tempest-VolumesServicesTestJSON-1023920716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:25:57 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-27e96448-291c-4b03-8dc1-49be459c8295 tempest-VolumesServicesTestJSON-1023920716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7731cde3-4c3d-4441-9aa3-b78efadc7340) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-349b3d6a-8a3e-4cb8-b6b9-de07605b9312', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:25:57 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-27e96448-291c-4b03-8dc1-49be459c8295 tempest-VolumesServicesTestJSON-1023920716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8bddd70-9978-4923-a90f-94d4a97515ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:25:57 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-27e96448-291c-4b03-8dc1-49be459c8295 tempest-VolumesServicesTestJSON-1023920716 None] Volume volume-349b3d6a-8a3e-4cb8-b6b9-de07605b9312 (349b3d6a-8a3e-4cb8-b6b9-de07605b9312): created successfully Sep 16 20:25:57 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-27e96448-291c-4b03-8dc1-49be459c8295 tempest-VolumesServicesTestJSON-1023920716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8bddd70-9978-4923-a90f-94d4a97515ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:25:57 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-27e96448-291c-4b03-8dc1-49be459c8295 tempest-VolumesServicesTestJSON-1023920716 None] Flow 'volume_create_manager' (d1a1f87f-a17f-412c-86b1-c53bd69b25df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:25:57 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-27e96448-291c-4b03-8dc1-49be459c8295 tempest-VolumesServicesTestJSON-1023920716 None] Created volume successfully. Sep 16 20:25:58 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-53c0f274-6685-4ab6-ac1b-25b85bfde099 tempest-VolumesServicesTestJSON-1023920716 None] Acquiring lock "cinder-349b3d6a-8a3e-4cb8-b6b9-de07605b9312-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:25:58 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-53c0f274-6685-4ab6-ac1b-25b85bfde099 tempest-VolumesServicesTestJSON-1023920716 None] Lock "cinder-349b3d6a-8a3e-4cb8-b6b9-de07605b9312-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:25:58 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-53c0f274-6685-4ab6-ac1b-25b85bfde099 tempest-VolumesServicesTestJSON-1023920716 None] Acquiring lock "cinder-quobyte-349b3d6a-8a3e-4cb8-b6b9-de07605b9312" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:25:58 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-53c0f274-6685-4ab6-ac1b-25b85bfde099 tempest-VolumesServicesTestJSON-1023920716 None] Lock "cinder-quobyte-349b3d6a-8a3e-4cb8-b6b9-de07605b9312" acquired by "delete_volume" :: waited 0.019s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:25:58 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[25a31815-8a2c-4327-930e-c3c31513da6a]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:25:58 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-53c0f274-6685-4ab6-ac1b-25b85bfde099 tempest-VolumesServicesTestJSON-1023920716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-349b3d6a-8a3e-4cb8-b6b9-de07605b9312 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:25:58 devstack sudo[97028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-349b3d6a-8a3e-4cb8-b6b9-de07605b9312 Sep 16 20:25:58 devstack sudo[97028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:25:59 devstack sudo[97028]: pam_unix(sudo:session): session closed for user root Sep 16 20:25:59 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-53c0f274-6685-4ab6-ac1b-25b85bfde099 tempest-VolumesServicesTestJSON-1023920716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-349b3d6a-8a3e-4cb8-b6b9-de07605b9312" returned: 0 in 0.487s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:25:59 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-53c0f274-6685-4ab6-ac1b-25b85bfde099 tempest-VolumesServicesTestJSON-1023920716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-349b3d6a-8a3e-4cb8-b6b9-de07605b9312 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:25:59 devstack sudo[97034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-349b3d6a-8a3e-4cb8-b6b9-de07605b9312 Sep 16 20:25:59 devstack sudo[97034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:25:59 devstack sudo[97034]: pam_unix(sudo:session): session closed for user root Sep 16 20:25:59 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-53c0f274-6685-4ab6-ac1b-25b85bfde099 tempest-VolumesServicesTestJSON-1023920716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-349b3d6a-8a3e-4cb8-b6b9-de07605b9312" returned: 0 in 0.362s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:25:59 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-53c0f274-6685-4ab6-ac1b-25b85bfde099 tempest-VolumesServicesTestJSON-1023920716 None] Lock "cinder-quobyte-349b3d6a-8a3e-4cb8-b6b9-de07605b9312" released by "delete_volume" :: held 0.944s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:25:59 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-53c0f274-6685-4ab6-ac1b-25b85bfde099 tempest-VolumesServicesTestJSON-1023920716 None] Created reservations ['20184a73-f004-410f-b6a5-2a9734e5a9ae', '14389eaa-3ec0-4468-83ff-96ca7f9155d3', '5398bab6-483c-4779-bb04-dd8c5d78c580', 'c4e850e1-3797-4814-8361-b6686b924061'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:25:59 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-53c0f274-6685-4ab6-ac1b-25b85bfde099 tempest-VolumesServicesTestJSON-1023920716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:25:59 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-53c0f274-6685-4ab6-ac1b-25b85bfde099 tempest-VolumesServicesTestJSON-1023920716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:25:59 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-53c0f274-6685-4ab6-ac1b-25b85bfde099 tempest-VolumesServicesTestJSON-1023920716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:25:59 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-53c0f274-6685-4ab6-ac1b-25b85bfde099 tempest-VolumesServicesTestJSON-1023920716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:25:59 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-53c0f274-6685-4ab6-ac1b-25b85bfde099 tempest-VolumesServicesTestJSON-1023920716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:25:59 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-53c0f274-6685-4ab6-ac1b-25b85bfde099 tempest-VolumesServicesTestJSON-1023920716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:25:59 devstack sudo[97038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:25:59 devstack sudo[97038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:00 devstack sudo[97038]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:00 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-53c0f274-6685-4ab6-ac1b-25b85bfde099 tempest-VolumesServicesTestJSON-1023920716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.528s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:00 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-53c0f274-6685-4ab6-ac1b-25b85bfde099 tempest-VolumesServicesTestJSON-1023920716 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:26:00 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-53c0f274-6685-4ab6-ac1b-25b85bfde099 tempest-VolumesServicesTestJSON-1023920716 None] Deleted volume successfully. Sep 16 20:26:00 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-53c0f274-6685-4ab6-ac1b-25b85bfde099 tempest-VolumesServicesTestJSON-1023920716 None] Lock "cinder-349b3d6a-8a3e-4cb8-b6b9-de07605b9312-delete_volume" released by "delete_volume" :: held 1.819s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:26:00 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-5f8a176b-41a6-489a-9301-665c02c74528 tempest-GroupsV314Test-1452032547 None] Group tempest-GroupsV314Test-Group-289885269: creating Sep 16 20:26:00 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-5f8a176b-41a6-489a-9301-665c02c74528 tempest-GroupsV314Test-1452032547 None] Group tempest-GroupsV314Test-Group-289885269: created successfully Sep 16 20:26:00 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-5f8a176b-41a6-489a-9301-665c02c74528 tempest-GroupsV314Test-1452032547 None] Create group completed successfully. Sep 16 20:26:02 devstack cinder-volume[86188]: DEBUG dbcounter [-] [86188] Writing DB stats cinder:SELECT=84,cinder:UPDATE=113,cinder:INSERT=24,cinder:DELETE=7 {{(pid=86188) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 20:26:02 devstack cinder-volume[86188]: DEBUG dbcounter [-] [86188] Writing DB stats cinder:UPDATE=96,cinder:SELECT=104,cinder:INSERT=19,cinder:DELETE=5 {{(pid=86188) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 20:26:02 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9d60606-8073-48e0-9f01-b7565fb4aa5c tempest-GroupsV314Test-1452032547 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:26:02 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e9d60606-8073-48e0-9f01-b7565fb4aa5c tempest-GroupsV314Test-1452032547 None] Flow 'volume_create_manager' (eb17bd7d-95d2-43ba-949b-491e4f33de14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:26:02 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e9d60606-8073-48e0-9f01-b7565fb4aa5c tempest-GroupsV314Test-1452032547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96b31ef1-e4f2-42b7-ab6d-0e4745a917ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:26:02 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e9d60606-8073-48e0-9f01-b7565fb4aa5c tempest-GroupsV314Test-1452032547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96b31ef1-e4f2-42b7-ab6d-0e4745a917ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:26:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-955534462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6ad29321-c033-4cf3-8bd1-222f9389f190,host='devstack@QuobyteHD#QuobyteHD',id=aec43cb4-601b-4c91-983c-b1fce9321852,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eacd79025c4c4976ae895c3202307106',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:26:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:26:03Z,use_quota=True,user_id='95d3d5baa72941cd9f1246b28456b3ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04346a49-b4d5-4d46-8f5f-1524e8a6b2bd),volume_type_id=04346a49-b4d5-4d46-8f5f-1524e8a6b2bd)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:26:02 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e9d60606-8073-48e0-9f01-b7565fb4aa5c tempest-GroupsV314Test-1452032547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (debb2cb9-54d6-4bb6-a803-469b3639f7c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:26:02 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e9d60606-8073-48e0-9f01-b7565fb4aa5c tempest-GroupsV314Test-1452032547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (debb2cb9-54d6-4bb6-a803-469b3639f7c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:26:02 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e9d60606-8073-48e0-9f01-b7565fb4aa5c tempest-GroupsV314Test-1452032547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99cb1fe0-70c9-4b51-b752-24ea2d4f53a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:26:02 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e9d60606-8073-48e0-9f01-b7565fb4aa5c tempest-GroupsV314Test-1452032547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99cb1fe0-70c9-4b51-b752-24ea2d4f53a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aec43cb4-601b-4c91-983c-b1fce9321852', 'volume_name': 'volume-aec43cb4-601b-4c91-983c-b1fce9321852', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:26:02 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e9d60606-8073-48e0-9f01-b7565fb4aa5c tempest-GroupsV314Test-1452032547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04fb84ec-9a8f-496f-9209-5b5ea973d3a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:26:02 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e9d60606-8073-48e0-9f01-b7565fb4aa5c tempest-GroupsV314Test-1452032547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04fb84ec-9a8f-496f-9209-5b5ea973d3a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:26:02 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e9d60606-8073-48e0-9f01-b7565fb4aa5c tempest-GroupsV314Test-1452032547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba83d44b-bbf4-4eec-826f-0e358a394984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:26:02 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-e9d60606-8073-48e0-9f01-b7565fb4aa5c tempest-GroupsV314Test-1452032547 None] Volume aec43cb4-601b-4c91-983c-b1fce9321852: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aec43cb4-601b-4c91-983c-b1fce9321852', 'volume_size': 1} Sep 16 20:26:02 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-e9d60606-8073-48e0-9f01-b7565fb4aa5c tempest-GroupsV314Test-1452032547 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:26:02 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-e9d60606-8073-48e0-9f01-b7565fb4aa5c tempest-GroupsV314Test-1452032547 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:26:02 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-e9d60606-8073-48e0-9f01-b7565fb4aa5c tempest-GroupsV314Test-1452032547 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6ad29321-c033-4cf3-8bd1-222f9389f190,created_at=2026-09-16T18:26:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-955534462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6ad29321-c033-4cf3-8bd1-222f9389f190,host='devstack@QuobyteHD#QuobyteHD',id=aec43cb4-601b-4c91-983c-b1fce9321852,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eacd79025c4c4976ae895c3202307106',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:26:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:26:03Z,use_quota=True,user_id='95d3d5baa72941cd9f1246b28456b3ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04346a49-b4d5-4d46-8f5f-1524e8a6b2bd),volume_type_id=04346a49-b4d5-4d46-8f5f-1524e8a6b2bd)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:26:02 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-e9d60606-8073-48e0-9f01-b7565fb4aa5c tempest-GroupsV314Test-1452032547 None] Creating volume aec43cb4-601b-4c91-983c-b1fce9321852 {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:26:02 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-e9d60606-8073-48e0-9f01-b7565fb4aa5c tempest-GroupsV314Test-1452032547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:26:02 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-e9d60606-8073-48e0-9f01-b7565fb4aa5c tempest-GroupsV314Test-1452032547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:26:02 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-e9d60606-8073-48e0-9f01-b7565fb4aa5c tempest-GroupsV314Test-1452032547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:26:02 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-e9d60606-8073-48e0-9f01-b7565fb4aa5c tempest-GroupsV314Test-1452032547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:26:02 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-e9d60606-8073-48e0-9f01-b7565fb4aa5c tempest-GroupsV314Test-1452032547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:26:02 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-e9d60606-8073-48e0-9f01-b7565fb4aa5c tempest-GroupsV314Test-1452032547 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:26:02 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-e9d60606-8073-48e0-9f01-b7565fb4aa5c tempest-GroupsV314Test-1452032547 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:26:02 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e9d60606-8073-48e0-9f01-b7565fb4aa5c tempest-GroupsV314Test-1452032547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-aec43cb4-601b-4c91-983c-b1fce9321852 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:02 devstack sudo[97113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-aec43cb4-601b-4c91-983c-b1fce9321852 1073741824 Sep 16 20:26:02 devstack sudo[97113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:03 devstack sudo[97113]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:03 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e9d60606-8073-48e0-9f01-b7565fb4aa5c tempest-GroupsV314Test-1452032547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-aec43cb4-601b-4c91-983c-b1fce9321852 1073741824" returned: 0 in 0.615s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:03 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e9d60606-8073-48e0-9f01-b7565fb4aa5c tempest-GroupsV314Test-1452032547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-aec43cb4-601b-4c91-983c-b1fce9321852 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:03 devstack sudo[97120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-aec43cb4-601b-4c91-983c-b1fce9321852 Sep 16 20:26:03 devstack sudo[97120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:04 devstack sudo[97120]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:04 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e9d60606-8073-48e0-9f01-b7565fb4aa5c tempest-GroupsV314Test-1452032547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-aec43cb4-601b-4c91-983c-b1fce9321852" returned: 0 in 0.591s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:04 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-e9d60606-8073-48e0-9f01-b7565fb4aa5c tempest-GroupsV314Test-1452032547 None] <== create_volume: return (1277ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:26:04 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-e9d60606-8073-48e0-9f01-b7565fb4aa5c tempest-GroupsV314Test-1452032547 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.281s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:26:04 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e9d60606-8073-48e0-9f01-b7565fb4aa5c tempest-GroupsV314Test-1452032547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba83d44b-bbf4-4eec-826f-0e358a394984) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aec43cb4-601b-4c91-983c-b1fce9321852', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:26:04 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e9d60606-8073-48e0-9f01-b7565fb4aa5c tempest-GroupsV314Test-1452032547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88f2fe65-a963-41be-b710-011079ec7038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:26:04 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-e9d60606-8073-48e0-9f01-b7565fb4aa5c tempest-GroupsV314Test-1452032547 None] Volume volume-aec43cb4-601b-4c91-983c-b1fce9321852 (aec43cb4-601b-4c91-983c-b1fce9321852): created successfully Sep 16 20:26:04 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e9d60606-8073-48e0-9f01-b7565fb4aa5c tempest-GroupsV314Test-1452032547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88f2fe65-a963-41be-b710-011079ec7038) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:26:04 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e9d60606-8073-48e0-9f01-b7565fb4aa5c tempest-GroupsV314Test-1452032547 None] Flow 'volume_create_manager' (eb17bd7d-95d2-43ba-949b-491e4f33de14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:26:04 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-e9d60606-8073-48e0-9f01-b7565fb4aa5c tempest-GroupsV314Test-1452032547 None] Created volume successfully. Sep 16 20:26:06 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-ad1246ef-66a7-4c41-a11c-0c4fb1926b31 tempest-GroupsV314Test-1452032547 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:26:06 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-ad1246ef-66a7-4c41-a11c-0c4fb1926b31 tempest-GroupsV314Test-1452032547 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:26:06 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-ad1246ef-66a7-4c41-a11c-0c4fb1926b31 tempest-GroupsV314Test-1452032547 None] Cloning volume aec43cb4-601b-4c91-983c-b1fce9321852 to volume df98ccdd-0525-46bd-bfb5-5e0cc0c487b5 Sep 16 20:26:06 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-ad1246ef-66a7-4c41-a11c-0c4fb1926b31 tempest-GroupsV314Test-1452032547 None] Creating offline snapshot a698a6a0-2224-4b69-be86-8a5dbd1d7948 of volume aec43cb4-601b-4c91-983c-b1fce9321852 {{(pid=86188) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 20:26:06 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f06c39c-b4ed-4506-9b57-a39eb17fa6f8]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:26:06 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ad1246ef-66a7-4c41-a11c-0c4fb1926b31 tempest-GroupsV314Test-1452032547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-aec43cb4-601b-4c91-983c-b1fce9321852 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:06 devstack sudo[97132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-aec43cb4-601b-4c91-983c-b1fce9321852 Sep 16 20:26:06 devstack sudo[97132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:06 devstack sudo[97132]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:06 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ad1246ef-66a7-4c41-a11c-0c4fb1926b31 tempest-GroupsV314Test-1452032547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-aec43cb4-601b-4c91-983c-b1fce9321852" returned: 0 in 0.781s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:06 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ad1246ef-66a7-4c41-a11c-0c4fb1926b31 tempest-GroupsV314Test-1452032547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-aec43cb4-601b-4c91-983c-b1fce9321852,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-aec43cb4-601b-4c91-983c-b1fce9321852.a698a6a0-2224-4b69-be86-8a5dbd1d7948 1G {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:07 devstack cinder-volume[86188]: INFO cinder.volume.manager [req-a92a5531-4504-479d-bfc0-6ebc9f875bd6 req-e900ca3d-6f31-4b77-a331-d1382e4ee422 tempest-TestMinimumBasicScenario-2081577986 None] Terminate volume connection completed successfully. Sep 16 20:26:07 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [req-a92a5531-4504-479d-bfc0-6ebc9f875bd6 req-e900ca3d-6f31-4b77-a331-d1382e4ee422 tempest-TestMinimumBasicScenario-2081577986 None] Deleting attachment 9e29f127-5cf4-48aa-aca7-00c5698ac693. {{(pid=86188) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 16 20:26:07 devstack sudo[97140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-aec43cb4-601b-4c91-983c-b1fce9321852,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-aec43cb4-601b-4c91-983c-b1fce9321852.a698a6a0-2224-4b69-be86-8a5dbd1d7948 1G Sep 16 20:26:07 devstack sudo[97140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:07 devstack sudo[97140]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:07 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ad1246ef-66a7-4c41-a11c-0c4fb1926b31 tempest-GroupsV314Test-1452032547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-aec43cb4-601b-4c91-983c-b1fce9321852,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-aec43cb4-601b-4c91-983c-b1fce9321852.a698a6a0-2224-4b69-be86-8a5dbd1d7948 1G" returned: 0 in 0.776s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:07 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ad1246ef-66a7-4c41-a11c-0c4fb1926b31 tempest-GroupsV314Test-1452032547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aec43cb4-601b-4c91-983c-b1fce9321852 -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-aec43cb4-601b-4c91-983c-b1fce9321852.a698a6a0-2224-4b69-be86-8a5dbd1d7948 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:07 devstack sudo[97147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aec43cb4-601b-4c91-983c-b1fce9321852 -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-aec43cb4-601b-4c91-983c-b1fce9321852.a698a6a0-2224-4b69-be86-8a5dbd1d7948 Sep 16 20:26:07 devstack sudo[97147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:07 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-328be466-1213-41fd-a9ea-0a7d9aae0dfb tempest-VolumesActionsTest-852371490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:26:07 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-328be466-1213-41fd-a9ea-0a7d9aae0dfb tempest-VolumesActionsTest-852371490 None] Flow 'volume_create_manager' (bd613cfb-d89e-4ff2-bcd3-bf63d72516af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:26:08 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-328be466-1213-41fd-a9ea-0a7d9aae0dfb tempest-VolumesActionsTest-852371490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d93c975-cfd3-41e9-885e-e244818b0f43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:26:08 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-328be466-1213-41fd-a9ea-0a7d9aae0dfb tempest-VolumesActionsTest-852371490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d93c975-cfd3-41e9-885e-e244818b0f43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:26:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-378984491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=327179da-c752-4a01-829f-cca9b3bc6308,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='241b8cb66c934319af2d98fd15cea960',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:26:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:26:08Z,use_quota=True,user_id='1ad5071e5a824fd7a960045be4b9a4db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:26:08 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-328be466-1213-41fd-a9ea-0a7d9aae0dfb tempest-VolumesActionsTest-852371490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d574eea-8176-47c3-aae0-488d7305bd26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:26:08 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-328be466-1213-41fd-a9ea-0a7d9aae0dfb tempest-VolumesActionsTest-852371490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d574eea-8176-47c3-aae0-488d7305bd26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:26:08 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-328be466-1213-41fd-a9ea-0a7d9aae0dfb tempest-VolumesActionsTest-852371490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e919cb53-3563-40a9-b01e-9dff17e0648b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:26:08 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-328be466-1213-41fd-a9ea-0a7d9aae0dfb tempest-VolumesActionsTest-852371490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e919cb53-3563-40a9-b01e-9dff17e0648b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '327179da-c752-4a01-829f-cca9b3bc6308', 'volume_name': 'volume-327179da-c752-4a01-829f-cca9b3bc6308', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:26:08 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-328be466-1213-41fd-a9ea-0a7d9aae0dfb tempest-VolumesActionsTest-852371490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f45e9c1-454c-408b-8ec2-25872276d112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:26:08 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-328be466-1213-41fd-a9ea-0a7d9aae0dfb tempest-VolumesActionsTest-852371490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f45e9c1-454c-408b-8ec2-25872276d112) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:26:08 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-328be466-1213-41fd-a9ea-0a7d9aae0dfb tempest-VolumesActionsTest-852371490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df5a525b-f59f-4112-b271-72b94585b1b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:26:08 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-328be466-1213-41fd-a9ea-0a7d9aae0dfb tempest-VolumesActionsTest-852371490 None] Volume 327179da-c752-4a01-829f-cca9b3bc6308: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-327179da-c752-4a01-829f-cca9b3bc6308', 'volume_size': 1} Sep 16 20:26:08 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-328be466-1213-41fd-a9ea-0a7d9aae0dfb tempest-VolumesActionsTest-852371490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:26:08 devstack sudo[97147]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:08 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ad1246ef-66a7-4c41-a11c-0c4fb1926b31 tempest-GroupsV314Test-1452032547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aec43cb4-601b-4c91-983c-b1fce9321852 -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-aec43cb4-601b-4c91-983c-b1fce9321852.a698a6a0-2224-4b69-be86-8a5dbd1d7948" returned: 0 in 0.522s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:08 devstack cinder-volume[86188]: WARNING cinder.volume.drivers.remotefs [None req-ad1246ef-66a7-4c41-a11c-0c4fb1926b31 tempest-GroupsV314Test-1452032547 None] /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-aec43cb4-601b-4c91-983c-b1fce9321852.a698a6a0-2224-4b69-be86-8a5dbd1d7948 is being set with open permissions: ugo+rw: NotImplementedError Sep 16 20:26:08 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ad1246ef-66a7-4c41-a11c-0c4fb1926b31 tempest-GroupsV314Test-1452032547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-aec43cb4-601b-4c91-983c-b1fce9321852.a698a6a0-2224-4b69-be86-8a5dbd1d7948 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:08 devstack sudo[97157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-aec43cb4-601b-4c91-983c-b1fce9321852.a698a6a0-2224-4b69-be86-8a5dbd1d7948 Sep 16 20:26:08 devstack sudo[97157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:08 devstack sudo[97157]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:08 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ad1246ef-66a7-4c41-a11c-0c4fb1926b31 tempest-GroupsV314Test-1452032547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-aec43cb4-601b-4c91-983c-b1fce9321852.a698a6a0-2224-4b69-be86-8a5dbd1d7948" returned: 0 in 0.333s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:08 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ad1246ef-66a7-4c41-a11c-0c4fb1926b31 tempest-GroupsV314Test-1452032547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-aec43cb4-601b-4c91-983c-b1fce9321852.info {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:08 devstack sudo[97167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-aec43cb4-601b-4c91-983c-b1fce9321852.info Sep 16 20:26:08 devstack sudo[97167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:08 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-df1eb50b-fca2-44f8-a8a4-a7b35245773c tempest-TestMinimumBasicScenario-2081577986 None] Acquiring lock "cinder-800c5efe-2db9-4ccf-ac6a-b9915008b32c-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:26:08 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-df1eb50b-fca2-44f8-a8a4-a7b35245773c tempest-TestMinimumBasicScenario-2081577986 None] Lock "cinder-800c5efe-2db9-4ccf-ac6a-b9915008b32c-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:26:08 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-df1eb50b-fca2-44f8-a8a4-a7b35245773c tempest-TestMinimumBasicScenario-2081577986 None] Acquiring lock "cinder-quobyte-800c5efe-2db9-4ccf-ac6a-b9915008b32c" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:26:08 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-df1eb50b-fca2-44f8-a8a4-a7b35245773c tempest-TestMinimumBasicScenario-2081577986 None] Lock "cinder-quobyte-800c5efe-2db9-4ccf-ac6a-b9915008b32c" acquired by "delete_volume" :: waited 0.021s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:26:08 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[f48200c5-e717-49ff-b34d-f022400b0ef8]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:26:08 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-df1eb50b-fca2-44f8-a8a4-a7b35245773c tempest-TestMinimumBasicScenario-2081577986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-800c5efe-2db9-4ccf-ac6a-b9915008b32c {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:09 devstack sudo[97174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-800c5efe-2db9-4ccf-ac6a-b9915008b32c Sep 16 20:26:09 devstack sudo[97174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:09 devstack sudo[97167]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:09 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ad1246ef-66a7-4c41-a11c-0c4fb1926b31 tempest-GroupsV314Test-1452032547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-aec43cb4-601b-4c91-983c-b1fce9321852.info" returned: 0 in 0.523s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:09 devstack cinder-volume[86188]: WARNING cinder.volume.drivers.remotefs [None req-ad1246ef-66a7-4c41-a11c-0c4fb1926b31 tempest-GroupsV314Test-1452032547 None] /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-aec43cb4-601b-4c91-983c-b1fce9321852.info is being set with open permissions: ugo+rw: NotImplementedError Sep 16 20:26:09 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ad1246ef-66a7-4c41-a11c-0c4fb1926b31 tempest-GroupsV314Test-1452032547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-aec43cb4-601b-4c91-983c-b1fce9321852.info {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:09 devstack sudo[97177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-aec43cb4-601b-4c91-983c-b1fce9321852.info Sep 16 20:26:09 devstack sudo[97177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:09 devstack sudo[97174]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:09 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-df1eb50b-fca2-44f8-a8a4-a7b35245773c tempest-TestMinimumBasicScenario-2081577986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-800c5efe-2db9-4ccf-ac6a-b9915008b32c" returned: 0 in 0.625s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:09 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-df1eb50b-fca2-44f8-a8a4-a7b35245773c tempest-TestMinimumBasicScenario-2081577986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-800c5efe-2db9-4ccf-ac6a-b9915008b32c {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:09 devstack sudo[97177]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:09 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ad1246ef-66a7-4c41-a11c-0c4fb1926b31 tempest-GroupsV314Test-1452032547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-aec43cb4-601b-4c91-983c-b1fce9321852.info" returned: 0 in 0.419s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:09 devstack sudo[97183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-800c5efe-2db9-4ccf-ac6a-b9915008b32c Sep 16 20:26:09 devstack sudo[97183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:09 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-ad1246ef-66a7-4c41-a11c-0c4fb1926b31 tempest-GroupsV314Test-1452032547 None] Acquiring lock "cinder-quobyte-df98ccdd-0525-46bd-bfb5-5e0cc0c487b5" by "_copy_volume_from_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:26:09 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-ad1246ef-66a7-4c41-a11c-0c4fb1926b31 tempest-GroupsV314Test-1452032547 None] Lock "cinder-quobyte-df98ccdd-0525-46bd-bfb5-5e0cc0c487b5" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:26:09 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-ad1246ef-66a7-4c41-a11c-0c4fb1926b31 tempest-GroupsV314Test-1452032547 None] snapshot: a698a6a0-2224-4b69-be86-8a5dbd1d7948, volume: df98ccdd-0525-46bd-bfb5-5e0cc0c487b5, {{(pid=86188) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 16 20:26:09 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-ad1246ef-66a7-4c41-a11c-0c4fb1926b31 tempest-GroupsV314Test-1452032547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:26:09 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-ad1246ef-66a7-4c41-a11c-0c4fb1926b31 tempest-GroupsV314Test-1452032547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:26:09 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-ad1246ef-66a7-4c41-a11c-0c4fb1926b31 tempest-GroupsV314Test-1452032547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:26:09 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-ad1246ef-66a7-4c41-a11c-0c4fb1926b31 tempest-GroupsV314Test-1452032547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:26:09 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-ad1246ef-66a7-4c41-a11c-0c4fb1926b31 tempest-GroupsV314Test-1452032547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:26:09 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[9be183d7-9cf1-435f-bd9f-6c69c3d84642]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:26:09 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ad1246ef-66a7-4c41-a11c-0c4fb1926b31 tempest-GroupsV314Test-1452032547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-aec43cb4-601b-4c91-983c-b1fce9321852.a698a6a0-2224-4b69-be86-8a5dbd1d7948 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:09 devstack sudo[97185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-aec43cb4-601b-4c91-983c-b1fce9321852.a698a6a0-2224-4b69-be86-8a5dbd1d7948 Sep 16 20:26:09 devstack sudo[97185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:09 devstack sudo[97183]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:09 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-df1eb50b-fca2-44f8-a8a4-a7b35245773c tempest-TestMinimumBasicScenario-2081577986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-800c5efe-2db9-4ccf-ac6a-b9915008b32c" returned: 0 in 0.320s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:09 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-df1eb50b-fca2-44f8-a8a4-a7b35245773c tempest-TestMinimumBasicScenario-2081577986 None] Lock "cinder-quobyte-800c5efe-2db9-4ccf-ac6a-b9915008b32c" released by "delete_volume" :: held 0.999s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:26:10 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-df1eb50b-fca2-44f8-a8a4-a7b35245773c tempest-TestMinimumBasicScenario-2081577986 None] Created reservations ['b854ea7a-fa4f-41ae-9973-37f63d397df4', '20f7b1a3-e8d2-4f2a-bcd2-1fb1db62b887', '5568e971-5e2a-44c9-b35b-7399be4b6514', 'ecb00507-780f-40bd-91d3-e4179edad268'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:26:10 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-df1eb50b-fca2-44f8-a8a4-a7b35245773c tempest-TestMinimumBasicScenario-2081577986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:26:10 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-df1eb50b-fca2-44f8-a8a4-a7b35245773c tempest-TestMinimumBasicScenario-2081577986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:26:10 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-df1eb50b-fca2-44f8-a8a4-a7b35245773c tempest-TestMinimumBasicScenario-2081577986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:26:10 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-df1eb50b-fca2-44f8-a8a4-a7b35245773c tempest-TestMinimumBasicScenario-2081577986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:26:10 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-df1eb50b-fca2-44f8-a8a4-a7b35245773c tempest-TestMinimumBasicScenario-2081577986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:26:10 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-df1eb50b-fca2-44f8-a8a4-a7b35245773c tempest-TestMinimumBasicScenario-2081577986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:10 devstack sudo[97188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:26:10 devstack sudo[97188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:10 devstack sudo[97185]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:10 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ad1246ef-66a7-4c41-a11c-0c4fb1926b31 tempest-GroupsV314Test-1452032547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-aec43cb4-601b-4c91-983c-b1fce9321852.a698a6a0-2224-4b69-be86-8a5dbd1d7948" returned: 0 in 0.531s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:10 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-ad1246ef-66a7-4c41-a11c-0c4fb1926b31 tempest-GroupsV314Test-1452032547 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aec43cb4-601b-4c91-983c-b1fce9321852(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86188) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 20:26:10 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4c76ec3-d6e6-409d-b3ef-e5b41a24dafd]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:26:10 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ad1246ef-66a7-4c41-a11c-0c4fb1926b31 tempest-GroupsV314Test-1452032547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-aec43cb4-601b-4c91-983c-b1fce9321852 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:10 devstack sudo[97193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-aec43cb4-601b-4c91-983c-b1fce9321852 Sep 16 20:26:10 devstack sudo[97193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:10 devstack sudo[97188]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:10 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-df1eb50b-fca2-44f8-a8a4-a7b35245773c tempest-TestMinimumBasicScenario-2081577986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.303s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:10 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-df1eb50b-fca2-44f8-a8a4-a7b35245773c tempest-TestMinimumBasicScenario-2081577986 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:26:10 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-df1eb50b-fca2-44f8-a8a4-a7b35245773c tempest-TestMinimumBasicScenario-2081577986 None] Deleted volume successfully. Sep 16 20:26:10 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-df1eb50b-fca2-44f8-a8a4-a7b35245773c tempest-TestMinimumBasicScenario-2081577986 None] Lock "cinder-800c5efe-2db9-4ccf-ac6a-b9915008b32c-delete_volume" released by "delete_volume" :: held 1.622s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:26:10 devstack sudo[97193]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:10 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ad1246ef-66a7-4c41-a11c-0c4fb1926b31 tempest-GroupsV314Test-1452032547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-aec43cb4-601b-4c91-983c-b1fce9321852" returned: 0 in 0.418s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:10 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-ad1246ef-66a7-4c41-a11c-0c4fb1926b31 tempest-GroupsV314Test-1452032547 None] will copy from snapshot at /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-aec43cb4-601b-4c91-983c-b1fce9321852 {{(pid=86188) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 16 20:26:10 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-ad1246ef-66a7-4c41-a11c-0c4fb1926b31 tempest-GroupsV314Test-1452032547 None] Creating direct copy from snapshot {{(pid=86188) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 16 20:26:10 devstack cinder-volume[86188]: DEBUG cinder.utils [None req-ad1246ef-66a7-4c41-a11c-0c4fb1926b31 tempest-GroupsV314Test-1452032547 None] Path /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-df98ccdd-0525-46bd-bfb5-5e0cc0c487b5 not found in is_blk_device check {{(pid=86188) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 16 20:26:10 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ad1246ef-66a7-4c41-a11c-0c4fb1926b31 tempest-GroupsV314Test-1452032547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-aec43cb4-601b-4c91-983c-b1fce9321852 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-df98ccdd-0525-46bd-bfb5-5e0cc0c487b5 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:10 devstack sudo[97199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-aec43cb4-601b-4c91-983c-b1fce9321852 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-df98ccdd-0525-46bd-bfb5-5e0cc0c487b5 Sep 16 20:26:10 devstack sudo[97199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:20 devstack cinder-volume[86188]: DEBUG dbcounter [-] [86188] Writing DB stats cinder:SELECT=13,cinder:UPDATE=12,cinder:INSERT=3 {{(pid=86188) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 20:26:20 devstack sudo[97199]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:20 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ad1246ef-66a7-4c41-a11c-0c4fb1926b31 tempest-GroupsV314Test-1452032547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-aec43cb4-601b-4c91-983c-b1fce9321852 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-df98ccdd-0525-46bd-bfb5-5e0cc0c487b5" returned: 0 in 9.541s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:20 devstack cinder-volume[86188]: DEBUG cinder.image.image_utils [None req-ad1246ef-66a7-4c41-a11c-0c4fb1926b31 tempest-GroupsV314Test-1452032547 None] Image conversion details: src /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-aec43cb4-601b-4c91-983c-b1fce9321852, size 1024.00 MB, duration 9.54 sec, destination /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-df98ccdd-0525-46bd-bfb5-5e0cc0c487b5 {{(pid=86188) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 16 20:26:20 devstack cinder-volume[86188]: INFO cinder.image.image_utils [None req-ad1246ef-66a7-4c41-a11c-0c4fb1926b31 tempest-GroupsV314Test-1452032547 None] Converted 1024.00 MB image at 107.30 MB/s Sep 16 20:26:20 devstack cinder-volume[86188]: WARNING cinder.volume.drivers.remotefs [None req-ad1246ef-66a7-4c41-a11c-0c4fb1926b31 tempest-GroupsV314Test-1452032547 None] /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-df98ccdd-0525-46bd-bfb5-5e0cc0c487b5 is being set with open permissions: ugo+rw: NotImplementedError Sep 16 20:26:20 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ad1246ef-66a7-4c41-a11c-0c4fb1926b31 tempest-GroupsV314Test-1452032547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-df98ccdd-0525-46bd-bfb5-5e0cc0c487b5 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:20 devstack sudo[97252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-df98ccdd-0525-46bd-bfb5-5e0cc0c487b5 Sep 16 20:26:20 devstack sudo[97252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:20 devstack cinder-volume[86188]: DEBUG dbcounter [-] [86188] Writing DB stats cinder:SELECT=15,cinder:UPDATE=11,cinder:DELETE=2,cinder:INSERT=4 {{(pid=86188) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 20:26:20 devstack sudo[97252]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:20 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ad1246ef-66a7-4c41-a11c-0c4fb1926b31 tempest-GroupsV314Test-1452032547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-df98ccdd-0525-46bd-bfb5-5e0cc0c487b5" returned: 0 in 0.271s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:20 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-ad1246ef-66a7-4c41-a11c-0c4fb1926b31 tempest-GroupsV314Test-1452032547 None] Lock "cinder-quobyte-df98ccdd-0525-46bd-bfb5-5e0cc0c487b5" released by "_copy_volume_from_snapshot" :: held 10.849s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:26:20 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-ad1246ef-66a7-4c41-a11c-0c4fb1926b31 tempest-GroupsV314Test-1452032547 None] Acquiring lock "cinder-quobyte-a698a6a0-2224-4b69-be86-8a5dbd1d7948" by "_delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:26:20 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-ad1246ef-66a7-4c41-a11c-0c4fb1926b31 tempest-GroupsV314Test-1452032547 None] Lock "cinder-quobyte-a698a6a0-2224-4b69-be86-8a5dbd1d7948" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:26:20 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-ad1246ef-66a7-4c41-a11c-0c4fb1926b31 tempest-GroupsV314Test-1452032547 None] Deleting offline snapshot a698a6a0-2224-4b69-be86-8a5dbd1d7948 of volume aec43cb4-601b-4c91-983c-b1fce9321852 {{(pid=86188) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 20:26:20 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-ad1246ef-66a7-4c41-a11c-0c4fb1926b31 tempest-GroupsV314Test-1452032547 None] snapshot_file for this snap is: volume-aec43cb4-601b-4c91-983c-b1fce9321852.a698a6a0-2224-4b69-be86-8a5dbd1d7948 {{(pid=86188) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 20:26:20 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[de167064-419e-4c2a-9d9b-25f7791ddc8d]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:26:20 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ad1246ef-66a7-4c41-a11c-0c4fb1926b31 tempest-GroupsV314Test-1452032547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-aec43cb4-601b-4c91-983c-b1fce9321852.a698a6a0-2224-4b69-be86-8a5dbd1d7948 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:20 devstack sudo[97255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-aec43cb4-601b-4c91-983c-b1fce9321852.a698a6a0-2224-4b69-be86-8a5dbd1d7948 Sep 16 20:26:20 devstack sudo[97255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:20 devstack sudo[97255]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:21 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ad1246ef-66a7-4c41-a11c-0c4fb1926b31 tempest-GroupsV314Test-1452032547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-aec43cb4-601b-4c91-983c-b1fce9321852.a698a6a0-2224-4b69-be86-8a5dbd1d7948" returned: 0 in 0.401s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:21 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-ad1246ef-66a7-4c41-a11c-0c4fb1926b31 tempest-GroupsV314Test-1452032547 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aec43cb4-601b-4c91-983c-b1fce9321852(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86188) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 20:26:21 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6ca3158-9a8c-41e0-be3a-d55723146f70]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:26:21 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ad1246ef-66a7-4c41-a11c-0c4fb1926b31 tempest-GroupsV314Test-1452032547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-aec43cb4-601b-4c91-983c-b1fce9321852 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:21 devstack sudo[97260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-aec43cb4-601b-4c91-983c-b1fce9321852 Sep 16 20:26:21 devstack sudo[97260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:21 devstack sudo[97260]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:21 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ad1246ef-66a7-4c41-a11c-0c4fb1926b31 tempest-GroupsV314Test-1452032547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-aec43cb4-601b-4c91-983c-b1fce9321852" returned: 0 in 0.568s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:21 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ad1246ef-66a7-4c41-a11c-0c4fb1926b31 tempest-GroupsV314Test-1452032547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-aec43cb4-601b-4c91-983c-b1fce9321852.a698a6a0-2224-4b69-be86-8a5dbd1d7948 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:21 devstack sudo[97265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-aec43cb4-601b-4c91-983c-b1fce9321852.a698a6a0-2224-4b69-be86-8a5dbd1d7948 Sep 16 20:26:21 devstack sudo[97265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:21 devstack sudo[97265]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:21 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ad1246ef-66a7-4c41-a11c-0c4fb1926b31 tempest-GroupsV314Test-1452032547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-aec43cb4-601b-4c91-983c-b1fce9321852.a698a6a0-2224-4b69-be86-8a5dbd1d7948" returned: 0 in 0.369s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:21 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ad1246ef-66a7-4c41-a11c-0c4fb1926b31 tempest-GroupsV314Test-1452032547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-aec43cb4-601b-4c91-983c-b1fce9321852.a698a6a0-2224-4b69-be86-8a5dbd1d7948 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:22 devstack sudo[97270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-aec43cb4-601b-4c91-983c-b1fce9321852.a698a6a0-2224-4b69-be86-8a5dbd1d7948 Sep 16 20:26:22 devstack sudo[97270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:22 devstack sudo[97270]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:22 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ad1246ef-66a7-4c41-a11c-0c4fb1926b31 tempest-GroupsV314Test-1452032547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-aec43cb4-601b-4c91-983c-b1fce9321852.a698a6a0-2224-4b69-be86-8a5dbd1d7948" returned: 0 in 0.298s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:22 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-ad1246ef-66a7-4c41-a11c-0c4fb1926b31 tempest-GroupsV314Test-1452032547 None] Lock "cinder-quobyte-a698a6a0-2224-4b69-be86-8a5dbd1d7948" released by "_delete_snapshot" :: held 1.765s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:26:22 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-ad1246ef-66a7-4c41-a11c-0c4fb1926b31 tempest-GroupsV314Test-1452032547 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.276s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:26:22 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-328be466-1213-41fd-a9ea-0a7d9aae0dfb tempest-VolumesActionsTest-852371490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.184s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:26:22 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-328be466-1213-41fd-a9ea-0a7d9aae0dfb tempest-VolumesActionsTest-852371490 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:26:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-378984491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=327179da-c752-4a01-829f-cca9b3bc6308,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='241b8cb66c934319af2d98fd15cea960',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:26:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:26:08Z,use_quota=True,user_id='1ad5071e5a824fd7a960045be4b9a4db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:26:22 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-328be466-1213-41fd-a9ea-0a7d9aae0dfb tempest-VolumesActionsTest-852371490 None] Creating volume 327179da-c752-4a01-829f-cca9b3bc6308 {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:26:22 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-328be466-1213-41fd-a9ea-0a7d9aae0dfb tempest-VolumesActionsTest-852371490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:26:22 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-328be466-1213-41fd-a9ea-0a7d9aae0dfb tempest-VolumesActionsTest-852371490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:26:22 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-328be466-1213-41fd-a9ea-0a7d9aae0dfb tempest-VolumesActionsTest-852371490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:26:22 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-328be466-1213-41fd-a9ea-0a7d9aae0dfb tempest-VolumesActionsTest-852371490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:26:22 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-328be466-1213-41fd-a9ea-0a7d9aae0dfb tempest-VolumesActionsTest-852371490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:26:22 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-328be466-1213-41fd-a9ea-0a7d9aae0dfb tempest-VolumesActionsTest-852371490 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:26:22 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-328be466-1213-41fd-a9ea-0a7d9aae0dfb tempest-VolumesActionsTest-852371490 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:26:22 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-328be466-1213-41fd-a9ea-0a7d9aae0dfb tempest-VolumesActionsTest-852371490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-327179da-c752-4a01-829f-cca9b3bc6308 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:22 devstack sudo[97273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-327179da-c752-4a01-829f-cca9b3bc6308 1073741824 Sep 16 20:26:22 devstack sudo[97273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:22 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-ad1246ef-66a7-4c41-a11c-0c4fb1926b31 tempest-GroupsV314Test-1452032547 None] Create group from source-group-6ad29321-c033-4cf3-8bd1-222f9389f190 completed successfully. Sep 16 20:26:22 devstack sudo[97273]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:22 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-328be466-1213-41fd-a9ea-0a7d9aae0dfb tempest-VolumesActionsTest-852371490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-327179da-c752-4a01-829f-cca9b3bc6308 1073741824" returned: 0 in 0.560s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:22 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-328be466-1213-41fd-a9ea-0a7d9aae0dfb tempest-VolumesActionsTest-852371490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-327179da-c752-4a01-829f-cca9b3bc6308 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:23 devstack sudo[97279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-327179da-c752-4a01-829f-cca9b3bc6308 Sep 16 20:26:23 devstack sudo[97279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:23 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-046616ce-8dec-46ce-a0e7-30e78e352ef0 tempest-GroupsV314Test-1452032547 None] Acquiring lock "cinder-quobyte-df98ccdd-0525-46bd-bfb5-5e0cc0c487b5" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:26:23 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-328be466-1213-41fd-a9ea-0a7d9aae0dfb tempest-VolumesActionsTest-852371490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-327179da-c752-4a01-829f-cca9b3bc6308" returned: 0 in 0.326s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:23 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-328be466-1213-41fd-a9ea-0a7d9aae0dfb tempest-VolumesActionsTest-852371490 None] <== create_volume: return (954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:26:23 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-328be466-1213-41fd-a9ea-0a7d9aae0dfb tempest-VolumesActionsTest-852371490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:26:23 devstack sudo[97279]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:23 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-046616ce-8dec-46ce-a0e7-30e78e352ef0 tempest-GroupsV314Test-1452032547 None] Lock "cinder-quobyte-df98ccdd-0525-46bd-bfb5-5e0cc0c487b5" acquired by "delete_volume" :: waited 0.046s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:26:23 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-328be466-1213-41fd-a9ea-0a7d9aae0dfb tempest-VolumesActionsTest-852371490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df5a525b-f59f-4112-b271-72b94585b1b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-327179da-c752-4a01-829f-cca9b3bc6308', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:26:23 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-328be466-1213-41fd-a9ea-0a7d9aae0dfb tempest-VolumesActionsTest-852371490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89937b35-f679-40d5-993e-be05acbb47c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:26:23 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[13aa0752-0be2-415d-907d-208682d91e81]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:26:23 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-046616ce-8dec-46ce-a0e7-30e78e352ef0 tempest-GroupsV314Test-1452032547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-df98ccdd-0525-46bd-bfb5-5e0cc0c487b5 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:23 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-328be466-1213-41fd-a9ea-0a7d9aae0dfb tempest-VolumesActionsTest-852371490 None] Volume volume-327179da-c752-4a01-829f-cca9b3bc6308 (327179da-c752-4a01-829f-cca9b3bc6308): created successfully Sep 16 20:26:23 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-328be466-1213-41fd-a9ea-0a7d9aae0dfb tempest-VolumesActionsTest-852371490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89937b35-f679-40d5-993e-be05acbb47c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:26:23 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-328be466-1213-41fd-a9ea-0a7d9aae0dfb tempest-VolumesActionsTest-852371490 None] Flow 'volume_create_manager' (bd613cfb-d89e-4ff2-bcd3-bf63d72516af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:26:23 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-328be466-1213-41fd-a9ea-0a7d9aae0dfb tempest-VolumesActionsTest-852371490 None] Created volume successfully. Sep 16 20:26:23 devstack sudo[97283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-df98ccdd-0525-46bd-bfb5-5e0cc0c487b5 Sep 16 20:26:23 devstack sudo[97283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:23 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-643b9508-5d54-49ee-831a-4af1ddb24121 tempest-VolumesActionsTest-852371490 None] Acquiring lock "cinder-327179da-c752-4a01-829f-cca9b3bc6308" by "attach_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:26:23 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-643b9508-5d54-49ee-831a-4af1ddb24121 tempest-VolumesActionsTest-852371490 None] Lock "cinder-327179da-c752-4a01-829f-cca9b3bc6308" acquired by "attach_volume" :: waited 0.028s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:26:23 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-643b9508-5d54-49ee-831a-4af1ddb24121 tempest-VolumesActionsTest-852371490 None] Attaching volume 327179da-c752-4a01-829f-cca9b3bc6308 to instance 6ed55f88-9af0-4998-ac44-d9049db9710a at mountpoint /dev/vdb on host None. Sep 16 20:26:24 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-643b9508-5d54-49ee-831a-4af1ddb24121 tempest-VolumesActionsTest-852371490 None] Attach volume completed successfully. Sep 16 20:26:24 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-643b9508-5d54-49ee-831a-4af1ddb24121 tempest-VolumesActionsTest-852371490 None] Lock "cinder-327179da-c752-4a01-829f-cca9b3bc6308" released by "attach_volume" :: held 0.214s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:26:24 devstack sudo[97283]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:24 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-046616ce-8dec-46ce-a0e7-30e78e352ef0 tempest-GroupsV314Test-1452032547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-df98ccdd-0525-46bd-bfb5-5e0cc0c487b5" returned: 0 in 0.672s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:24 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-046616ce-8dec-46ce-a0e7-30e78e352ef0 tempest-GroupsV314Test-1452032547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-df98ccdd-0525-46bd-bfb5-5e0cc0c487b5 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:24 devstack sudo[97288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-df98ccdd-0525-46bd-bfb5-5e0cc0c487b5 Sep 16 20:26:24 devstack sudo[97288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:24 devstack sudo[97288]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:24 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-046616ce-8dec-46ce-a0e7-30e78e352ef0 tempest-GroupsV314Test-1452032547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-df98ccdd-0525-46bd-bfb5-5e0cc0c487b5" returned: 0 in 0.340s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:24 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-046616ce-8dec-46ce-a0e7-30e78e352ef0 tempest-GroupsV314Test-1452032547 None] Lock "cinder-quobyte-df98ccdd-0525-46bd-bfb5-5e0cc0c487b5" released by "delete_volume" :: held 1.114s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:26:24 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-046616ce-8dec-46ce-a0e7-30e78e352ef0 tempest-GroupsV314Test-1452032547 None] Created reservations ['e96cc230-6d11-46c2-b93d-33cca3d1afa8'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:26:24 devstack cinder-volume[86188]: WARNING cinder.quota [None req-046616ce-8dec-46ce-a0e7-30e78e352ef0 tempest-GroupsV314Test-1452032547 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1575394570 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1575394570, it is now deprecated. Please use the default quota class for default quota. Sep 16 20:26:24 devstack cinder-volume[86188]: WARNING cinder.quota [None req-046616ce-8dec-46ce-a0e7-30e78e352ef0 tempest-GroupsV314Test-1452032547 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1575394570 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1575394570, it is now deprecated. Please use the default quota class for default quota. Sep 16 20:26:24 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-046616ce-8dec-46ce-a0e7-30e78e352ef0 tempest-GroupsV314Test-1452032547 None] Created reservations ['59db5eef-8ddb-41b1-8cb3-0280567b6601', '8f76af7e-7b1e-4743-823c-ff2bfa88ad0d', 'ed161925-bddb-41d0-821f-ddf6e4c29963', '3f4211e7-59bf-49ce-9141-fd736c4f575b'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:26:24 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-046616ce-8dec-46ce-a0e7-30e78e352ef0 tempest-GroupsV314Test-1452032547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:26:24 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-046616ce-8dec-46ce-a0e7-30e78e352ef0 tempest-GroupsV314Test-1452032547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:26:24 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-046616ce-8dec-46ce-a0e7-30e78e352ef0 tempest-GroupsV314Test-1452032547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:26:24 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-046616ce-8dec-46ce-a0e7-30e78e352ef0 tempest-GroupsV314Test-1452032547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:26:24 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-046616ce-8dec-46ce-a0e7-30e78e352ef0 tempest-GroupsV314Test-1452032547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:26:24 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-046616ce-8dec-46ce-a0e7-30e78e352ef0 tempest-GroupsV314Test-1452032547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:24 devstack sudo[97291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:26:24 devstack sudo[97291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:25 devstack sudo[97291]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:25 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-046616ce-8dec-46ce-a0e7-30e78e352ef0 tempest-GroupsV314Test-1452032547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.379s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:25 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-046616ce-8dec-46ce-a0e7-30e78e352ef0 tempest-GroupsV314Test-1452032547 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:26:25 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-046616ce-8dec-46ce-a0e7-30e78e352ef0 tempest-GroupsV314Test-1452032547 None] Delete group completed successfully. Sep 16 20:26:25 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-4a654de9-c756-483f-a101-0afa3eb7a20e tempest-VolumesActionsTest-1567958602 None] Terminate volume connection completed successfully. Sep 16 20:26:25 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-4a654de9-c756-483f-a101-0afa3eb7a20e tempest-VolumesActionsTest-1567958602 None] Acquiring lock "cinder-327179da-c752-4a01-829f-cca9b3bc6308-detach_volume" by "detach_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:26:25 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-4a654de9-c756-483f-a101-0afa3eb7a20e tempest-VolumesActionsTest-1567958602 None] Lock "cinder-327179da-c752-4a01-829f-cca9b3bc6308-detach_volume" acquired by "detach_volume" :: waited 0.015s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:26:25 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-4a654de9-c756-483f-a101-0afa3eb7a20e tempest-VolumesActionsTest-1567958602 None] Detaching volume 327179da-c752-4a01-829f-cca9b3bc6308 from instance 6ed55f88-9af0-4998-ac44-d9049db9710a. Sep 16 20:26:25 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-4a654de9-c756-483f-a101-0afa3eb7a20e tempest-VolumesActionsTest-1567958602 None] Detach volume completed successfully. Sep 16 20:26:25 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-4a654de9-c756-483f-a101-0afa3eb7a20e tempest-VolumesActionsTest-1567958602 None] Lock "cinder-327179da-c752-4a01-829f-cca9b3bc6308-detach_volume" released by "detach_volume" :: held 0.085s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:26:25 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-21d56e9c-6bd2-44bc-9de7-aec4897e811e tempest-VolumesActionsTest-852371490 None] Acquiring lock "cinder-327179da-c752-4a01-829f-cca9b3bc6308-detach_volume" by "detach_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:26:25 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-21d56e9c-6bd2-44bc-9de7-aec4897e811e tempest-VolumesActionsTest-852371490 None] Lock "cinder-327179da-c752-4a01-829f-cca9b3bc6308-detach_volume" acquired by "detach_volume" :: waited 0.019s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:26:25 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-21d56e9c-6bd2-44bc-9de7-aec4897e811e tempest-VolumesActionsTest-852371490 None] Volume detach called, but volume not attached. Sep 16 20:26:25 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-21d56e9c-6bd2-44bc-9de7-aec4897e811e tempest-VolumesActionsTest-852371490 None] Lock "cinder-327179da-c752-4a01-829f-cca9b3bc6308-detach_volume" released by "detach_volume" :: held 0.025s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:26:26 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-d40e7105-299d-45b6-9766-502be1ac0326 tempest-VolumesActionsTest-852371490 None] Acquiring lock "cinder-327179da-c752-4a01-829f-cca9b3bc6308-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:26:26 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-d40e7105-299d-45b6-9766-502be1ac0326 tempest-VolumesActionsTest-852371490 None] Lock "cinder-327179da-c752-4a01-829f-cca9b3bc6308-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:26:26 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-d40e7105-299d-45b6-9766-502be1ac0326 tempest-VolumesActionsTest-852371490 None] Acquiring lock "cinder-quobyte-327179da-c752-4a01-829f-cca9b3bc6308" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:26:26 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-d40e7105-299d-45b6-9766-502be1ac0326 tempest-VolumesActionsTest-852371490 None] Lock "cinder-quobyte-327179da-c752-4a01-829f-cca9b3bc6308" acquired by "delete_volume" :: waited 0.018s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:26:26 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[874d10e9-566f-461f-ac6c-103b3bb04886]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:26:26 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-d40e7105-299d-45b6-9766-502be1ac0326 tempest-VolumesActionsTest-852371490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-327179da-c752-4a01-829f-cca9b3bc6308 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:26 devstack sudo[97295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-327179da-c752-4a01-829f-cca9b3bc6308 Sep 16 20:26:26 devstack sudo[97295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:26 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9684eaa-35b4-4d21-82ed-8c991135559b tempest-SnapshotMetadataTestJSON-1031157924 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:26:26 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a9684eaa-35b4-4d21-82ed-8c991135559b tempest-SnapshotMetadataTestJSON-1031157924 None] Flow 'volume_create_manager' (1e047b02-3071-4388-a079-fdec08ec8176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:26:26 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a9684eaa-35b4-4d21-82ed-8c991135559b tempest-SnapshotMetadataTestJSON-1031157924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e6ac726-efc9-47c5-955c-596e8bfb2055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:26:26 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-c802c7d3-bdb4-44ff-b42f-47924c504700 tempest-GroupsV314Test-1452032547 None] Acquiring lock "cinder-quobyte-aec43cb4-601b-4c91-983c-b1fce9321852" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:26:26 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a9684eaa-35b4-4d21-82ed-8c991135559b tempest-SnapshotMetadataTestJSON-1031157924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e6ac726-efc9-47c5-955c-596e8bfb2055) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:26:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1325100438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=868fcc74-11e7-43aa-bad2-c54fd29d6a80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7bfecdc4b2d498f8893e63c6b43c12e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:26:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:26:26Z,use_quota=True,user_id='4474ae9f1dc043268558538324a6f398',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:26:26 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a9684eaa-35b4-4d21-82ed-8c991135559b tempest-SnapshotMetadataTestJSON-1031157924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d192f170-f12d-4847-888b-b9fa817d12e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:26:26 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a9684eaa-35b4-4d21-82ed-8c991135559b tempest-SnapshotMetadataTestJSON-1031157924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d192f170-f12d-4847-888b-b9fa817d12e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:26:26 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a9684eaa-35b4-4d21-82ed-8c991135559b tempest-SnapshotMetadataTestJSON-1031157924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0236605e-152d-408d-b915-0f35d8e5a179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:26:26 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a9684eaa-35b4-4d21-82ed-8c991135559b tempest-SnapshotMetadataTestJSON-1031157924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0236605e-152d-408d-b915-0f35d8e5a179) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '868fcc74-11e7-43aa-bad2-c54fd29d6a80', 'volume_name': 'volume-868fcc74-11e7-43aa-bad2-c54fd29d6a80', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:26:26 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a9684eaa-35b4-4d21-82ed-8c991135559b tempest-SnapshotMetadataTestJSON-1031157924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99ca7b29-bdc3-45e7-acd0-f9451e20c02e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:26:26 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a9684eaa-35b4-4d21-82ed-8c991135559b tempest-SnapshotMetadataTestJSON-1031157924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99ca7b29-bdc3-45e7-acd0-f9451e20c02e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:26:26 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a9684eaa-35b4-4d21-82ed-8c991135559b tempest-SnapshotMetadataTestJSON-1031157924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7d751aa-d23c-4c5b-90fb-ea7cb76c0dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:26:26 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-a9684eaa-35b4-4d21-82ed-8c991135559b tempest-SnapshotMetadataTestJSON-1031157924 None] Volume 868fcc74-11e7-43aa-bad2-c54fd29d6a80: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-868fcc74-11e7-43aa-bad2-c54fd29d6a80', 'volume_size': 1} Sep 16 20:26:26 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a9684eaa-35b4-4d21-82ed-8c991135559b tempest-SnapshotMetadataTestJSON-1031157924 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:26:26 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a9684eaa-35b4-4d21-82ed-8c991135559b tempest-SnapshotMetadataTestJSON-1031157924 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:26:26 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-a9684eaa-35b4-4d21-82ed-8c991135559b tempest-SnapshotMetadataTestJSON-1031157924 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:26:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1325100438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=868fcc74-11e7-43aa-bad2-c54fd29d6a80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7bfecdc4b2d498f8893e63c6b43c12e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:26:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:26:26Z,use_quota=True,user_id='4474ae9f1dc043268558538324a6f398',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:26:26 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-a9684eaa-35b4-4d21-82ed-8c991135559b tempest-SnapshotMetadataTestJSON-1031157924 None] Creating volume 868fcc74-11e7-43aa-bad2-c54fd29d6a80 {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:26:26 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a9684eaa-35b4-4d21-82ed-8c991135559b tempest-SnapshotMetadataTestJSON-1031157924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:26:26 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a9684eaa-35b4-4d21-82ed-8c991135559b tempest-SnapshotMetadataTestJSON-1031157924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:26:26 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-a9684eaa-35b4-4d21-82ed-8c991135559b tempest-SnapshotMetadataTestJSON-1031157924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:26:26 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-a9684eaa-35b4-4d21-82ed-8c991135559b tempest-SnapshotMetadataTestJSON-1031157924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:26:26 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a9684eaa-35b4-4d21-82ed-8c991135559b tempest-SnapshotMetadataTestJSON-1031157924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:26:26 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-a9684eaa-35b4-4d21-82ed-8c991135559b tempest-SnapshotMetadataTestJSON-1031157924 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:26:26 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-a9684eaa-35b4-4d21-82ed-8c991135559b tempest-SnapshotMetadataTestJSON-1031157924 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:26:26 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a9684eaa-35b4-4d21-82ed-8c991135559b tempest-SnapshotMetadataTestJSON-1031157924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-868fcc74-11e7-43aa-bad2-c54fd29d6a80 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:26 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-c802c7d3-bdb4-44ff-b42f-47924c504700 tempest-GroupsV314Test-1452032547 None] Lock "cinder-quobyte-aec43cb4-601b-4c91-983c-b1fce9321852" acquired by "delete_volume" :: waited 0.123s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:26:26 devstack sudo[97299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-868fcc74-11e7-43aa-bad2-c54fd29d6a80 1073741824 Sep 16 20:26:26 devstack sudo[97299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:26 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[89af3816-7cde-4ede-8a82-a313b621f7a9]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:26:26 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-c802c7d3-bdb4-44ff-b42f-47924c504700 tempest-GroupsV314Test-1452032547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-aec43cb4-601b-4c91-983c-b1fce9321852 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:26 devstack sudo[97295]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:26 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-d40e7105-299d-45b6-9766-502be1ac0326 tempest-VolumesActionsTest-852371490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-327179da-c752-4a01-829f-cca9b3bc6308" returned: 0 in 0.515s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:26 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-d40e7105-299d-45b6-9766-502be1ac0326 tempest-VolumesActionsTest-852371490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-327179da-c752-4a01-829f-cca9b3bc6308 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:26 devstack sudo[97304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-327179da-c752-4a01-829f-cca9b3bc6308 Sep 16 20:26:26 devstack sudo[97304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:26 devstack sudo[97303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-aec43cb4-601b-4c91-983c-b1fce9321852 Sep 16 20:26:26 devstack sudo[97303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:26 devstack sudo[97304]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:26 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-d40e7105-299d-45b6-9766-502be1ac0326 tempest-VolumesActionsTest-852371490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-327179da-c752-4a01-829f-cca9b3bc6308" returned: 0 in 0.286s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:27 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-d40e7105-299d-45b6-9766-502be1ac0326 tempest-VolumesActionsTest-852371490 None] Lock "cinder-quobyte-327179da-c752-4a01-829f-cca9b3bc6308" released by "delete_volume" :: held 0.877s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:26:27 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-d40e7105-299d-45b6-9766-502be1ac0326 tempest-VolumesActionsTest-852371490 None] Created reservations ['6fb4a26c-0e96-47f0-a469-e30e6cd4e0e5', 'ef7d2715-9ba0-40b5-b539-dd32392e68e4', '5eead0d6-c80c-43c6-b364-26594322882b', '2670d8d3-3a65-4c2e-bcc7-468a748ff9b5'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:26:27 devstack sudo[97303]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:27 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-c802c7d3-bdb4-44ff-b42f-47924c504700 tempest-GroupsV314Test-1452032547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-aec43cb4-601b-4c91-983c-b1fce9321852" returned: 0 in 0.435s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:27 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-c802c7d3-bdb4-44ff-b42f-47924c504700 tempest-GroupsV314Test-1452032547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-aec43cb4-601b-4c91-983c-b1fce9321852 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:27 devstack sudo[97315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-aec43cb4-601b-4c91-983c-b1fce9321852 Sep 16 20:26:27 devstack sudo[97315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:27 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-d40e7105-299d-45b6-9766-502be1ac0326 tempest-VolumesActionsTest-852371490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:26:27 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-d40e7105-299d-45b6-9766-502be1ac0326 tempest-VolumesActionsTest-852371490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:26:27 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-d40e7105-299d-45b6-9766-502be1ac0326 tempest-VolumesActionsTest-852371490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:26:27 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-d40e7105-299d-45b6-9766-502be1ac0326 tempest-VolumesActionsTest-852371490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:26:27 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-d40e7105-299d-45b6-9766-502be1ac0326 tempest-VolumesActionsTest-852371490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:26:27 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-d40e7105-299d-45b6-9766-502be1ac0326 tempest-VolumesActionsTest-852371490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:27 devstack sudo[97299]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:27 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a9684eaa-35b4-4d21-82ed-8c991135559b tempest-SnapshotMetadataTestJSON-1031157924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-868fcc74-11e7-43aa-bad2-c54fd29d6a80 1073741824" returned: 0 in 0.585s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:27 devstack sudo[97317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:26:27 devstack sudo[97317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:27 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a9684eaa-35b4-4d21-82ed-8c991135559b tempest-SnapshotMetadataTestJSON-1031157924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-868fcc74-11e7-43aa-bad2-c54fd29d6a80 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:27 devstack sudo[97319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-868fcc74-11e7-43aa-bad2-c54fd29d6a80 Sep 16 20:26:27 devstack sudo[97319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:27 devstack sudo[97315]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:27 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-c802c7d3-bdb4-44ff-b42f-47924c504700 tempest-GroupsV314Test-1452032547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-aec43cb4-601b-4c91-983c-b1fce9321852" returned: 0 in 0.382s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:27 devstack sudo[97317]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:27 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-d40e7105-299d-45b6-9766-502be1ac0326 tempest-VolumesActionsTest-852371490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.369s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:27 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-d40e7105-299d-45b6-9766-502be1ac0326 tempest-VolumesActionsTest-852371490 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:26:27 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-c802c7d3-bdb4-44ff-b42f-47924c504700 tempest-GroupsV314Test-1452032547 None] Lock "cinder-quobyte-aec43cb4-601b-4c91-983c-b1fce9321852" released by "delete_volume" :: held 0.942s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:26:27 devstack sudo[97319]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:27 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a9684eaa-35b4-4d21-82ed-8c991135559b tempest-SnapshotMetadataTestJSON-1031157924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-868fcc74-11e7-43aa-bad2-c54fd29d6a80" returned: 0 in 0.347s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:27 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-a9684eaa-35b4-4d21-82ed-8c991135559b tempest-SnapshotMetadataTestJSON-1031157924 None] <== create_volume: return (988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:26:27 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a9684eaa-35b4-4d21-82ed-8c991135559b tempest-SnapshotMetadataTestJSON-1031157924 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.993s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:26:27 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-d40e7105-299d-45b6-9766-502be1ac0326 tempest-VolumesActionsTest-852371490 None] Deleted volume successfully. Sep 16 20:26:27 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a9684eaa-35b4-4d21-82ed-8c991135559b tempest-SnapshotMetadataTestJSON-1031157924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7d751aa-d23c-4c5b-90fb-ea7cb76c0dde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-868fcc74-11e7-43aa-bad2-c54fd29d6a80', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:26:27 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a9684eaa-35b4-4d21-82ed-8c991135559b tempest-SnapshotMetadataTestJSON-1031157924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddb7a81c-f961-42f5-8ea7-5e3ebe10bb54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:26:27 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-d40e7105-299d-45b6-9766-502be1ac0326 tempest-VolumesActionsTest-852371490 None] Lock "cinder-327179da-c752-4a01-829f-cca9b3bc6308-delete_volume" released by "delete_volume" :: held 1.595s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:26:27 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-a9684eaa-35b4-4d21-82ed-8c991135559b tempest-SnapshotMetadataTestJSON-1031157924 None] Volume volume-868fcc74-11e7-43aa-bad2-c54fd29d6a80 (868fcc74-11e7-43aa-bad2-c54fd29d6a80): created successfully Sep 16 20:26:27 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a9684eaa-35b4-4d21-82ed-8c991135559b tempest-SnapshotMetadataTestJSON-1031157924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddb7a81c-f961-42f5-8ea7-5e3ebe10bb54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:26:27 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a9684eaa-35b4-4d21-82ed-8c991135559b tempest-SnapshotMetadataTestJSON-1031157924 None] Flow 'volume_create_manager' (1e047b02-3071-4388-a079-fdec08ec8176) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:26:27 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-a9684eaa-35b4-4d21-82ed-8c991135559b tempest-SnapshotMetadataTestJSON-1031157924 None] Created volume successfully. Sep 16 20:26:27 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-c802c7d3-bdb4-44ff-b42f-47924c504700 tempest-GroupsV314Test-1452032547 None] Created reservations ['30faaf6d-5c4e-4090-88a1-c446d5972ac0'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:26:27 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-c802c7d3-bdb4-44ff-b42f-47924c504700 tempest-GroupsV314Test-1452032547 None] Created reservations ['d3f03776-4d32-4290-8908-8760cd496920', 'c63b6c65-ec1a-40dd-ab43-b10289de3fd7', '8beff4a4-7452-460f-9e28-37a72c57e0be', '5d1d2c3e-cea9-4766-ba9d-f85ef73577ac'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:26:28 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-c802c7d3-bdb4-44ff-b42f-47924c504700 tempest-GroupsV314Test-1452032547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:26:28 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-c802c7d3-bdb4-44ff-b42f-47924c504700 tempest-GroupsV314Test-1452032547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:26:28 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-c802c7d3-bdb4-44ff-b42f-47924c504700 tempest-GroupsV314Test-1452032547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:26:28 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-c802c7d3-bdb4-44ff-b42f-47924c504700 tempest-GroupsV314Test-1452032547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:26:28 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-c802c7d3-bdb4-44ff-b42f-47924c504700 tempest-GroupsV314Test-1452032547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:26:28 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-c802c7d3-bdb4-44ff-b42f-47924c504700 tempest-GroupsV314Test-1452032547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:28 devstack sudo[97340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:26:28 devstack sudo[97340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:28 devstack sudo[97340]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:28 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-c802c7d3-bdb4-44ff-b42f-47924c504700 tempest-GroupsV314Test-1452032547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.329s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:28 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-c802c7d3-bdb4-44ff-b42f-47924c504700 tempest-GroupsV314Test-1452032547 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:26:28 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-c802c7d3-bdb4-44ff-b42f-47924c504700 tempest-GroupsV314Test-1452032547 None] Delete group completed successfully. Sep 16 20:26:28 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-f1f07caa-2bf2-4bb2-95d9-b98df2c77cba tempest-SnapshotMetadataTestJSON-1031157924 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:26:28 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-f1f07caa-2bf2-4bb2-95d9-b98df2c77cba tempest-SnapshotMetadataTestJSON-1031157924 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:26:28 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-f1f07caa-2bf2-4bb2-95d9-b98df2c77cba tempest-SnapshotMetadataTestJSON-1031157924 None] Creating offline snapshot 11224d54-0200-4c41-a593-564bd04d9adb of volume 868fcc74-11e7-43aa-bad2-c54fd29d6a80 {{(pid=86188) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 20:26:28 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b6a8bd1-36a1-4fe2-8aed-124813c130ea]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:26:28 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f1f07caa-2bf2-4bb2-95d9-b98df2c77cba tempest-SnapshotMetadataTestJSON-1031157924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-868fcc74-11e7-43aa-bad2-c54fd29d6a80 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:29 devstack sudo[97351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-868fcc74-11e7-43aa-bad2-c54fd29d6a80 Sep 16 20:26:29 devstack sudo[97351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:29 devstack sudo[97351]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:29 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f1f07caa-2bf2-4bb2-95d9-b98df2c77cba tempest-SnapshotMetadataTestJSON-1031157924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-868fcc74-11e7-43aa-bad2-c54fd29d6a80" returned: 0 in 0.521s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:29 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f1f07caa-2bf2-4bb2-95d9-b98df2c77cba tempest-SnapshotMetadataTestJSON-1031157924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-868fcc74-11e7-43aa-bad2-c54fd29d6a80,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-868fcc74-11e7-43aa-bad2-c54fd29d6a80.11224d54-0200-4c41-a593-564bd04d9adb 1G {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:29 devstack sudo[97357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-868fcc74-11e7-43aa-bad2-c54fd29d6a80,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-868fcc74-11e7-43aa-bad2-c54fd29d6a80.11224d54-0200-4c41-a593-564bd04d9adb 1G Sep 16 20:26:29 devstack sudo[97357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:29 devstack sudo[97357]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:29 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f1f07caa-2bf2-4bb2-95d9-b98df2c77cba tempest-SnapshotMetadataTestJSON-1031157924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-868fcc74-11e7-43aa-bad2-c54fd29d6a80,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-868fcc74-11e7-43aa-bad2-c54fd29d6a80.11224d54-0200-4c41-a593-564bd04d9adb 1G" returned: 0 in 0.498s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:29 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f1f07caa-2bf2-4bb2-95d9-b98df2c77cba tempest-SnapshotMetadataTestJSON-1031157924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-868fcc74-11e7-43aa-bad2-c54fd29d6a80 -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-868fcc74-11e7-43aa-bad2-c54fd29d6a80.11224d54-0200-4c41-a593-564bd04d9adb {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:29 devstack sudo[97363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-868fcc74-11e7-43aa-bad2-c54fd29d6a80 -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-868fcc74-11e7-43aa-bad2-c54fd29d6a80.11224d54-0200-4c41-a593-564bd04d9adb Sep 16 20:26:29 devstack sudo[97363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:30 devstack sudo[97363]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:30 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f1f07caa-2bf2-4bb2-95d9-b98df2c77cba tempest-SnapshotMetadataTestJSON-1031157924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-868fcc74-11e7-43aa-bad2-c54fd29d6a80 -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-868fcc74-11e7-43aa-bad2-c54fd29d6a80.11224d54-0200-4c41-a593-564bd04d9adb" returned: 0 in 0.323s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:30 devstack cinder-volume[86188]: WARNING cinder.volume.drivers.remotefs [None req-f1f07caa-2bf2-4bb2-95d9-b98df2c77cba tempest-SnapshotMetadataTestJSON-1031157924 None] /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-868fcc74-11e7-43aa-bad2-c54fd29d6a80.11224d54-0200-4c41-a593-564bd04d9adb is being set with open permissions: ugo+rw Sep 16 20:26:30 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f1f07caa-2bf2-4bb2-95d9-b98df2c77cba tempest-SnapshotMetadataTestJSON-1031157924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-868fcc74-11e7-43aa-bad2-c54fd29d6a80.11224d54-0200-4c41-a593-564bd04d9adb {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:30 devstack sudo[97369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-868fcc74-11e7-43aa-bad2-c54fd29d6a80.11224d54-0200-4c41-a593-564bd04d9adb Sep 16 20:26:30 devstack sudo[97369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:30 devstack sudo[97369]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:30 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f1f07caa-2bf2-4bb2-95d9-b98df2c77cba tempest-SnapshotMetadataTestJSON-1031157924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-868fcc74-11e7-43aa-bad2-c54fd29d6a80.11224d54-0200-4c41-a593-564bd04d9adb" returned: 0 in 0.283s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:30 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f1f07caa-2bf2-4bb2-95d9-b98df2c77cba tempest-SnapshotMetadataTestJSON-1031157924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-868fcc74-11e7-43aa-bad2-c54fd29d6a80.info {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:30 devstack sudo[97373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-868fcc74-11e7-43aa-bad2-c54fd29d6a80.info Sep 16 20:26:30 devstack sudo[97373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:30 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-4aa91f7d-ebf3-456d-bdc3-0595d927efe7 tempest-VolumesActionsTest-852371490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:26:30 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-4aa91f7d-ebf3-456d-bdc3-0595d927efe7 tempest-VolumesActionsTest-852371490 None] Flow 'volume_create_manager' (80ef9d95-f668-48f0-8681-ea80612fc8b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:26:30 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-4aa91f7d-ebf3-456d-bdc3-0595d927efe7 tempest-VolumesActionsTest-852371490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7f3147c-1c8a-457c-bdd4-b2e8d0f1cbdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:26:30 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-4aa91f7d-ebf3-456d-bdc3-0595d927efe7 tempest-VolumesActionsTest-852371490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7f3147c-1c8a-457c-bdd4-b2e8d0f1cbdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:26:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1237909603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b262581-45bd-41f0-b06c-bd5162cd3e59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='241b8cb66c934319af2d98fd15cea960',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:26:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:26:31Z,use_quota=True,user_id='1ad5071e5a824fd7a960045be4b9a4db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:26:30 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-4aa91f7d-ebf3-456d-bdc3-0595d927efe7 tempest-VolumesActionsTest-852371490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b0a3483-76a9-4846-b55b-d9eea1ed3428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:26:30 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-4aa91f7d-ebf3-456d-bdc3-0595d927efe7 tempest-VolumesActionsTest-852371490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b0a3483-76a9-4846-b55b-d9eea1ed3428) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:26:30 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-4aa91f7d-ebf3-456d-bdc3-0595d927efe7 tempest-VolumesActionsTest-852371490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7307356-33ba-4771-8645-8de60cfa49b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:26:30 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-4aa91f7d-ebf3-456d-bdc3-0595d927efe7 tempest-VolumesActionsTest-852371490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7307356-33ba-4771-8645-8de60cfa49b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b262581-45bd-41f0-b06c-bd5162cd3e59', 'volume_name': 'volume-9b262581-45bd-41f0-b06c-bd5162cd3e59', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:26:30 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-4aa91f7d-ebf3-456d-bdc3-0595d927efe7 tempest-VolumesActionsTest-852371490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab3b3ec6-8a35-445e-9946-3728744f16f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:26:30 devstack sudo[97373]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:30 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-4aa91f7d-ebf3-456d-bdc3-0595d927efe7 tempest-VolumesActionsTest-852371490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab3b3ec6-8a35-445e-9946-3728744f16f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:26:30 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-4aa91f7d-ebf3-456d-bdc3-0595d927efe7 tempest-VolumesActionsTest-852371490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f0be905-d52b-4b7a-92c2-71dd671a965e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:26:30 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-4aa91f7d-ebf3-456d-bdc3-0595d927efe7 tempest-VolumesActionsTest-852371490 None] Volume 9b262581-45bd-41f0-b06c-bd5162cd3e59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b262581-45bd-41f0-b06c-bd5162cd3e59', 'volume_size': 1} Sep 16 20:26:30 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-4aa91f7d-ebf3-456d-bdc3-0595d927efe7 tempest-VolumesActionsTest-852371490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:26:30 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f1f07caa-2bf2-4bb2-95d9-b98df2c77cba tempest-SnapshotMetadataTestJSON-1031157924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-868fcc74-11e7-43aa-bad2-c54fd29d6a80.info" returned: 0 in 0.385s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:30 devstack cinder-volume[86188]: WARNING cinder.volume.drivers.remotefs [None req-f1f07caa-2bf2-4bb2-95d9-b98df2c77cba tempest-SnapshotMetadataTestJSON-1031157924 None] /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-868fcc74-11e7-43aa-bad2-c54fd29d6a80.info is being set with open permissions: ugo+rw Sep 16 20:26:30 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f1f07caa-2bf2-4bb2-95d9-b98df2c77cba tempest-SnapshotMetadataTestJSON-1031157924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-868fcc74-11e7-43aa-bad2-c54fd29d6a80.info {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:31 devstack sudo[97376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-868fcc74-11e7-43aa-bad2-c54fd29d6a80.info Sep 16 20:26:31 devstack sudo[97376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:31 devstack sudo[97376]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:31 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f1f07caa-2bf2-4bb2-95d9-b98df2c77cba tempest-SnapshotMetadataTestJSON-1031157924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-868fcc74-11e7-43aa-bad2-c54fd29d6a80.info" returned: 0 in 0.284s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:31 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-f1f07caa-2bf2-4bb2-95d9-b98df2c77cba tempest-SnapshotMetadataTestJSON-1031157924 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.436s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:26:31 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-4aa91f7d-ebf3-456d-bdc3-0595d927efe7 tempest-VolumesActionsTest-852371490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.311s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:26:31 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-4aa91f7d-ebf3-456d-bdc3-0595d927efe7 tempest-VolumesActionsTest-852371490 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:26:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1237909603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b262581-45bd-41f0-b06c-bd5162cd3e59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='241b8cb66c934319af2d98fd15cea960',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:26:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:26:31Z,use_quota=True,user_id='1ad5071e5a824fd7a960045be4b9a4db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:26:31 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-4aa91f7d-ebf3-456d-bdc3-0595d927efe7 tempest-VolumesActionsTest-852371490 None] Creating volume 9b262581-45bd-41f0-b06c-bd5162cd3e59 {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:26:31 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-4aa91f7d-ebf3-456d-bdc3-0595d927efe7 tempest-VolumesActionsTest-852371490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:26:31 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-4aa91f7d-ebf3-456d-bdc3-0595d927efe7 tempest-VolumesActionsTest-852371490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:26:31 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-4aa91f7d-ebf3-456d-bdc3-0595d927efe7 tempest-VolumesActionsTest-852371490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:26:31 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-4aa91f7d-ebf3-456d-bdc3-0595d927efe7 tempest-VolumesActionsTest-852371490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:26:31 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-4aa91f7d-ebf3-456d-bdc3-0595d927efe7 tempest-VolumesActionsTest-852371490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:26:31 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-4aa91f7d-ebf3-456d-bdc3-0595d927efe7 tempest-VolumesActionsTest-852371490 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:26:31 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-4aa91f7d-ebf3-456d-bdc3-0595d927efe7 tempest-VolumesActionsTest-852371490 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:26:31 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-4aa91f7d-ebf3-456d-bdc3-0595d927efe7 tempest-VolumesActionsTest-852371490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9b262581-45bd-41f0-b06c-bd5162cd3e59 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:31 devstack sudo[97379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9b262581-45bd-41f0-b06c-bd5162cd3e59 1073741824 Sep 16 20:26:31 devstack sudo[97379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:31 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-f1f07caa-2bf2-4bb2-95d9-b98df2c77cba tempest-SnapshotMetadataTestJSON-1031157924 None] Create snapshot completed successfully Sep 16 20:26:31 devstack sudo[97379]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:31 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-4aa91f7d-ebf3-456d-bdc3-0595d927efe7 tempest-VolumesActionsTest-852371490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9b262581-45bd-41f0-b06c-bd5162cd3e59 1073741824" returned: 0 in 0.514s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:31 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-4aa91f7d-ebf3-456d-bdc3-0595d927efe7 tempest-VolumesActionsTest-852371490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9b262581-45bd-41f0-b06c-bd5162cd3e59 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:31 devstack sudo[97385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9b262581-45bd-41f0-b06c-bd5162cd3e59 Sep 16 20:26:31 devstack sudo[97385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:32 devstack sudo[97385]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:32 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-4aa91f7d-ebf3-456d-bdc3-0595d927efe7 tempest-VolumesActionsTest-852371490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9b262581-45bd-41f0-b06c-bd5162cd3e59" returned: 0 in 0.271s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:32 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-4aa91f7d-ebf3-456d-bdc3-0595d927efe7 tempest-VolumesActionsTest-852371490 None] <== create_volume: return (839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:26:32 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-4aa91f7d-ebf3-456d-bdc3-0595d927efe7 tempest-VolumesActionsTest-852371490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.842s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:26:32 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-4aa91f7d-ebf3-456d-bdc3-0595d927efe7 tempest-VolumesActionsTest-852371490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f0be905-d52b-4b7a-92c2-71dd671a965e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b262581-45bd-41f0-b06c-bd5162cd3e59', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:26:32 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-4aa91f7d-ebf3-456d-bdc3-0595d927efe7 tempest-VolumesActionsTest-852371490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aed60661-6148-40b4-8b98-57bd302bcffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:26:32 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-4aa91f7d-ebf3-456d-bdc3-0595d927efe7 tempest-VolumesActionsTest-852371490 None] Volume volume-9b262581-45bd-41f0-b06c-bd5162cd3e59 (9b262581-45bd-41f0-b06c-bd5162cd3e59): created successfully Sep 16 20:26:32 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-4aa91f7d-ebf3-456d-bdc3-0595d927efe7 tempest-VolumesActionsTest-852371490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aed60661-6148-40b4-8b98-57bd302bcffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:26:32 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-4aa91f7d-ebf3-456d-bdc3-0595d927efe7 tempest-VolumesActionsTest-852371490 None] Flow 'volume_create_manager' (80ef9d95-f668-48f0-8681-ea80612fc8b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:26:32 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-4aa91f7d-ebf3-456d-bdc3-0595d927efe7 tempest-VolumesActionsTest-852371490 None] Created volume successfully. Sep 16 20:26:33 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-d3395159-57a8-4efc-a0e6-eb00defae9ac tempest-VolumesActionsTest-1567958602 None] Acquiring lock "cinder-9b262581-45bd-41f0-b06c-bd5162cd3e59-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:26:33 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-d3395159-57a8-4efc-a0e6-eb00defae9ac tempest-VolumesActionsTest-1567958602 None] Lock "cinder-9b262581-45bd-41f0-b06c-bd5162cd3e59-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:26:33 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-ed226b62-a57b-43d1-8143-4984f57d3688 tempest-SnapshotMetadataTestJSON-1031157924 None] Acquiring lock "cinder-11224d54-0200-4c41-a593-564bd04d9adb-delete_snapshot" by "delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:26:33 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-d3395159-57a8-4efc-a0e6-eb00defae9ac tempest-VolumesActionsTest-1567958602 None] Acquiring lock "cinder-quobyte-9b262581-45bd-41f0-b06c-bd5162cd3e59" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:26:33 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-ed226b62-a57b-43d1-8143-4984f57d3688 tempest-SnapshotMetadataTestJSON-1031157924 None] Lock "cinder-11224d54-0200-4c41-a593-564bd04d9adb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:26:33 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-ed226b62-a57b-43d1-8143-4984f57d3688 tempest-SnapshotMetadataTestJSON-1031157924 None] Acquiring lock "cinder-quobyte-868fcc74-11e7-43aa-bad2-c54fd29d6a80" by "delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:26:33 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-d3395159-57a8-4efc-a0e6-eb00defae9ac tempest-VolumesActionsTest-1567958602 None] Lock "cinder-quobyte-9b262581-45bd-41f0-b06c-bd5162cd3e59" acquired by "delete_volume" :: waited 0.028s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:26:33 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-ed226b62-a57b-43d1-8143-4984f57d3688 tempest-SnapshotMetadataTestJSON-1031157924 None] Lock "cinder-quobyte-868fcc74-11e7-43aa-bad2-c54fd29d6a80" acquired by "delete_snapshot" :: waited 0.047s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:26:33 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-ed226b62-a57b-43d1-8143-4984f57d3688 tempest-SnapshotMetadataTestJSON-1031157924 None] Acquiring lock "cinder-quobyte-11224d54-0200-4c41-a593-564bd04d9adb" by "_delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:26:33 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d4f2620-b8dc-4268-b8d6-1f3af89410cb]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:26:33 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-d3395159-57a8-4efc-a0e6-eb00defae9ac tempest-VolumesActionsTest-1567958602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9b262581-45bd-41f0-b06c-bd5162cd3e59 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:33 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-ed226b62-a57b-43d1-8143-4984f57d3688 tempest-SnapshotMetadataTestJSON-1031157924 None] Lock "cinder-quobyte-11224d54-0200-4c41-a593-564bd04d9adb" acquired by "_delete_snapshot" :: waited 0.058s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:26:33 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-ed226b62-a57b-43d1-8143-4984f57d3688 tempest-SnapshotMetadataTestJSON-1031157924 None] Deleting offline snapshot 11224d54-0200-4c41-a593-564bd04d9adb of volume 868fcc74-11e7-43aa-bad2-c54fd29d6a80 {{(pid=86188) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 20:26:33 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-ed226b62-a57b-43d1-8143-4984f57d3688 tempest-SnapshotMetadataTestJSON-1031157924 None] snapshot_file for this snap is: volume-868fcc74-11e7-43aa-bad2-c54fd29d6a80.11224d54-0200-4c41-a593-564bd04d9adb {{(pid=86188) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 20:26:33 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dc9d0ea-47c6-4f3c-bc6f-6fc276718303]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:26:33 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ed226b62-a57b-43d1-8143-4984f57d3688 tempest-SnapshotMetadataTestJSON-1031157924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-868fcc74-11e7-43aa-bad2-c54fd29d6a80.11224d54-0200-4c41-a593-564bd04d9adb {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:33 devstack sudo[97388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9b262581-45bd-41f0-b06c-bd5162cd3e59 Sep 16 20:26:33 devstack sudo[97388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:33 devstack sudo[97389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-868fcc74-11e7-43aa-bad2-c54fd29d6a80.11224d54-0200-4c41-a593-564bd04d9adb Sep 16 20:26:33 devstack sudo[97389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:33 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-57c7c010-8778-4e2d-bb8a-dc1551c86d78 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:26:33 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-57c7c010-8778-4e2d-bb8a-dc1551c86d78 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Flow 'volume_create_manager' (f2863732-393d-44ee-9b67-d9d5845ff820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:26:33 devstack sudo[97388]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:33 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-57c7c010-8778-4e2d-bb8a-dc1551c86d78 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (187bbbfb-661f-43d3-9c7b-4e87ec52ed15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:26:33 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-d3395159-57a8-4efc-a0e6-eb00defae9ac tempest-VolumesActionsTest-1567958602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9b262581-45bd-41f0-b06c-bd5162cd3e59" returned: 0 in 0.605s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:33 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-d3395159-57a8-4efc-a0e6-eb00defae9ac tempest-VolumesActionsTest-1567958602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9b262581-45bd-41f0-b06c-bd5162cd3e59 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:33 devstack sudo[97389]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:33 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ed226b62-a57b-43d1-8143-4984f57d3688 tempest-SnapshotMetadataTestJSON-1031157924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-868fcc74-11e7-43aa-bad2-c54fd29d6a80.11224d54-0200-4c41-a593-564bd04d9adb" returned: 0 in 0.516s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:33 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-ed226b62-a57b-43d1-8143-4984f57d3688 tempest-SnapshotMetadataTestJSON-1031157924 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-868fcc74-11e7-43aa-bad2-c54fd29d6a80(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86188) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 20:26:33 devstack sudo[97398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9b262581-45bd-41f0-b06c-bd5162cd3e59 Sep 16 20:26:33 devstack sudo[97398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:34 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-57c7c010-8778-4e2d-bb8a-dc1551c86d78 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (187bbbfb-661f-43d3-9c7b-4e87ec52ed15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:26:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1349771576',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86fe5af1-92c6-45b0-81eb-04a5259b0964,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a489ad938cc84fb4a2f328f6ddc72940',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:26:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:26:34Z,use_quota=True,user_id='3656a2b8cd84461293ad1284e7c235f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:26:34 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-57c7c010-8778-4e2d-bb8a-dc1551c86d78 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (828c09a6-3e4e-48d8-95ea-0970e1993ae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:26:34 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-57c7c010-8778-4e2d-bb8a-dc1551c86d78 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (828c09a6-3e4e-48d8-95ea-0970e1993ae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:26:34 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-57c7c010-8778-4e2d-bb8a-dc1551c86d78 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3f4288e-3318-457b-9563-c04248d5009d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:26:34 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-57c7c010-8778-4e2d-bb8a-dc1551c86d78 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3f4288e-3318-457b-9563-c04248d5009d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86fe5af1-92c6-45b0-81eb-04a5259b0964', 'volume_name': 'volume-86fe5af1-92c6-45b0-81eb-04a5259b0964', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:26:34 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-57c7c010-8778-4e2d-bb8a-dc1551c86d78 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (579d7ce7-cba5-433c-8c97-07553c374753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:26:34 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-57c7c010-8778-4e2d-bb8a-dc1551c86d78 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (579d7ce7-cba5-433c-8c97-07553c374753) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:26:34 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-57c7c010-8778-4e2d-bb8a-dc1551c86d78 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbab1792-64f1-4b96-a5c6-c53df5a5bed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:26:34 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-57c7c010-8778-4e2d-bb8a-dc1551c86d78 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Volume 86fe5af1-92c6-45b0-81eb-04a5259b0964: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86fe5af1-92c6-45b0-81eb-04a5259b0964', 'volume_size': 1} Sep 16 20:26:34 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-57c7c010-8778-4e2d-bb8a-dc1551c86d78 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:26:34 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-57c7c010-8778-4e2d-bb8a-dc1551c86d78 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:26:34 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-57c7c010-8778-4e2d-bb8a-dc1551c86d78 tempest-CreateVolumesFromSnapshotTest-1034816622 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:26:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1349771576',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86fe5af1-92c6-45b0-81eb-04a5259b0964,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a489ad938cc84fb4a2f328f6ddc72940',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:26:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:26:34Z,use_quota=True,user_id='3656a2b8cd84461293ad1284e7c235f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:26:34 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-57c7c010-8778-4e2d-bb8a-dc1551c86d78 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Creating volume 86fe5af1-92c6-45b0-81eb-04a5259b0964 {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:26:34 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-57c7c010-8778-4e2d-bb8a-dc1551c86d78 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:26:34 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-57c7c010-8778-4e2d-bb8a-dc1551c86d78 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:26:34 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-57c7c010-8778-4e2d-bb8a-dc1551c86d78 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:26:34 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-57c7c010-8778-4e2d-bb8a-dc1551c86d78 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:26:34 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-57c7c010-8778-4e2d-bb8a-dc1551c86d78 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:26:34 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-57c7c010-8778-4e2d-bb8a-dc1551c86d78 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:26:34 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-57c7c010-8778-4e2d-bb8a-dc1551c86d78 tempest-CreateVolumesFromSnapshotTest-1034816622 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:26:34 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-57c7c010-8778-4e2d-bb8a-dc1551c86d78 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-86fe5af1-92c6-45b0-81eb-04a5259b0964 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:34 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[594142f5-939c-42d8-8f38-87304bd62bd6]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:26:34 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ed226b62-a57b-43d1-8143-4984f57d3688 tempest-SnapshotMetadataTestJSON-1031157924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-868fcc74-11e7-43aa-bad2-c54fd29d6a80 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:34 devstack sudo[97400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-86fe5af1-92c6-45b0-81eb-04a5259b0964 1073741824 Sep 16 20:26:34 devstack sudo[97400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:34 devstack sudo[97398]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:34 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-d3395159-57a8-4efc-a0e6-eb00defae9ac tempest-VolumesActionsTest-1567958602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9b262581-45bd-41f0-b06c-bd5162cd3e59" returned: 0 in 0.273s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:34 devstack sudo[97401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-868fcc74-11e7-43aa-bad2-c54fd29d6a80 Sep 16 20:26:34 devstack sudo[97401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:34 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-d3395159-57a8-4efc-a0e6-eb00defae9ac tempest-VolumesActionsTest-1567958602 None] Lock "cinder-quobyte-9b262581-45bd-41f0-b06c-bd5162cd3e59" released by "delete_volume" :: held 0.965s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:26:34 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-d3395159-57a8-4efc-a0e6-eb00defae9ac tempest-VolumesActionsTest-1567958602 None] Created reservations ['25de3c69-1d03-4757-9cef-4ba5784a7d0a', '8877c1ca-cd89-4ac0-8b31-de3d258a6af8', 'c1025893-0416-4568-b696-06176112395e', '8706d9d0-dcc9-4eb3-9e32-bbb92ea116e3'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:26:34 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-d3395159-57a8-4efc-a0e6-eb00defae9ac tempest-VolumesActionsTest-1567958602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:26:34 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-d3395159-57a8-4efc-a0e6-eb00defae9ac tempest-VolumesActionsTest-1567958602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:26:34 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-d3395159-57a8-4efc-a0e6-eb00defae9ac tempest-VolumesActionsTest-1567958602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:26:34 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-d3395159-57a8-4efc-a0e6-eb00defae9ac tempest-VolumesActionsTest-1567958602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:26:34 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-d3395159-57a8-4efc-a0e6-eb00defae9ac tempest-VolumesActionsTest-1567958602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:26:34 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-d3395159-57a8-4efc-a0e6-eb00defae9ac tempest-VolumesActionsTest-1567958602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:34 devstack sudo[97408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:26:34 devstack sudo[97408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:34 devstack sudo[97401]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:34 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ed226b62-a57b-43d1-8143-4984f57d3688 tempest-SnapshotMetadataTestJSON-1031157924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-868fcc74-11e7-43aa-bad2-c54fd29d6a80" returned: 0 in 0.557s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:34 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ed226b62-a57b-43d1-8143-4984f57d3688 tempest-SnapshotMetadataTestJSON-1031157924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-868fcc74-11e7-43aa-bad2-c54fd29d6a80.11224d54-0200-4c41-a593-564bd04d9adb {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:34 devstack sudo[97400]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:34 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-57c7c010-8778-4e2d-bb8a-dc1551c86d78 tempest-CreateVolumesFromSnapshotTest-1034816622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-86fe5af1-92c6-45b0-81eb-04a5259b0964 1073741824" returned: 0 in 0.603s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:34 devstack sudo[97413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-868fcc74-11e7-43aa-bad2-c54fd29d6a80.11224d54-0200-4c41-a593-564bd04d9adb Sep 16 20:26:34 devstack sudo[97413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:34 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-57c7c010-8778-4e2d-bb8a-dc1551c86d78 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-86fe5af1-92c6-45b0-81eb-04a5259b0964 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:34 devstack sudo[97415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-86fe5af1-92c6-45b0-81eb-04a5259b0964 Sep 16 20:26:34 devstack sudo[97415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:34 devstack sudo[97408]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:34 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-d3395159-57a8-4efc-a0e6-eb00defae9ac tempest-VolumesActionsTest-1567958602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.414s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:34 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-d3395159-57a8-4efc-a0e6-eb00defae9ac tempest-VolumesActionsTest-1567958602 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:26:34 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-d3395159-57a8-4efc-a0e6-eb00defae9ac tempest-VolumesActionsTest-1567958602 None] Deleted volume successfully. Sep 16 20:26:34 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-d3395159-57a8-4efc-a0e6-eb00defae9ac tempest-VolumesActionsTest-1567958602 None] Lock "cinder-9b262581-45bd-41f0-b06c-bd5162cd3e59-delete_volume" released by "delete_volume" :: held 1.705s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:26:35 devstack sudo[97413]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:35 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ed226b62-a57b-43d1-8143-4984f57d3688 tempest-SnapshotMetadataTestJSON-1031157924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-868fcc74-11e7-43aa-bad2-c54fd29d6a80.11224d54-0200-4c41-a593-564bd04d9adb" returned: 0 in 0.500s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:35 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ed226b62-a57b-43d1-8143-4984f57d3688 tempest-SnapshotMetadataTestJSON-1031157924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-868fcc74-11e7-43aa-bad2-c54fd29d6a80.11224d54-0200-4c41-a593-564bd04d9adb {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:35 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-20236610-854c-40b5-809c-a039f4ddccc2 tempest-VolumesActionsTest-852371490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:26:35 devstack sudo[97415]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:35 devstack sudo[97422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-868fcc74-11e7-43aa-bad2-c54fd29d6a80.11224d54-0200-4c41-a593-564bd04d9adb Sep 16 20:26:35 devstack sudo[97422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:35 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-20236610-854c-40b5-809c-a039f4ddccc2 tempest-VolumesActionsTest-852371490 None] Flow 'volume_create_manager' (69b157cb-3b60-4a13-b0d3-949f8a5d4282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:26:35 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-20236610-854c-40b5-809c-a039f4ddccc2 tempest-VolumesActionsTest-852371490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b631c508-fe57-4314-b25f-b059c16d2174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:26:35 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-57c7c010-8778-4e2d-bb8a-dc1551c86d78 tempest-CreateVolumesFromSnapshotTest-1034816622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-86fe5af1-92c6-45b0-81eb-04a5259b0964" returned: 0 in 0.458s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:35 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-57c7c010-8778-4e2d-bb8a-dc1551c86d78 tempest-CreateVolumesFromSnapshotTest-1034816622 None] <== create_volume: return (1139ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:26:35 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-57c7c010-8778-4e2d-bb8a-dc1551c86d78 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.141s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:26:35 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-20236610-854c-40b5-809c-a039f4ddccc2 tempest-VolumesActionsTest-852371490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b631c508-fe57-4314-b25f-b059c16d2174) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:26:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1855123771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f2af323-0f0e-423e-8550-98bde73314c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='241b8cb66c934319af2d98fd15cea960',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:26:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:26:35Z,use_quota=True,user_id='1ad5071e5a824fd7a960045be4b9a4db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:26:35 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-20236610-854c-40b5-809c-a039f4ddccc2 tempest-VolumesActionsTest-852371490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48d3410a-9ba8-4578-b7a0-9ddda9038446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:26:35 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-20236610-854c-40b5-809c-a039f4ddccc2 tempest-VolumesActionsTest-852371490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48d3410a-9ba8-4578-b7a0-9ddda9038446) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:26:35 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-20236610-854c-40b5-809c-a039f4ddccc2 tempest-VolumesActionsTest-852371490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (701aa6f2-b985-4342-aa56-aa2fd9fddc92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:26:35 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-20236610-854c-40b5-809c-a039f4ddccc2 tempest-VolumesActionsTest-852371490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (701aa6f2-b985-4342-aa56-aa2fd9fddc92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f2af323-0f0e-423e-8550-98bde73314c0', 'volume_name': 'volume-4f2af323-0f0e-423e-8550-98bde73314c0', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:26:35 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-20236610-854c-40b5-809c-a039f4ddccc2 tempest-VolumesActionsTest-852371490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dcb43d4-5aca-47f0-8840-8d441cb1e70d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:26:35 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-20236610-854c-40b5-809c-a039f4ddccc2 tempest-VolumesActionsTest-852371490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dcb43d4-5aca-47f0-8840-8d441cb1e70d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:26:35 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-20236610-854c-40b5-809c-a039f4ddccc2 tempest-VolumesActionsTest-852371490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b616c8f6-3941-491d-9eac-b83bdb9e9081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:26:35 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-20236610-854c-40b5-809c-a039f4ddccc2 tempest-VolumesActionsTest-852371490 None] Volume 4f2af323-0f0e-423e-8550-98bde73314c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f2af323-0f0e-423e-8550-98bde73314c0', 'volume_size': 1} Sep 16 20:26:35 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-20236610-854c-40b5-809c-a039f4ddccc2 tempest-VolumesActionsTest-852371490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:26:35 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-20236610-854c-40b5-809c-a039f4ddccc2 tempest-VolumesActionsTest-852371490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:26:35 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-20236610-854c-40b5-809c-a039f4ddccc2 tempest-VolumesActionsTest-852371490 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:26:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1855123771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f2af323-0f0e-423e-8550-98bde73314c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='241b8cb66c934319af2d98fd15cea960',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:26:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:26:35Z,use_quota=True,user_id='1ad5071e5a824fd7a960045be4b9a4db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:26:35 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-20236610-854c-40b5-809c-a039f4ddccc2 tempest-VolumesActionsTest-852371490 None] Creating volume 4f2af323-0f0e-423e-8550-98bde73314c0 {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:26:35 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-20236610-854c-40b5-809c-a039f4ddccc2 tempest-VolumesActionsTest-852371490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:26:35 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-20236610-854c-40b5-809c-a039f4ddccc2 tempest-VolumesActionsTest-852371490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:26:35 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-20236610-854c-40b5-809c-a039f4ddccc2 tempest-VolumesActionsTest-852371490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:26:35 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-20236610-854c-40b5-809c-a039f4ddccc2 tempest-VolumesActionsTest-852371490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:26:35 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-20236610-854c-40b5-809c-a039f4ddccc2 tempest-VolumesActionsTest-852371490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:26:35 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-20236610-854c-40b5-809c-a039f4ddccc2 tempest-VolumesActionsTest-852371490 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:26:35 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-20236610-854c-40b5-809c-a039f4ddccc2 tempest-VolumesActionsTest-852371490 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:26:35 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-20236610-854c-40b5-809c-a039f4ddccc2 tempest-VolumesActionsTest-852371490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-4f2af323-0f0e-423e-8550-98bde73314c0 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:35 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-57c7c010-8778-4e2d-bb8a-dc1551c86d78 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbab1792-64f1-4b96-a5c6-c53df5a5bed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86fe5af1-92c6-45b0-81eb-04a5259b0964', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:26:35 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-57c7c010-8778-4e2d-bb8a-dc1551c86d78 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6ae11bd-d054-4899-96dc-5f76aaed0967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:26:35 devstack sudo[97424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-4f2af323-0f0e-423e-8550-98bde73314c0 1073741824 Sep 16 20:26:35 devstack sudo[97424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:35 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-57c7c010-8778-4e2d-bb8a-dc1551c86d78 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Volume volume-86fe5af1-92c6-45b0-81eb-04a5259b0964 (86fe5af1-92c6-45b0-81eb-04a5259b0964): created successfully Sep 16 20:26:35 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-57c7c010-8778-4e2d-bb8a-dc1551c86d78 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6ae11bd-d054-4899-96dc-5f76aaed0967) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:26:35 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-57c7c010-8778-4e2d-bb8a-dc1551c86d78 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Flow 'volume_create_manager' (f2863732-393d-44ee-9b67-d9d5845ff820) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:26:35 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-57c7c010-8778-4e2d-bb8a-dc1551c86d78 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Created volume successfully. Sep 16 20:26:35 devstack sudo[97422]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:35 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ed226b62-a57b-43d1-8143-4984f57d3688 tempest-SnapshotMetadataTestJSON-1031157924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-868fcc74-11e7-43aa-bad2-c54fd29d6a80.11224d54-0200-4c41-a593-564bd04d9adb" returned: 0 in 0.296s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:35 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-ed226b62-a57b-43d1-8143-4984f57d3688 tempest-SnapshotMetadataTestJSON-1031157924 None] Lock "cinder-quobyte-11224d54-0200-4c41-a593-564bd04d9adb" released by "_delete_snapshot" :: held 2.108s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:26:35 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-ed226b62-a57b-43d1-8143-4984f57d3688 tempest-SnapshotMetadataTestJSON-1031157924 None] Lock "cinder-quobyte-868fcc74-11e7-43aa-bad2-c54fd29d6a80" released by "delete_snapshot" :: held 2.173s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:26:35 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-ed226b62-a57b-43d1-8143-4984f57d3688 tempest-SnapshotMetadataTestJSON-1031157924 None] Created reservations ['a8845d79-7700-4cf0-830e-48d0d34b98f6', '0ab4548a-6538-458b-9e18-29842b041ff8', 'a3bb6488-49ce-49f3-bbf5-f13055268df1', '243ff8ff-09eb-468a-a8d9-ec8c40fdb2e8'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:26:35 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-ed226b62-a57b-43d1-8143-4984f57d3688 tempest-SnapshotMetadataTestJSON-1031157924 None] Delete snapshot completed successfully. Sep 16 20:26:35 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-ed226b62-a57b-43d1-8143-4984f57d3688 tempest-SnapshotMetadataTestJSON-1031157924 None] Lock "cinder-11224d54-0200-4c41-a593-564bd04d9adb-delete_snapshot" released by "delete_snapshot" :: held 2.360s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:26:35 devstack sudo[97424]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:35 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-20236610-854c-40b5-809c-a039f4ddccc2 tempest-VolumesActionsTest-852371490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-4f2af323-0f0e-423e-8550-98bde73314c0 1073741824" returned: 0 in 0.490s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:35 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-20236610-854c-40b5-809c-a039f4ddccc2 tempest-VolumesActionsTest-852371490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-4f2af323-0f0e-423e-8550-98bde73314c0 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:35 devstack sudo[97432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-4f2af323-0f0e-423e-8550-98bde73314c0 Sep 16 20:26:35 devstack sudo[97432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:36 devstack sudo[97432]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:36 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-20236610-854c-40b5-809c-a039f4ddccc2 tempest-VolumesActionsTest-852371490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-4f2af323-0f0e-423e-8550-98bde73314c0" returned: 0 in 0.297s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:36 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-20236610-854c-40b5-809c-a039f4ddccc2 tempest-VolumesActionsTest-852371490 None] <== create_volume: return (828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:26:36 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-20236610-854c-40b5-809c-a039f4ddccc2 tempest-VolumesActionsTest-852371490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.831s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:26:36 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-20236610-854c-40b5-809c-a039f4ddccc2 tempest-VolumesActionsTest-852371490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b616c8f6-3941-491d-9eac-b83bdb9e9081) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f2af323-0f0e-423e-8550-98bde73314c0', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:26:36 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-20236610-854c-40b5-809c-a039f4ddccc2 tempest-VolumesActionsTest-852371490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (927c502d-c897-49e8-93f9-eba191e3dabe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:26:36 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-20236610-854c-40b5-809c-a039f4ddccc2 tempest-VolumesActionsTest-852371490 None] Volume volume-4f2af323-0f0e-423e-8550-98bde73314c0 (4f2af323-0f0e-423e-8550-98bde73314c0): created successfully Sep 16 20:26:36 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-20236610-854c-40b5-809c-a039f4ddccc2 tempest-VolumesActionsTest-852371490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (927c502d-c897-49e8-93f9-eba191e3dabe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:26:36 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-20236610-854c-40b5-809c-a039f4ddccc2 tempest-VolumesActionsTest-852371490 None] Flow 'volume_create_manager' (69b157cb-3b60-4a13-b0d3-949f8a5d4282) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:26:36 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-20236610-854c-40b5-809c-a039f4ddccc2 tempest-VolumesActionsTest-852371490 None] Created volume successfully. Sep 16 20:26:36 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-748046d9-1df4-407d-b91a-9b4a31337193 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:26:36 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-748046d9-1df4-407d-b91a-9b4a31337193 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:26:36 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-748046d9-1df4-407d-b91a-9b4a31337193 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Creating offline snapshot fa81d337-0581-4321-88b0-f7694a722a13 of volume 86fe5af1-92c6-45b0-81eb-04a5259b0964 {{(pid=86188) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 20:26:36 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d9c4cdb-2783-4051-9c5b-d37e210bd8e5]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:26:36 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-748046d9-1df4-407d-b91a-9b4a31337193 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-86fe5af1-92c6-45b0-81eb-04a5259b0964 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:36 devstack sudo[97435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-86fe5af1-92c6-45b0-81eb-04a5259b0964 Sep 16 20:26:36 devstack sudo[97435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:36 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-190d4c46-6931-486d-a494-4ccc0aaed3ec tempest-GroupsV320Test-487131809 None] Group tempest-GroupsV320Test-Group-1509148479: creating Sep 16 20:26:36 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-190d4c46-6931-486d-a494-4ccc0aaed3ec tempest-GroupsV320Test-487131809 None] Group tempest-GroupsV320Test-Group-1509148479: created successfully Sep 16 20:26:36 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-190d4c46-6931-486d-a494-4ccc0aaed3ec tempest-GroupsV320Test-487131809 None] Create group completed successfully. Sep 16 20:26:36 devstack sudo[97435]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:36 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-748046d9-1df4-407d-b91a-9b4a31337193 tempest-CreateVolumesFromSnapshotTest-1034816622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-86fe5af1-92c6-45b0-81eb-04a5259b0964" returned: 0 in 0.380s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:36 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-748046d9-1df4-407d-b91a-9b4a31337193 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-86fe5af1-92c6-45b0-81eb-04a5259b0964,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-86fe5af1-92c6-45b0-81eb-04a5259b0964.fa81d337-0581-4321-88b0-f7694a722a13 1G {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:36 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-5baa1cff-91ed-4855-a53b-c0f99a8d2910 tempest-SnapshotMetadataTestJSON-1031157924 None] Acquiring lock "cinder-868fcc74-11e7-43aa-bad2-c54fd29d6a80-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:26:36 devstack sudo[97441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-86fe5af1-92c6-45b0-81eb-04a5259b0964,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-86fe5af1-92c6-45b0-81eb-04a5259b0964.fa81d337-0581-4321-88b0-f7694a722a13 1G Sep 16 20:26:36 devstack sudo[97441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:36 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-5baa1cff-91ed-4855-a53b-c0f99a8d2910 tempest-SnapshotMetadataTestJSON-1031157924 None] Lock "cinder-868fcc74-11e7-43aa-bad2-c54fd29d6a80-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:26:36 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-5baa1cff-91ed-4855-a53b-c0f99a8d2910 tempest-SnapshotMetadataTestJSON-1031157924 None] Acquiring lock "cinder-quobyte-868fcc74-11e7-43aa-bad2-c54fd29d6a80" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:26:36 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-5baa1cff-91ed-4855-a53b-c0f99a8d2910 tempest-SnapshotMetadataTestJSON-1031157924 None] Lock "cinder-quobyte-868fcc74-11e7-43aa-bad2-c54fd29d6a80" acquired by "delete_volume" :: waited 0.015s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:26:36 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca7c6def-defb-4522-9bfa-3a59f3ee682e]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:26:36 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-5baa1cff-91ed-4855-a53b-c0f99a8d2910 tempest-SnapshotMetadataTestJSON-1031157924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-868fcc74-11e7-43aa-bad2-c54fd29d6a80 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:36 devstack sudo[97443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-868fcc74-11e7-43aa-bad2-c54fd29d6a80 Sep 16 20:26:36 devstack sudo[97443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:36 devstack sudo[97441]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:36 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-748046d9-1df4-407d-b91a-9b4a31337193 tempest-CreateVolumesFromSnapshotTest-1034816622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-86fe5af1-92c6-45b0-81eb-04a5259b0964,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-86fe5af1-92c6-45b0-81eb-04a5259b0964.fa81d337-0581-4321-88b0-f7694a722a13 1G" returned: 0 in 0.393s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:36 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-748046d9-1df4-407d-b91a-9b4a31337193 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86fe5af1-92c6-45b0-81eb-04a5259b0964 -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-86fe5af1-92c6-45b0-81eb-04a5259b0964.fa81d337-0581-4321-88b0-f7694a722a13 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:37 devstack sudo[97448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86fe5af1-92c6-45b0-81eb-04a5259b0964 -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-86fe5af1-92c6-45b0-81eb-04a5259b0964.fa81d337-0581-4321-88b0-f7694a722a13 Sep 16 20:26:37 devstack sudo[97448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:37 devstack sudo[97443]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:37 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-5baa1cff-91ed-4855-a53b-c0f99a8d2910 tempest-SnapshotMetadataTestJSON-1031157924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-868fcc74-11e7-43aa-bad2-c54fd29d6a80" returned: 0 in 0.383s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:37 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-5baa1cff-91ed-4855-a53b-c0f99a8d2910 tempest-SnapshotMetadataTestJSON-1031157924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-868fcc74-11e7-43aa-bad2-c54fd29d6a80 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:37 devstack sudo[97453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-868fcc74-11e7-43aa-bad2-c54fd29d6a80 Sep 16 20:26:37 devstack sudo[97453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:37 devstack sudo[97448]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:37 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-748046d9-1df4-407d-b91a-9b4a31337193 tempest-CreateVolumesFromSnapshotTest-1034816622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86fe5af1-92c6-45b0-81eb-04a5259b0964 -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-86fe5af1-92c6-45b0-81eb-04a5259b0964.fa81d337-0581-4321-88b0-f7694a722a13" returned: 0 in 0.313s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:37 devstack cinder-volume[86188]: WARNING cinder.volume.drivers.remotefs [None req-748046d9-1df4-407d-b91a-9b4a31337193 tempest-CreateVolumesFromSnapshotTest-1034816622 None] /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-86fe5af1-92c6-45b0-81eb-04a5259b0964.fa81d337-0581-4321-88b0-f7694a722a13 is being set with open permissions: ugo+rw Sep 16 20:26:37 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-748046d9-1df4-407d-b91a-9b4a31337193 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-86fe5af1-92c6-45b0-81eb-04a5259b0964.fa81d337-0581-4321-88b0-f7694a722a13 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:37 devstack sudo[97459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-86fe5af1-92c6-45b0-81eb-04a5259b0964.fa81d337-0581-4321-88b0-f7694a722a13 Sep 16 20:26:37 devstack sudo[97459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:37 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-bdbcc4a8-a2fa-4241-8452-d8d9c463a04a tempest-VolumesActionsTest-1567958602 None] Acquiring lock "cinder-4f2af323-0f0e-423e-8550-98bde73314c0-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:26:37 devstack sudo[97453]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:37 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-5baa1cff-91ed-4855-a53b-c0f99a8d2910 tempest-SnapshotMetadataTestJSON-1031157924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-868fcc74-11e7-43aa-bad2-c54fd29d6a80" returned: 0 in 0.295s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:37 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-bdbcc4a8-a2fa-4241-8452-d8d9c463a04a tempest-VolumesActionsTest-1567958602 None] Lock "cinder-4f2af323-0f0e-423e-8550-98bde73314c0-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:26:37 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-5baa1cff-91ed-4855-a53b-c0f99a8d2910 tempest-SnapshotMetadataTestJSON-1031157924 None] Lock "cinder-quobyte-868fcc74-11e7-43aa-bad2-c54fd29d6a80" released by "delete_volume" :: held 0.772s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:26:37 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-bdbcc4a8-a2fa-4241-8452-d8d9c463a04a tempest-VolumesActionsTest-1567958602 None] Acquiring lock "cinder-quobyte-4f2af323-0f0e-423e-8550-98bde73314c0" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:26:37 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-bdbcc4a8-a2fa-4241-8452-d8d9c463a04a tempest-VolumesActionsTest-1567958602 None] Lock "cinder-quobyte-4f2af323-0f0e-423e-8550-98bde73314c0" acquired by "delete_volume" :: waited 0.023s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:26:37 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce380993-e3d6-4e0a-94dd-cf2e8ef4db9e]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:26:37 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-bdbcc4a8-a2fa-4241-8452-d8d9c463a04a tempest-VolumesActionsTest-1567958602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-4f2af323-0f0e-423e-8550-98bde73314c0 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:37 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-5baa1cff-91ed-4855-a53b-c0f99a8d2910 tempest-SnapshotMetadataTestJSON-1031157924 None] Created reservations ['bc090d5b-2e62-42e9-a428-6b2f4b57a022', '35295f2e-9224-487f-9f4b-4d58fb905f96', '4e4bebef-53e7-45df-9719-7915c16261f9', '8a86b9c9-d5a8-4938-af79-62a015ec58e3'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:26:37 devstack sudo[97459]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:37 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-748046d9-1df4-407d-b91a-9b4a31337193 tempest-CreateVolumesFromSnapshotTest-1034816622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-86fe5af1-92c6-45b0-81eb-04a5259b0964.fa81d337-0581-4321-88b0-f7694a722a13" returned: 0 in 0.295s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:37 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-748046d9-1df4-407d-b91a-9b4a31337193 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-86fe5af1-92c6-45b0-81eb-04a5259b0964.info {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:37 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-5baa1cff-91ed-4855-a53b-c0f99a8d2910 tempest-SnapshotMetadataTestJSON-1031157924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:26:37 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-5baa1cff-91ed-4855-a53b-c0f99a8d2910 tempest-SnapshotMetadataTestJSON-1031157924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:26:37 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-5baa1cff-91ed-4855-a53b-c0f99a8d2910 tempest-SnapshotMetadataTestJSON-1031157924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:26:37 devstack sudo[97464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-86fe5af1-92c6-45b0-81eb-04a5259b0964.info Sep 16 20:26:37 devstack sudo[97464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:37 devstack sudo[97463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-4f2af323-0f0e-423e-8550-98bde73314c0 Sep 16 20:26:37 devstack sudo[97463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:37 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-5baa1cff-91ed-4855-a53b-c0f99a8d2910 tempest-SnapshotMetadataTestJSON-1031157924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:26:37 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-5baa1cff-91ed-4855-a53b-c0f99a8d2910 tempest-SnapshotMetadataTestJSON-1031157924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:26:37 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-5baa1cff-91ed-4855-a53b-c0f99a8d2910 tempest-SnapshotMetadataTestJSON-1031157924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:37 devstack sudo[97467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:26:37 devstack sudo[97467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:38 devstack sudo[97464]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:38 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-748046d9-1df4-407d-b91a-9b4a31337193 tempest-CreateVolumesFromSnapshotTest-1034816622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-86fe5af1-92c6-45b0-81eb-04a5259b0964.info" returned: 0 in 0.368s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:38 devstack cinder-volume[86188]: WARNING cinder.volume.drivers.remotefs [None req-748046d9-1df4-407d-b91a-9b4a31337193 tempest-CreateVolumesFromSnapshotTest-1034816622 None] /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-86fe5af1-92c6-45b0-81eb-04a5259b0964.info is being set with open permissions: ugo+rw Sep 16 20:26:38 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-748046d9-1df4-407d-b91a-9b4a31337193 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-86fe5af1-92c6-45b0-81eb-04a5259b0964.info {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:38 devstack sudo[97475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-86fe5af1-92c6-45b0-81eb-04a5259b0964.info Sep 16 20:26:38 devstack sudo[97475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:38 devstack sudo[97467]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:38 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-5baa1cff-91ed-4855-a53b-c0f99a8d2910 tempest-SnapshotMetadataTestJSON-1031157924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.387s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:38 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-5baa1cff-91ed-4855-a53b-c0f99a8d2910 tempest-SnapshotMetadataTestJSON-1031157924 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:26:38 devstack sudo[97463]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:38 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-bdbcc4a8-a2fa-4241-8452-d8d9c463a04a tempest-VolumesActionsTest-1567958602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-4f2af323-0f0e-423e-8550-98bde73314c0" returned: 0 in 0.540s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:38 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-bdbcc4a8-a2fa-4241-8452-d8d9c463a04a tempest-VolumesActionsTest-1567958602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-4f2af323-0f0e-423e-8550-98bde73314c0 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:38 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-5baa1cff-91ed-4855-a53b-c0f99a8d2910 tempest-SnapshotMetadataTestJSON-1031157924 None] Deleted volume successfully. Sep 16 20:26:38 devstack sudo[97477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-4f2af323-0f0e-423e-8550-98bde73314c0 Sep 16 20:26:38 devstack sudo[97477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:38 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-5baa1cff-91ed-4855-a53b-c0f99a8d2910 tempest-SnapshotMetadataTestJSON-1031157924 None] Lock "cinder-868fcc74-11e7-43aa-bad2-c54fd29d6a80-delete_volume" released by "delete_volume" :: held 1.530s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:26:38 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-64ad5218-2b77-45fd-b301-75f7651429e0 tempest-GroupsV320Test-487131809 None] Created reservations ['102cd502-85ee-4749-9db6-282fb0037b4b'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:26:38 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-64ad5218-2b77-45fd-b301-75f7651429e0 tempest-GroupsV320Test-487131809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:26:38 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-64ad5218-2b77-45fd-b301-75f7651429e0 tempest-GroupsV320Test-487131809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:26:38 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-64ad5218-2b77-45fd-b301-75f7651429e0 tempest-GroupsV320Test-487131809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:26:38 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-64ad5218-2b77-45fd-b301-75f7651429e0 tempest-GroupsV320Test-487131809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:26:38 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-64ad5218-2b77-45fd-b301-75f7651429e0 tempest-GroupsV320Test-487131809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:26:38 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-64ad5218-2b77-45fd-b301-75f7651429e0 tempest-GroupsV320Test-487131809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:38 devstack sudo[97475]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:38 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-748046d9-1df4-407d-b91a-9b4a31337193 tempest-CreateVolumesFromSnapshotTest-1034816622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-86fe5af1-92c6-45b0-81eb-04a5259b0964.info" returned: 0 in 0.314s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:38 devstack sudo[97480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:26:38 devstack sudo[97480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:38 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-748046d9-1df4-407d-b91a-9b4a31337193 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.182s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:26:38 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-748046d9-1df4-407d-b91a-9b4a31337193 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Create snapshot completed successfully Sep 16 20:26:38 devstack sudo[97477]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:38 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-bdbcc4a8-a2fa-4241-8452-d8d9c463a04a tempest-VolumesActionsTest-1567958602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-4f2af323-0f0e-423e-8550-98bde73314c0" returned: 0 in 0.349s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:38 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-bdbcc4a8-a2fa-4241-8452-d8d9c463a04a tempest-VolumesActionsTest-1567958602 None] Lock "cinder-quobyte-4f2af323-0f0e-423e-8550-98bde73314c0" released by "delete_volume" :: held 0.957s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:26:38 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-bdbcc4a8-a2fa-4241-8452-d8d9c463a04a tempest-VolumesActionsTest-1567958602 None] Created reservations ['54f6bcf3-1603-4d9d-8508-d73174a7d68a', '86a44306-066d-4f5f-9da3-e047edb75a23', '0da257d8-1f70-4ee8-92d0-7e065d90a10b', 'abd508f2-b7d5-45d4-90ea-05b4ce549c22'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:26:38 devstack sudo[97480]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:38 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-64ad5218-2b77-45fd-b301-75f7651429e0 tempest-GroupsV320Test-487131809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.310s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:38 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-64ad5218-2b77-45fd-b301-75f7651429e0 tempest-GroupsV320Test-487131809 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:26:38 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-bdbcc4a8-a2fa-4241-8452-d8d9c463a04a tempest-VolumesActionsTest-1567958602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:26:38 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-bdbcc4a8-a2fa-4241-8452-d8d9c463a04a tempest-VolumesActionsTest-1567958602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:26:38 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-bdbcc4a8-a2fa-4241-8452-d8d9c463a04a tempest-VolumesActionsTest-1567958602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:26:38 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-bdbcc4a8-a2fa-4241-8452-d8d9c463a04a tempest-VolumesActionsTest-1567958602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:26:38 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-bdbcc4a8-a2fa-4241-8452-d8d9c463a04a tempest-VolumesActionsTest-1567958602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:26:38 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-bdbcc4a8-a2fa-4241-8452-d8d9c463a04a tempest-VolumesActionsTest-1567958602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:38 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-64ad5218-2b77-45fd-b301-75f7651429e0 tempest-GroupsV320Test-487131809 None] Delete group completed successfully. Sep 16 20:26:38 devstack sudo[97484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:26:38 devstack sudo[97484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:38 devstack sudo[97484]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:38 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-bdbcc4a8-a2fa-4241-8452-d8d9c463a04a tempest-VolumesActionsTest-1567958602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.257s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:38 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-bdbcc4a8-a2fa-4241-8452-d8d9c463a04a tempest-VolumesActionsTest-1567958602 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:26:38 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-bdbcc4a8-a2fa-4241-8452-d8d9c463a04a tempest-VolumesActionsTest-1567958602 None] Deleted volume successfully. Sep 16 20:26:38 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-bdbcc4a8-a2fa-4241-8452-d8d9c463a04a tempest-VolumesActionsTest-1567958602 None] Lock "cinder-4f2af323-0f0e-423e-8550-98bde73314c0-delete_volume" released by "delete_volume" :: held 1.492s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:26:40 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-b74f946c-08d9-4c25-8dc7-3ad07b9c1ddd tempest-CreateVolumesFromSnapshotTest-1034816622 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:26:40 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-b74f946c-08d9-4c25-8dc7-3ad07b9c1ddd tempest-CreateVolumesFromSnapshotTest-1034816622 None] Flow 'volume_create_manager' (4ed20286-fe8a-460a-8333-dd2cdaac3a26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:26:40 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-b74f946c-08d9-4c25-8dc7-3ad07b9c1ddd tempest-CreateVolumesFromSnapshotTest-1034816622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2cd6372-1e55-4fe8-9cda-ee9b3644c713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:26:40 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-b74f946c-08d9-4c25-8dc7-3ad07b9c1ddd tempest-CreateVolumesFromSnapshotTest-1034816622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2cd6372-1e55-4fe8-9cda-ee9b3644c713) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:26:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1878106720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2119929-a780-495d-9855-3c8adc0b9205,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a489ad938cc84fb4a2f328f6ddc72940',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:26:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:26:40Z,use_quota=True,user_id='3656a2b8cd84461293ad1284e7c235f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:26:40 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-b74f946c-08d9-4c25-8dc7-3ad07b9c1ddd tempest-CreateVolumesFromSnapshotTest-1034816622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0284d08-b3cd-4f2a-ab8d-d7c93b3e6582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:26:40 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-b74f946c-08d9-4c25-8dc7-3ad07b9c1ddd tempest-CreateVolumesFromSnapshotTest-1034816622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0284d08-b3cd-4f2a-ab8d-d7c93b3e6582) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:26:40 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-b74f946c-08d9-4c25-8dc7-3ad07b9c1ddd tempest-CreateVolumesFromSnapshotTest-1034816622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70be8cfc-93bf-435a-a443-cb8b45c47aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:26:40 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-b74f946c-08d9-4c25-8dc7-3ad07b9c1ddd tempest-CreateVolumesFromSnapshotTest-1034816622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70be8cfc-93bf-435a-a443-cb8b45c47aae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2119929-a780-495d-9855-3c8adc0b9205', 'volume_name': 'volume-c2119929-a780-495d-9855-3c8adc0b9205', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:26:40 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-b74f946c-08d9-4c25-8dc7-3ad07b9c1ddd tempest-CreateVolumesFromSnapshotTest-1034816622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddf09f2f-1497-48f4-aa94-4079469c1b57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:26:40 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-b74f946c-08d9-4c25-8dc7-3ad07b9c1ddd tempest-CreateVolumesFromSnapshotTest-1034816622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddf09f2f-1497-48f4-aa94-4079469c1b57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:26:40 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-b74f946c-08d9-4c25-8dc7-3ad07b9c1ddd tempest-CreateVolumesFromSnapshotTest-1034816622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (febd5eed-0a8a-431a-a1bd-2e7020aaeaa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:26:40 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-b74f946c-08d9-4c25-8dc7-3ad07b9c1ddd tempest-CreateVolumesFromSnapshotTest-1034816622 None] Volume c2119929-a780-495d-9855-3c8adc0b9205: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2119929-a780-495d-9855-3c8adc0b9205', 'volume_size': 1} Sep 16 20:26:40 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-b74f946c-08d9-4c25-8dc7-3ad07b9c1ddd tempest-CreateVolumesFromSnapshotTest-1034816622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:26:40 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-b74f946c-08d9-4c25-8dc7-3ad07b9c1ddd tempest-CreateVolumesFromSnapshotTest-1034816622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:26:40 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-b74f946c-08d9-4c25-8dc7-3ad07b9c1ddd tempest-CreateVolumesFromSnapshotTest-1034816622 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:26:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1878106720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2119929-a780-495d-9855-3c8adc0b9205,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a489ad938cc84fb4a2f328f6ddc72940',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:26:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:26:40Z,use_quota=True,user_id='3656a2b8cd84461293ad1284e7c235f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:26:40 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-b74f946c-08d9-4c25-8dc7-3ad07b9c1ddd tempest-CreateVolumesFromSnapshotTest-1034816622 None] Creating volume c2119929-a780-495d-9855-3c8adc0b9205 {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:26:40 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-b74f946c-08d9-4c25-8dc7-3ad07b9c1ddd tempest-CreateVolumesFromSnapshotTest-1034816622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:26:40 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-b74f946c-08d9-4c25-8dc7-3ad07b9c1ddd tempest-CreateVolumesFromSnapshotTest-1034816622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:26:40 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-b74f946c-08d9-4c25-8dc7-3ad07b9c1ddd tempest-CreateVolumesFromSnapshotTest-1034816622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:26:40 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-b74f946c-08d9-4c25-8dc7-3ad07b9c1ddd tempest-CreateVolumesFromSnapshotTest-1034816622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:26:40 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-b74f946c-08d9-4c25-8dc7-3ad07b9c1ddd tempest-CreateVolumesFromSnapshotTest-1034816622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:26:40 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-b74f946c-08d9-4c25-8dc7-3ad07b9c1ddd tempest-CreateVolumesFromSnapshotTest-1034816622 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:26:40 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-b74f946c-08d9-4c25-8dc7-3ad07b9c1ddd tempest-CreateVolumesFromSnapshotTest-1034816622 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:26:40 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b74f946c-08d9-4c25-8dc7-3ad07b9c1ddd tempest-CreateVolumesFromSnapshotTest-1034816622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c2119929-a780-495d-9855-3c8adc0b9205 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:40 devstack sudo[97488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c2119929-a780-495d-9855-3c8adc0b9205 1073741824 Sep 16 20:26:40 devstack sudo[97488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:40 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-612f5448-6d83-4a88-9c3c-bdbeebc2c5ab tempest-CreateVolumesFromSnapshotTest-1034816622 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:26:40 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-612f5448-6d83-4a88-9c3c-bdbeebc2c5ab tempest-CreateVolumesFromSnapshotTest-1034816622 None] Flow 'volume_create_manager' (7e1fcfc4-4cb8-48ab-8f2a-745a1ef38562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:26:40 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-612f5448-6d83-4a88-9c3c-bdbeebc2c5ab tempest-CreateVolumesFromSnapshotTest-1034816622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f04bd47-3322-4906-949d-c8ede334eb0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:26:40 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-612f5448-6d83-4a88-9c3c-bdbeebc2c5ab tempest-CreateVolumesFromSnapshotTest-1034816622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f04bd47-3322-4906-949d-c8ede334eb0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:26:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-647843128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80017b43-a037-4728-8c91-0c36afd31a3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a489ad938cc84fb4a2f328f6ddc72940',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:26:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:26:41Z,use_quota=True,user_id='3656a2b8cd84461293ad1284e7c235f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:26:40 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-612f5448-6d83-4a88-9c3c-bdbeebc2c5ab tempest-CreateVolumesFromSnapshotTest-1034816622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ec11fda-2013-429e-9288-ed92afbe7738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:26:40 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-612f5448-6d83-4a88-9c3c-bdbeebc2c5ab tempest-CreateVolumesFromSnapshotTest-1034816622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ec11fda-2013-429e-9288-ed92afbe7738) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:26:40 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-612f5448-6d83-4a88-9c3c-bdbeebc2c5ab tempest-CreateVolumesFromSnapshotTest-1034816622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56f01d9c-b5fb-4d27-ae16-d9176e206bc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:26:40 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-612f5448-6d83-4a88-9c3c-bdbeebc2c5ab tempest-CreateVolumesFromSnapshotTest-1034816622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56f01d9c-b5fb-4d27-ae16-d9176e206bc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80017b43-a037-4728-8c91-0c36afd31a3d', 'volume_name': 'volume-80017b43-a037-4728-8c91-0c36afd31a3d', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:26:40 devstack sudo[97488]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:40 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-612f5448-6d83-4a88-9c3c-bdbeebc2c5ab tempest-CreateVolumesFromSnapshotTest-1034816622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (daa83807-003d-44ab-b4cf-8dc69038e0f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:26:40 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-612f5448-6d83-4a88-9c3c-bdbeebc2c5ab tempest-CreateVolumesFromSnapshotTest-1034816622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (daa83807-003d-44ab-b4cf-8dc69038e0f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:26:41 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-612f5448-6d83-4a88-9c3c-bdbeebc2c5ab tempest-CreateVolumesFromSnapshotTest-1034816622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d7b2a8a-f558-4efc-92fd-811421a73199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:26:41 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-612f5448-6d83-4a88-9c3c-bdbeebc2c5ab tempest-CreateVolumesFromSnapshotTest-1034816622 None] Volume 80017b43-a037-4728-8c91-0c36afd31a3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80017b43-a037-4728-8c91-0c36afd31a3d', 'volume_size': 1} Sep 16 20:26:41 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-612f5448-6d83-4a88-9c3c-bdbeebc2c5ab tempest-CreateVolumesFromSnapshotTest-1034816622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:26:41 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b74f946c-08d9-4c25-8dc7-3ad07b9c1ddd tempest-CreateVolumesFromSnapshotTest-1034816622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c2119929-a780-495d-9855-3c8adc0b9205 1073741824" returned: 0 in 0.733s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:41 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b74f946c-08d9-4c25-8dc7-3ad07b9c1ddd tempest-CreateVolumesFromSnapshotTest-1034816622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c2119929-a780-495d-9855-3c8adc0b9205 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:41 devstack sudo[97496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c2119929-a780-495d-9855-3c8adc0b9205 Sep 16 20:26:41 devstack sudo[97496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:41 devstack sudo[97496]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:41 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b74f946c-08d9-4c25-8dc7-3ad07b9c1ddd tempest-CreateVolumesFromSnapshotTest-1034816622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c2119929-a780-495d-9855-3c8adc0b9205" returned: 0 in 0.417s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:41 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-b74f946c-08d9-4c25-8dc7-3ad07b9c1ddd tempest-CreateVolumesFromSnapshotTest-1034816622 None] <== create_volume: return (1219ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:26:41 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-b74f946c-08d9-4c25-8dc7-3ad07b9c1ddd tempest-CreateVolumesFromSnapshotTest-1034816622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.225s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:26:41 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-612f5448-6d83-4a88-9c3c-bdbeebc2c5ab tempest-CreateVolumesFromSnapshotTest-1034816622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.476s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:26:41 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-612f5448-6d83-4a88-9c3c-bdbeebc2c5ab tempest-CreateVolumesFromSnapshotTest-1034816622 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:26:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-647843128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80017b43-a037-4728-8c91-0c36afd31a3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a489ad938cc84fb4a2f328f6ddc72940',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:26:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:26:41Z,use_quota=True,user_id='3656a2b8cd84461293ad1284e7c235f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:26:41 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-612f5448-6d83-4a88-9c3c-bdbeebc2c5ab tempest-CreateVolumesFromSnapshotTest-1034816622 None] Creating volume 80017b43-a037-4728-8c91-0c36afd31a3d {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:26:41 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-612f5448-6d83-4a88-9c3c-bdbeebc2c5ab tempest-CreateVolumesFromSnapshotTest-1034816622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:26:41 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-612f5448-6d83-4a88-9c3c-bdbeebc2c5ab tempest-CreateVolumesFromSnapshotTest-1034816622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:26:41 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-612f5448-6d83-4a88-9c3c-bdbeebc2c5ab tempest-CreateVolumesFromSnapshotTest-1034816622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:26:41 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-612f5448-6d83-4a88-9c3c-bdbeebc2c5ab tempest-CreateVolumesFromSnapshotTest-1034816622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:26:41 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-612f5448-6d83-4a88-9c3c-bdbeebc2c5ab tempest-CreateVolumesFromSnapshotTest-1034816622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:26:41 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-612f5448-6d83-4a88-9c3c-bdbeebc2c5ab tempest-CreateVolumesFromSnapshotTest-1034816622 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:26:41 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-612f5448-6d83-4a88-9c3c-bdbeebc2c5ab tempest-CreateVolumesFromSnapshotTest-1034816622 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:26:41 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-612f5448-6d83-4a88-9c3c-bdbeebc2c5ab tempest-CreateVolumesFromSnapshotTest-1034816622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-80017b43-a037-4728-8c91-0c36afd31a3d 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:41 devstack sudo[97501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-80017b43-a037-4728-8c91-0c36afd31a3d 1073741824 Sep 16 20:26:41 devstack sudo[97501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:41 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-b74f946c-08d9-4c25-8dc7-3ad07b9c1ddd tempest-CreateVolumesFromSnapshotTest-1034816622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (febd5eed-0a8a-431a-a1bd-2e7020aaeaa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2119929-a780-495d-9855-3c8adc0b9205', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:26:41 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-b74f946c-08d9-4c25-8dc7-3ad07b9c1ddd tempest-CreateVolumesFromSnapshotTest-1034816622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcd2852a-985e-45ba-8144-e3077373054c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:26:41 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e977b25-72ae-4937-8684-298ac0ed5265 tempest-VolumesActionsTest-852371490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:26:41 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-7e977b25-72ae-4937-8684-298ac0ed5265 tempest-VolumesActionsTest-852371490 None] Flow 'volume_create_manager' (c2e1ff01-01bc-46a7-b5c0-3a4e4828a5d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:26:41 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-7e977b25-72ae-4937-8684-298ac0ed5265 tempest-VolumesActionsTest-852371490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e859af8-a5b2-41e2-86a7-b7227f34a42a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:26:41 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-b74f946c-08d9-4c25-8dc7-3ad07b9c1ddd tempest-CreateVolumesFromSnapshotTest-1034816622 None] Volume volume-c2119929-a780-495d-9855-3c8adc0b9205 (c2119929-a780-495d-9855-3c8adc0b9205): created successfully Sep 16 20:26:41 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-b74f946c-08d9-4c25-8dc7-3ad07b9c1ddd tempest-CreateVolumesFromSnapshotTest-1034816622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcd2852a-985e-45ba-8144-e3077373054c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:26:41 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-b74f946c-08d9-4c25-8dc7-3ad07b9c1ddd tempest-CreateVolumesFromSnapshotTest-1034816622 None] Flow 'volume_create_manager' (4ed20286-fe8a-460a-8333-dd2cdaac3a26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:26:41 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-7e977b25-72ae-4937-8684-298ac0ed5265 tempest-VolumesActionsTest-852371490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e859af8-a5b2-41e2-86a7-b7227f34a42a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:26:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1499519440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4df2d6c7-8f3e-4b53-a7d6-b5b64f39eebe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='241b8cb66c934319af2d98fd15cea960',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:26:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:26:41Z,use_quota=True,user_id='1ad5071e5a824fd7a960045be4b9a4db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:26:41 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-7e977b25-72ae-4937-8684-298ac0ed5265 tempest-VolumesActionsTest-852371490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (220cf5ff-64ee-4a4b-b12b-7082d8bc12e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:26:41 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-7e977b25-72ae-4937-8684-298ac0ed5265 tempest-VolumesActionsTest-852371490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (220cf5ff-64ee-4a4b-b12b-7082d8bc12e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:26:41 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-7e977b25-72ae-4937-8684-298ac0ed5265 tempest-VolumesActionsTest-852371490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b525bdda-066a-4cbe-bac0-39c391421027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:26:41 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-7e977b25-72ae-4937-8684-298ac0ed5265 tempest-VolumesActionsTest-852371490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b525bdda-066a-4cbe-bac0-39c391421027) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4df2d6c7-8f3e-4b53-a7d6-b5b64f39eebe', 'volume_name': 'volume-4df2d6c7-8f3e-4b53-a7d6-b5b64f39eebe', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:26:41 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-7e977b25-72ae-4937-8684-298ac0ed5265 tempest-VolumesActionsTest-852371490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c18f9946-c277-4262-8624-964b01020c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:26:41 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-7e977b25-72ae-4937-8684-298ac0ed5265 tempest-VolumesActionsTest-852371490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c18f9946-c277-4262-8624-964b01020c18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:26:41 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-7e977b25-72ae-4937-8684-298ac0ed5265 tempest-VolumesActionsTest-852371490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04a58d7c-3c0d-4889-ada6-e3525fae8d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:26:41 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-7e977b25-72ae-4937-8684-298ac0ed5265 tempest-VolumesActionsTest-852371490 None] Volume 4df2d6c7-8f3e-4b53-a7d6-b5b64f39eebe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4df2d6c7-8f3e-4b53-a7d6-b5b64f39eebe', 'volume_size': 1} Sep 16 20:26:41 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-7e977b25-72ae-4937-8684-298ac0ed5265 tempest-VolumesActionsTest-852371490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:26:41 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-b74f946c-08d9-4c25-8dc7-3ad07b9c1ddd tempest-CreateVolumesFromSnapshotTest-1034816622 None] Created volume successfully. Sep 16 20:26:41 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-7154b810-5d49-45c3-821a-d30fce285472 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:26:41 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-7154b810-5d49-45c3-821a-d30fce285472 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Flow 'volume_create_manager' (f859a288-5964-40ce-85a2-aea5f520d30b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:26:41 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-7154b810-5d49-45c3-821a-d30fce285472 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f901dbda-d87c-481b-a807-31a3b8f56373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:26:41 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-7154b810-5d49-45c3-821a-d30fce285472 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f901dbda-d87c-481b-a807-31a3b8f56373) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:26:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-257557661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12c9c84a-a2e6-4372-b94e-137555a4cd36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a489ad938cc84fb4a2f328f6ddc72940',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:26:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:26:41Z,use_quota=True,user_id='3656a2b8cd84461293ad1284e7c235f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:26:41 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-7154b810-5d49-45c3-821a-d30fce285472 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80680477-c926-417b-abcd-cc761b23b78a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:26:41 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-7154b810-5d49-45c3-821a-d30fce285472 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80680477-c926-417b-abcd-cc761b23b78a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:26:41 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-7154b810-5d49-45c3-821a-d30fce285472 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (012bebf9-bdf6-4d19-9236-c546d64ff92e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:26:41 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-7154b810-5d49-45c3-821a-d30fce285472 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (012bebf9-bdf6-4d19-9236-c546d64ff92e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12c9c84a-a2e6-4372-b94e-137555a4cd36', 'volume_name': 'volume-12c9c84a-a2e6-4372-b94e-137555a4cd36', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:26:41 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-7154b810-5d49-45c3-821a-d30fce285472 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8874375-d67c-4f7d-b8af-3e331d697b33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:26:41 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-7154b810-5d49-45c3-821a-d30fce285472 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8874375-d67c-4f7d-b8af-3e331d697b33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:26:41 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-7154b810-5d49-45c3-821a-d30fce285472 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (746bb4b8-3cd8-465f-88b0-aa8afda9f0fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:26:41 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-7154b810-5d49-45c3-821a-d30fce285472 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Volume 12c9c84a-a2e6-4372-b94e-137555a4cd36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12c9c84a-a2e6-4372-b94e-137555a4cd36', 'volume_size': 1} Sep 16 20:26:41 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-7154b810-5d49-45c3-821a-d30fce285472 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:26:42 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef3228c6-3161-465b-9c3c-45934a0ee0db tempest-CreateVolumesFromSnapshotTest-1034816622 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:26:42 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ef3228c6-3161-465b-9c3c-45934a0ee0db tempest-CreateVolumesFromSnapshotTest-1034816622 None] Flow 'volume_create_manager' (d0e16117-3da3-4c4c-99ec-9da821408065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:26:42 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ef3228c6-3161-465b-9c3c-45934a0ee0db tempest-CreateVolumesFromSnapshotTest-1034816622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (441c50b5-0f0c-4420-88dc-1cc108426ff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:26:42 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ef3228c6-3161-465b-9c3c-45934a0ee0db tempest-CreateVolumesFromSnapshotTest-1034816622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (441c50b5-0f0c-4420-88dc-1cc108426ff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:26:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-430308136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e81afbc9-de23-4c9a-a347-3113592f41e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a489ad938cc84fb4a2f328f6ddc72940',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:26:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:26:42Z,use_quota=True,user_id='3656a2b8cd84461293ad1284e7c235f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:26:42 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ef3228c6-3161-465b-9c3c-45934a0ee0db tempest-CreateVolumesFromSnapshotTest-1034816622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8522cbd8-15db-46c4-948c-8e5bcbd22b6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:26:42 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ef3228c6-3161-465b-9c3c-45934a0ee0db tempest-CreateVolumesFromSnapshotTest-1034816622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8522cbd8-15db-46c4-948c-8e5bcbd22b6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:26:42 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ef3228c6-3161-465b-9c3c-45934a0ee0db tempest-CreateVolumesFromSnapshotTest-1034816622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cadcfd7e-1c4f-47dc-84ca-d8f1695cf63c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:26:42 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ef3228c6-3161-465b-9c3c-45934a0ee0db tempest-CreateVolumesFromSnapshotTest-1034816622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cadcfd7e-1c4f-47dc-84ca-d8f1695cf63c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e81afbc9-de23-4c9a-a347-3113592f41e3', 'volume_name': 'volume-e81afbc9-de23-4c9a-a347-3113592f41e3', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:26:42 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ef3228c6-3161-465b-9c3c-45934a0ee0db tempest-CreateVolumesFromSnapshotTest-1034816622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d52d0e04-9481-42ec-9153-6751407775c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:26:42 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ef3228c6-3161-465b-9c3c-45934a0ee0db tempest-CreateVolumesFromSnapshotTest-1034816622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d52d0e04-9481-42ec-9153-6751407775c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:26:42 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ef3228c6-3161-465b-9c3c-45934a0ee0db tempest-CreateVolumesFromSnapshotTest-1034816622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8e1b455-4803-49d7-b797-09f099f939af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:26:42 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-ef3228c6-3161-465b-9c3c-45934a0ee0db tempest-CreateVolumesFromSnapshotTest-1034816622 None] Volume e81afbc9-de23-4c9a-a347-3113592f41e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e81afbc9-de23-4c9a-a347-3113592f41e3', 'volume_size': 1} Sep 16 20:26:42 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-ef3228c6-3161-465b-9c3c-45934a0ee0db tempest-CreateVolumesFromSnapshotTest-1034816622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:26:42 devstack sudo[97501]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:42 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-612f5448-6d83-4a88-9c3c-bdbeebc2c5ab tempest-CreateVolumesFromSnapshotTest-1034816622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-80017b43-a037-4728-8c91-0c36afd31a3d 1073741824" returned: 0 in 0.813s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:42 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-37a18274-04c0-456a-8736-3b283911ae40 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:26:42 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-37a18274-04c0-456a-8736-3b283911ae40 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Flow 'volume_create_manager' (81edaeb5-cffd-488b-85ad-f80dd945a4df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:26:42 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-37a18274-04c0-456a-8736-3b283911ae40 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (914c397a-3717-4989-9d9b-b7981e4ecb8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:26:42 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-37a18274-04c0-456a-8736-3b283911ae40 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (914c397a-3717-4989-9d9b-b7981e4ecb8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:26:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1288225612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86bb2612-a0e6-4a91-82cc-94b44fe9d0b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a489ad938cc84fb4a2f328f6ddc72940',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:26:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:26:42Z,use_quota=True,user_id='3656a2b8cd84461293ad1284e7c235f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:26:42 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-37a18274-04c0-456a-8736-3b283911ae40 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (763e8666-48a7-4622-aff0-83b82521b82f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:26:42 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-37a18274-04c0-456a-8736-3b283911ae40 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (763e8666-48a7-4622-aff0-83b82521b82f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:26:42 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-37a18274-04c0-456a-8736-3b283911ae40 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (362efb18-1d15-4888-aa16-2e36611a36ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:26:42 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-37a18274-04c0-456a-8736-3b283911ae40 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (362efb18-1d15-4888-aa16-2e36611a36ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86bb2612-a0e6-4a91-82cc-94b44fe9d0b4', 'volume_name': 'volume-86bb2612-a0e6-4a91-82cc-94b44fe9d0b4', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:26:42 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-37a18274-04c0-456a-8736-3b283911ae40 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (088c85eb-3127-4efc-9a4b-6ae1ac25e78c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:26:42 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-37a18274-04c0-456a-8736-3b283911ae40 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (088c85eb-3127-4efc-9a4b-6ae1ac25e78c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:26:42 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-37a18274-04c0-456a-8736-3b283911ae40 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dbc5c18-3052-4287-8f95-03ff11018951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:26:42 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-37a18274-04c0-456a-8736-3b283911ae40 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Volume 86bb2612-a0e6-4a91-82cc-94b44fe9d0b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86bb2612-a0e6-4a91-82cc-94b44fe9d0b4', 'volume_size': 1} Sep 16 20:26:42 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-37a18274-04c0-456a-8736-3b283911ae40 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:26:42 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-612f5448-6d83-4a88-9c3c-bdbeebc2c5ab tempest-CreateVolumesFromSnapshotTest-1034816622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-80017b43-a037-4728-8c91-0c36afd31a3d {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:42 devstack sudo[97507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-80017b43-a037-4728-8c91-0c36afd31a3d Sep 16 20:26:42 devstack sudo[97507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:42 devstack sudo[97507]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:42 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-612f5448-6d83-4a88-9c3c-bdbeebc2c5ab tempest-CreateVolumesFromSnapshotTest-1034816622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-80017b43-a037-4728-8c91-0c36afd31a3d" returned: 0 in 0.315s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:42 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-612f5448-6d83-4a88-9c3c-bdbeebc2c5ab tempest-CreateVolumesFromSnapshotTest-1034816622 None] <== create_volume: return (1266ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:26:42 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-612f5448-6d83-4a88-9c3c-bdbeebc2c5ab tempest-CreateVolumesFromSnapshotTest-1034816622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.274s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:26:42 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-7e977b25-72ae-4937-8684-298ac0ed5265 tempest-VolumesActionsTest-852371490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.008s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:26:42 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-7e977b25-72ae-4937-8684-298ac0ed5265 tempest-VolumesActionsTest-852371490 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:26:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1499519440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4df2d6c7-8f3e-4b53-a7d6-b5b64f39eebe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='241b8cb66c934319af2d98fd15cea960',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:26:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:26:41Z,use_quota=True,user_id='1ad5071e5a824fd7a960045be4b9a4db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:26:42 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-7e977b25-72ae-4937-8684-298ac0ed5265 tempest-VolumesActionsTest-852371490 None] Creating volume 4df2d6c7-8f3e-4b53-a7d6-b5b64f39eebe {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:26:42 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-7e977b25-72ae-4937-8684-298ac0ed5265 tempest-VolumesActionsTest-852371490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:26:42 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-7e977b25-72ae-4937-8684-298ac0ed5265 tempest-VolumesActionsTest-852371490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:26:42 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-7e977b25-72ae-4937-8684-298ac0ed5265 tempest-VolumesActionsTest-852371490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:26:42 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-7e977b25-72ae-4937-8684-298ac0ed5265 tempest-VolumesActionsTest-852371490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:26:42 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-7e977b25-72ae-4937-8684-298ac0ed5265 tempest-VolumesActionsTest-852371490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:26:42 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-7e977b25-72ae-4937-8684-298ac0ed5265 tempest-VolumesActionsTest-852371490 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:26:42 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-7e977b25-72ae-4937-8684-298ac0ed5265 tempest-VolumesActionsTest-852371490 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:26:42 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-7e977b25-72ae-4937-8684-298ac0ed5265 tempest-VolumesActionsTest-852371490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-4df2d6c7-8f3e-4b53-a7d6-b5b64f39eebe 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:42 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-612f5448-6d83-4a88-9c3c-bdbeebc2c5ab tempest-CreateVolumesFromSnapshotTest-1034816622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d7b2a8a-f558-4efc-92fd-811421a73199) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80017b43-a037-4728-8c91-0c36afd31a3d', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:26:42 devstack sudo[97510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-4df2d6c7-8f3e-4b53-a7d6-b5b64f39eebe 1073741824 Sep 16 20:26:42 devstack sudo[97510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:42 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-612f5448-6d83-4a88-9c3c-bdbeebc2c5ab tempest-CreateVolumesFromSnapshotTest-1034816622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e820285c-f9ed-4503-9bb4-eb4fbbfc57e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:26:42 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-612f5448-6d83-4a88-9c3c-bdbeebc2c5ab tempest-CreateVolumesFromSnapshotTest-1034816622 None] Volume volume-80017b43-a037-4728-8c91-0c36afd31a3d (80017b43-a037-4728-8c91-0c36afd31a3d): created successfully Sep 16 20:26:42 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-612f5448-6d83-4a88-9c3c-bdbeebc2c5ab tempest-CreateVolumesFromSnapshotTest-1034816622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e820285c-f9ed-4503-9bb4-eb4fbbfc57e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:26:42 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-612f5448-6d83-4a88-9c3c-bdbeebc2c5ab tempest-CreateVolumesFromSnapshotTest-1034816622 None] Flow 'volume_create_manager' (7e1fcfc4-4cb8-48ab-8f2a-745a1ef38562) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:26:42 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-612f5448-6d83-4a88-9c3c-bdbeebc2c5ab tempest-CreateVolumesFromSnapshotTest-1034816622 None] Created volume successfully. Sep 16 20:26:43 devstack sudo[97510]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:43 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-7e977b25-72ae-4937-8684-298ac0ed5265 tempest-VolumesActionsTest-852371490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-4df2d6c7-8f3e-4b53-a7d6-b5b64f39eebe 1073741824" returned: 0 in 0.559s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:43 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-7e977b25-72ae-4937-8684-298ac0ed5265 tempest-VolumesActionsTest-852371490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-4df2d6c7-8f3e-4b53-a7d6-b5b64f39eebe {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:43 devstack sudo[97516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-4df2d6c7-8f3e-4b53-a7d6-b5b64f39eebe Sep 16 20:26:43 devstack sudo[97516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:43 devstack sudo[97516]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:43 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-7e977b25-72ae-4937-8684-298ac0ed5265 tempest-VolumesActionsTest-852371490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-4df2d6c7-8f3e-4b53-a7d6-b5b64f39eebe" returned: 0 in 0.306s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:43 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-7e977b25-72ae-4937-8684-298ac0ed5265 tempest-VolumesActionsTest-852371490 None] <== create_volume: return (920ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:26:43 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-7e977b25-72ae-4937-8684-298ac0ed5265 tempest-VolumesActionsTest-852371490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.924s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:26:43 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-7154b810-5d49-45c3-821a-d30fce285472 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.699s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:26:43 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-7154b810-5d49-45c3-821a-d30fce285472 tempest-CreateVolumesFromSnapshotTest-1034816622 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:26:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-257557661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12c9c84a-a2e6-4372-b94e-137555a4cd36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a489ad938cc84fb4a2f328f6ddc72940',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:26:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:26:41Z,use_quota=True,user_id='3656a2b8cd84461293ad1284e7c235f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:26:43 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-7154b810-5d49-45c3-821a-d30fce285472 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Creating volume 12c9c84a-a2e6-4372-b94e-137555a4cd36 {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:26:43 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-7154b810-5d49-45c3-821a-d30fce285472 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:26:43 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-7154b810-5d49-45c3-821a-d30fce285472 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:26:43 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-7154b810-5d49-45c3-821a-d30fce285472 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:26:43 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-7154b810-5d49-45c3-821a-d30fce285472 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:26:43 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-7154b810-5d49-45c3-821a-d30fce285472 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:26:43 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-7154b810-5d49-45c3-821a-d30fce285472 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:26:43 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-7154b810-5d49-45c3-821a-d30fce285472 tempest-CreateVolumesFromSnapshotTest-1034816622 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:26:43 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-7154b810-5d49-45c3-821a-d30fce285472 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-12c9c84a-a2e6-4372-b94e-137555a4cd36 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:43 devstack sudo[97519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-12c9c84a-a2e6-4372-b94e-137555a4cd36 1073741824 Sep 16 20:26:43 devstack sudo[97519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:43 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-7e977b25-72ae-4937-8684-298ac0ed5265 tempest-VolumesActionsTest-852371490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04a58d7c-3c0d-4889-ada6-e3525fae8d8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4df2d6c7-8f3e-4b53-a7d6-b5b64f39eebe', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:26:43 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-7e977b25-72ae-4937-8684-298ac0ed5265 tempest-VolumesActionsTest-852371490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74837c32-1f83-4c14-9b54-eff61167eacb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:26:43 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-7e977b25-72ae-4937-8684-298ac0ed5265 tempest-VolumesActionsTest-852371490 None] Volume volume-4df2d6c7-8f3e-4b53-a7d6-b5b64f39eebe (4df2d6c7-8f3e-4b53-a7d6-b5b64f39eebe): created successfully Sep 16 20:26:43 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-7e977b25-72ae-4937-8684-298ac0ed5265 tempest-VolumesActionsTest-852371490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74837c32-1f83-4c14-9b54-eff61167eacb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:26:43 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-7e977b25-72ae-4937-8684-298ac0ed5265 tempest-VolumesActionsTest-852371490 None] Flow 'volume_create_manager' (c2e1ff01-01bc-46a7-b5c0-3a4e4828a5d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:26:43 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-7e977b25-72ae-4937-8684-298ac0ed5265 tempest-VolumesActionsTest-852371490 None] Created volume successfully. Sep 16 20:26:44 devstack sudo[97519]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:44 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-7154b810-5d49-45c3-821a-d30fce285472 tempest-CreateVolumesFromSnapshotTest-1034816622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-12c9c84a-a2e6-4372-b94e-137555a4cd36 1073741824" returned: 0 in 0.504s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:44 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-7154b810-5d49-45c3-821a-d30fce285472 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-12c9c84a-a2e6-4372-b94e-137555a4cd36 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:44 devstack sudo[97525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-12c9c84a-a2e6-4372-b94e-137555a4cd36 Sep 16 20:26:44 devstack sudo[97525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:44 devstack sudo[97525]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:44 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-7154b810-5d49-45c3-821a-d30fce285472 tempest-CreateVolumesFromSnapshotTest-1034816622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-12c9c84a-a2e6-4372-b94e-137555a4cd36" returned: 0 in 0.291s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:44 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-7154b810-5d49-45c3-821a-d30fce285472 tempest-CreateVolumesFromSnapshotTest-1034816622 None] <== create_volume: return (841ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:26:44 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-7154b810-5d49-45c3-821a-d30fce285472 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.845s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:26:44 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-ef3228c6-3161-465b-9c3c-45934a0ee0db tempest-CreateVolumesFromSnapshotTest-1034816622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.364s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:26:44 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-ef3228c6-3161-465b-9c3c-45934a0ee0db tempest-CreateVolumesFromSnapshotTest-1034816622 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:26:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-430308136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e81afbc9-de23-4c9a-a347-3113592f41e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a489ad938cc84fb4a2f328f6ddc72940',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:26:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:26:42Z,use_quota=True,user_id='3656a2b8cd84461293ad1284e7c235f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:26:44 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-ef3228c6-3161-465b-9c3c-45934a0ee0db tempest-CreateVolumesFromSnapshotTest-1034816622 None] Creating volume e81afbc9-de23-4c9a-a347-3113592f41e3 {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:26:44 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-ef3228c6-3161-465b-9c3c-45934a0ee0db tempest-CreateVolumesFromSnapshotTest-1034816622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:26:44 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-ef3228c6-3161-465b-9c3c-45934a0ee0db tempest-CreateVolumesFromSnapshotTest-1034816622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:26:44 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-ef3228c6-3161-465b-9c3c-45934a0ee0db tempest-CreateVolumesFromSnapshotTest-1034816622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:26:44 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-ef3228c6-3161-465b-9c3c-45934a0ee0db tempest-CreateVolumesFromSnapshotTest-1034816622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:26:44 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-ef3228c6-3161-465b-9c3c-45934a0ee0db tempest-CreateVolumesFromSnapshotTest-1034816622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:26:44 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-ef3228c6-3161-465b-9c3c-45934a0ee0db tempest-CreateVolumesFromSnapshotTest-1034816622 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:26:44 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-ef3228c6-3161-465b-9c3c-45934a0ee0db tempest-CreateVolumesFromSnapshotTest-1034816622 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:26:44 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ef3228c6-3161-465b-9c3c-45934a0ee0db tempest-CreateVolumesFromSnapshotTest-1034816622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e81afbc9-de23-4c9a-a347-3113592f41e3 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:44 devstack sudo[97528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e81afbc9-de23-4c9a-a347-3113592f41e3 1073741824 Sep 16 20:26:44 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-7154b810-5d49-45c3-821a-d30fce285472 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (746bb4b8-3cd8-465f-88b0-aa8afda9f0fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12c9c84a-a2e6-4372-b94e-137555a4cd36', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:26:44 devstack sudo[97528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:44 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-7154b810-5d49-45c3-821a-d30fce285472 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e8618dc-4893-4c3a-9b56-71d444438aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:26:44 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-7154b810-5d49-45c3-821a-d30fce285472 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Volume volume-12c9c84a-a2e6-4372-b94e-137555a4cd36 (12c9c84a-a2e6-4372-b94e-137555a4cd36): created successfully Sep 16 20:26:44 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-7154b810-5d49-45c3-821a-d30fce285472 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e8618dc-4893-4c3a-9b56-71d444438aa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:26:44 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-7154b810-5d49-45c3-821a-d30fce285472 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Flow 'volume_create_manager' (f859a288-5964-40ce-85a2-aea5f520d30b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:26:44 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-7154b810-5d49-45c3-821a-d30fce285472 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Created volume successfully. Sep 16 20:26:44 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-a58712e0-a0fe-446f-b3be-4bf5e9c024f3 tempest-VolumesActionsTest-1567958602 None] Acquiring lock "cinder-4df2d6c7-8f3e-4b53-a7d6-b5b64f39eebe-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:26:45 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-a58712e0-a0fe-446f-b3be-4bf5e9c024f3 tempest-VolumesActionsTest-1567958602 None] Lock "cinder-4df2d6c7-8f3e-4b53-a7d6-b5b64f39eebe-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:26:45 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-a58712e0-a0fe-446f-b3be-4bf5e9c024f3 tempest-VolumesActionsTest-1567958602 None] Acquiring lock "cinder-quobyte-4df2d6c7-8f3e-4b53-a7d6-b5b64f39eebe" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:26:45 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-a58712e0-a0fe-446f-b3be-4bf5e9c024f3 tempest-VolumesActionsTest-1567958602 None] Lock "cinder-quobyte-4df2d6c7-8f3e-4b53-a7d6-b5b64f39eebe" acquired by "delete_volume" :: waited 0.035s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:26:45 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[33f206a7-ab77-408f-b485-bf143ff7328a]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:26:45 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a58712e0-a0fe-446f-b3be-4bf5e9c024f3 tempest-VolumesActionsTest-1567958602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-4df2d6c7-8f3e-4b53-a7d6-b5b64f39eebe {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:45 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e99bafb-12fe-4b3c-92e2-2312ce89bb89 tempest-VolumesTransfersV355Test-794549451 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:26:45 devstack sudo[97528]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:45 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-9e99bafb-12fe-4b3c-92e2-2312ce89bb89 tempest-VolumesTransfersV355Test-794549451 None] Flow 'volume_create_manager' (bed2f6fa-1cfd-448f-8321-e9a9f6c3d309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:26:45 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-9e99bafb-12fe-4b3c-92e2-2312ce89bb89 tempest-VolumesTransfersV355Test-794549451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd2be52e-6dc9-4466-9851-8c5dfd43c665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:26:45 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ef3228c6-3161-465b-9c3c-45934a0ee0db tempest-CreateVolumesFromSnapshotTest-1034816622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e81afbc9-de23-4c9a-a347-3113592f41e3 1073741824" returned: 0 in 0.637s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:45 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-9e99bafb-12fe-4b3c-92e2-2312ce89bb89 tempest-VolumesTransfersV355Test-794549451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd2be52e-6dc9-4466-9851-8c5dfd43c665) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:26:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-41822986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84c3055f-b785-401e-84c6-33cf1e804eb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd52b8c18dc04478a49b4f0e7badc689',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:26:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:26:45Z,use_quota=True,user_id='1b27637ce44248328484cb5084d67dc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:26:45 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-9e99bafb-12fe-4b3c-92e2-2312ce89bb89 tempest-VolumesTransfersV355Test-794549451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abb56bbe-1fcd-402e-a3fc-d78b567952ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:26:45 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-9e99bafb-12fe-4b3c-92e2-2312ce89bb89 tempest-VolumesTransfersV355Test-794549451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abb56bbe-1fcd-402e-a3fc-d78b567952ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:26:45 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-9e99bafb-12fe-4b3c-92e2-2312ce89bb89 tempest-VolumesTransfersV355Test-794549451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1cc9168-a915-477c-9bec-21cdf6f131c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:26:45 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-9e99bafb-12fe-4b3c-92e2-2312ce89bb89 tempest-VolumesTransfersV355Test-794549451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1cc9168-a915-477c-9bec-21cdf6f131c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84c3055f-b785-401e-84c6-33cf1e804eb9', 'volume_name': 'volume-84c3055f-b785-401e-84c6-33cf1e804eb9', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:26:45 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-9e99bafb-12fe-4b3c-92e2-2312ce89bb89 tempest-VolumesTransfersV355Test-794549451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90704bc2-5e4d-495d-99be-41a55cc2d28a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:26:45 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-9e99bafb-12fe-4b3c-92e2-2312ce89bb89 tempest-VolumesTransfersV355Test-794549451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90704bc2-5e4d-495d-99be-41a55cc2d28a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:26:45 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-9e99bafb-12fe-4b3c-92e2-2312ce89bb89 tempest-VolumesTransfersV355Test-794549451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5ba747e-6852-4724-bb66-0b62fe2d60e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:26:45 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-9e99bafb-12fe-4b3c-92e2-2312ce89bb89 tempest-VolumesTransfersV355Test-794549451 None] Volume 84c3055f-b785-401e-84c6-33cf1e804eb9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84c3055f-b785-401e-84c6-33cf1e804eb9', 'volume_size': 1} Sep 16 20:26:45 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-9e99bafb-12fe-4b3c-92e2-2312ce89bb89 tempest-VolumesTransfersV355Test-794549451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:26:45 devstack sudo[97534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-4df2d6c7-8f3e-4b53-a7d6-b5b64f39eebe Sep 16 20:26:45 devstack sudo[97534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:45 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ef3228c6-3161-465b-9c3c-45934a0ee0db tempest-CreateVolumesFromSnapshotTest-1034816622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e81afbc9-de23-4c9a-a347-3113592f41e3 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:45 devstack sudo[97536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e81afbc9-de23-4c9a-a347-3113592f41e3 Sep 16 20:26:45 devstack sudo[97536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:45 devstack sudo[97534]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:45 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a58712e0-a0fe-446f-b3be-4bf5e9c024f3 tempest-VolumesActionsTest-1567958602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-4df2d6c7-8f3e-4b53-a7d6-b5b64f39eebe" returned: 0 in 0.431s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:45 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a58712e0-a0fe-446f-b3be-4bf5e9c024f3 tempest-VolumesActionsTest-1567958602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-4df2d6c7-8f3e-4b53-a7d6-b5b64f39eebe {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:45 devstack sudo[97536]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:45 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ef3228c6-3161-465b-9c3c-45934a0ee0db tempest-CreateVolumesFromSnapshotTest-1034816622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e81afbc9-de23-4c9a-a347-3113592f41e3" returned: 0 in 0.315s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:45 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-ef3228c6-3161-465b-9c3c-45934a0ee0db tempest-CreateVolumesFromSnapshotTest-1034816622 None] <== create_volume: return (1045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:26:45 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-ef3228c6-3161-465b-9c3c-45934a0ee0db tempest-CreateVolumesFromSnapshotTest-1034816622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.048s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:26:45 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-37a18274-04c0-456a-8736-3b283911ae40 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.151s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:26:45 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-37a18274-04c0-456a-8736-3b283911ae40 tempest-CreateVolumesFromSnapshotTest-1034816622 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:26:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1288225612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86bb2612-a0e6-4a91-82cc-94b44fe9d0b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a489ad938cc84fb4a2f328f6ddc72940',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:26:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:26:42Z,use_quota=True,user_id='3656a2b8cd84461293ad1284e7c235f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:26:45 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-37a18274-04c0-456a-8736-3b283911ae40 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Creating volume 86bb2612-a0e6-4a91-82cc-94b44fe9d0b4 {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:26:45 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-37a18274-04c0-456a-8736-3b283911ae40 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:26:45 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-37a18274-04c0-456a-8736-3b283911ae40 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:26:45 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-37a18274-04c0-456a-8736-3b283911ae40 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:26:45 devstack sudo[97542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-4df2d6c7-8f3e-4b53-a7d6-b5b64f39eebe Sep 16 20:26:45 devstack sudo[97542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:45 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-37a18274-04c0-456a-8736-3b283911ae40 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:26:45 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-37a18274-04c0-456a-8736-3b283911ae40 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:26:45 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-37a18274-04c0-456a-8736-3b283911ae40 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:26:45 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-37a18274-04c0-456a-8736-3b283911ae40 tempest-CreateVolumesFromSnapshotTest-1034816622 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:26:45 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-37a18274-04c0-456a-8736-3b283911ae40 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-86bb2612-a0e6-4a91-82cc-94b44fe9d0b4 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:45 devstack sudo[97544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-86bb2612-a0e6-4a91-82cc-94b44fe9d0b4 1073741824 Sep 16 20:26:45 devstack sudo[97544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:45 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ef3228c6-3161-465b-9c3c-45934a0ee0db tempest-CreateVolumesFromSnapshotTest-1034816622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8e1b455-4803-49d7-b797-09f099f939af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e81afbc9-de23-4c9a-a347-3113592f41e3', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:26:45 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ef3228c6-3161-465b-9c3c-45934a0ee0db tempest-CreateVolumesFromSnapshotTest-1034816622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25bc25af-0475-4096-9da0-d8ba47a68b4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:26:45 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-ef3228c6-3161-465b-9c3c-45934a0ee0db tempest-CreateVolumesFromSnapshotTest-1034816622 None] Volume volume-e81afbc9-de23-4c9a-a347-3113592f41e3 (e81afbc9-de23-4c9a-a347-3113592f41e3): created successfully Sep 16 20:26:45 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ef3228c6-3161-465b-9c3c-45934a0ee0db tempest-CreateVolumesFromSnapshotTest-1034816622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25bc25af-0475-4096-9da0-d8ba47a68b4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:26:45 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ef3228c6-3161-465b-9c3c-45934a0ee0db tempest-CreateVolumesFromSnapshotTest-1034816622 None] Flow 'volume_create_manager' (d0e16117-3da3-4c4c-99ec-9da821408065) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:26:45 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-ef3228c6-3161-465b-9c3c-45934a0ee0db tempest-CreateVolumesFromSnapshotTest-1034816622 None] Created volume successfully. Sep 16 20:26:45 devstack sudo[97542]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:45 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a58712e0-a0fe-446f-b3be-4bf5e9c024f3 tempest-VolumesActionsTest-1567958602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-4df2d6c7-8f3e-4b53-a7d6-b5b64f39eebe" returned: 0 in 0.266s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:45 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-a58712e0-a0fe-446f-b3be-4bf5e9c024f3 tempest-VolumesActionsTest-1567958602 None] Lock "cinder-quobyte-4df2d6c7-8f3e-4b53-a7d6-b5b64f39eebe" released by "delete_volume" :: held 0.746s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:26:45 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-a58712e0-a0fe-446f-b3be-4bf5e9c024f3 tempest-VolumesActionsTest-1567958602 None] Created reservations ['28d920f9-e6fd-412f-99a1-ef2ff99b7da8', 'a0c79fdb-b0fc-4899-bd0b-5dd8e8f0eeed', '471efd0a-666a-49b7-9d3c-8b7d5b6a90e7', '65a9737c-c1cb-490f-a313-af1361c7ccac'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:26:45 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a58712e0-a0fe-446f-b3be-4bf5e9c024f3 tempest-VolumesActionsTest-1567958602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:26:45 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a58712e0-a0fe-446f-b3be-4bf5e9c024f3 tempest-VolumesActionsTest-1567958602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:26:45 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-a58712e0-a0fe-446f-b3be-4bf5e9c024f3 tempest-VolumesActionsTest-1567958602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:26:45 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-a58712e0-a0fe-446f-b3be-4bf5e9c024f3 tempest-VolumesActionsTest-1567958602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:26:45 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a58712e0-a0fe-446f-b3be-4bf5e9c024f3 tempest-VolumesActionsTest-1567958602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:26:45 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a58712e0-a0fe-446f-b3be-4bf5e9c024f3 tempest-VolumesActionsTest-1567958602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:46 devstack sudo[97550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:26:46 devstack sudo[97550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:46 devstack sudo[97544]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:46 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-37a18274-04c0-456a-8736-3b283911ae40 tempest-CreateVolumesFromSnapshotTest-1034816622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-86bb2612-a0e6-4a91-82cc-94b44fe9d0b4 1073741824" returned: 0 in 0.562s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:46 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-37a18274-04c0-456a-8736-3b283911ae40 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-86bb2612-a0e6-4a91-82cc-94b44fe9d0b4 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:46 devstack sudo[97554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-86bb2612-a0e6-4a91-82cc-94b44fe9d0b4 Sep 16 20:26:46 devstack sudo[97554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:46 devstack sudo[97550]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:46 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a58712e0-a0fe-446f-b3be-4bf5e9c024f3 tempest-VolumesActionsTest-1567958602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.289s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:46 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-a58712e0-a0fe-446f-b3be-4bf5e9c024f3 tempest-VolumesActionsTest-1567958602 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:26:46 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-a58712e0-a0fe-446f-b3be-4bf5e9c024f3 tempest-VolumesActionsTest-1567958602 None] Deleted volume successfully. Sep 16 20:26:46 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-a58712e0-a0fe-446f-b3be-4bf5e9c024f3 tempest-VolumesActionsTest-1567958602 None] Lock "cinder-4df2d6c7-8f3e-4b53-a7d6-b5b64f39eebe-delete_volume" released by "delete_volume" :: held 1.296s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:26:46 devstack sudo[97554]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:46 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-37a18274-04c0-456a-8736-3b283911ae40 tempest-CreateVolumesFromSnapshotTest-1034816622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-86bb2612-a0e6-4a91-82cc-94b44fe9d0b4" returned: 0 in 0.286s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:46 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-37a18274-04c0-456a-8736-3b283911ae40 tempest-CreateVolumesFromSnapshotTest-1034816622 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:26:46 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-37a18274-04c0-456a-8736-3b283911ae40 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:26:46 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-9e99bafb-12fe-4b3c-92e2-2312ce89bb89 tempest-VolumesTransfersV355Test-794549451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.266s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:26:46 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-9e99bafb-12fe-4b3c-92e2-2312ce89bb89 tempest-VolumesTransfersV355Test-794549451 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:26:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-41822986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84c3055f-b785-401e-84c6-33cf1e804eb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd52b8c18dc04478a49b4f0e7badc689',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:26:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:26:45Z,use_quota=True,user_id='1b27637ce44248328484cb5084d67dc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:26:46 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-9e99bafb-12fe-4b3c-92e2-2312ce89bb89 tempest-VolumesTransfersV355Test-794549451 None] Creating volume 84c3055f-b785-401e-84c6-33cf1e804eb9 {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:26:46 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-9e99bafb-12fe-4b3c-92e2-2312ce89bb89 tempest-VolumesTransfersV355Test-794549451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:26:46 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-9e99bafb-12fe-4b3c-92e2-2312ce89bb89 tempest-VolumesTransfersV355Test-794549451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:26:46 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-9e99bafb-12fe-4b3c-92e2-2312ce89bb89 tempest-VolumesTransfersV355Test-794549451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:26:46 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-9e99bafb-12fe-4b3c-92e2-2312ce89bb89 tempest-VolumesTransfersV355Test-794549451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:26:46 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-9e99bafb-12fe-4b3c-92e2-2312ce89bb89 tempest-VolumesTransfersV355Test-794549451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:26:46 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-9e99bafb-12fe-4b3c-92e2-2312ce89bb89 tempest-VolumesTransfersV355Test-794549451 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:26:46 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-9e99bafb-12fe-4b3c-92e2-2312ce89bb89 tempest-VolumesTransfersV355Test-794549451 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:26:46 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-9e99bafb-12fe-4b3c-92e2-2312ce89bb89 tempest-VolumesTransfersV355Test-794549451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-84c3055f-b785-401e-84c6-33cf1e804eb9 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:46 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-37a18274-04c0-456a-8736-3b283911ae40 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dbc5c18-3052-4287-8f95-03ff11018951) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86bb2612-a0e6-4a91-82cc-94b44fe9d0b4', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:26:46 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-37a18274-04c0-456a-8736-3b283911ae40 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07bdfe97-f679-4d02-a15d-bfff63eda5b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:26:46 devstack sudo[97557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-84c3055f-b785-401e-84c6-33cf1e804eb9 1073741824 Sep 16 20:26:46 devstack sudo[97557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:46 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-37a18274-04c0-456a-8736-3b283911ae40 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Volume volume-86bb2612-a0e6-4a91-82cc-94b44fe9d0b4 (86bb2612-a0e6-4a91-82cc-94b44fe9d0b4): created successfully Sep 16 20:26:46 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-37a18274-04c0-456a-8736-3b283911ae40 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07bdfe97-f679-4d02-a15d-bfff63eda5b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:26:46 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-37a18274-04c0-456a-8736-3b283911ae40 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Flow 'volume_create_manager' (81edaeb5-cffd-488b-85ad-f80dd945a4df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:26:46 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-37a18274-04c0-456a-8736-3b283911ae40 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Created volume successfully. Sep 16 20:26:46 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-a274e81e-5b87-4237-aeb0-b016979a7323 tempest-VolumesActionsTest-852371490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:26:46 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a274e81e-5b87-4237-aeb0-b016979a7323 tempest-VolumesActionsTest-852371490 None] Flow 'volume_create_manager' (63300d4d-757a-4ff0-b469-db1fecca870e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:26:46 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a274e81e-5b87-4237-aeb0-b016979a7323 tempest-VolumesActionsTest-852371490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b955b43b-60dd-44c1-8567-aab2541783fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:26:46 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-6f01d790-77f4-4e14-9874-79dc41f5c5a2 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Acquiring lock "cinder-86bb2612-a0e6-4a91-82cc-94b44fe9d0b4-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:26:46 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a274e81e-5b87-4237-aeb0-b016979a7323 tempest-VolumesActionsTest-852371490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b955b43b-60dd-44c1-8567-aab2541783fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:26:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2116806637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd7cffc2-c309-4c3d-8fa8-6bb4f6b850df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='241b8cb66c934319af2d98fd15cea960',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:26:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:26:47Z,use_quota=True,user_id='1ad5071e5a824fd7a960045be4b9a4db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:26:46 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a274e81e-5b87-4237-aeb0-b016979a7323 tempest-VolumesActionsTest-852371490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b951ade1-8165-480c-b725-affdf544f757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:26:46 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a274e81e-5b87-4237-aeb0-b016979a7323 tempest-VolumesActionsTest-852371490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b951ade1-8165-480c-b725-affdf544f757) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:26:46 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a274e81e-5b87-4237-aeb0-b016979a7323 tempest-VolumesActionsTest-852371490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (427eb092-03ac-430e-a1e8-f1e3bf55d73f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:26:46 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a274e81e-5b87-4237-aeb0-b016979a7323 tempest-VolumesActionsTest-852371490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (427eb092-03ac-430e-a1e8-f1e3bf55d73f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd7cffc2-c309-4c3d-8fa8-6bb4f6b850df', 'volume_name': 'volume-cd7cffc2-c309-4c3d-8fa8-6bb4f6b850df', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:26:46 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a274e81e-5b87-4237-aeb0-b016979a7323 tempest-VolumesActionsTest-852371490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55d635ef-4e4d-47fb-87d6-c5e5197a7912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:26:46 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a274e81e-5b87-4237-aeb0-b016979a7323 tempest-VolumesActionsTest-852371490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55d635ef-4e4d-47fb-87d6-c5e5197a7912) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:26:46 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a274e81e-5b87-4237-aeb0-b016979a7323 tempest-VolumesActionsTest-852371490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2635c68-a7ff-4c5a-bee8-29b831ec9e29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:26:46 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-a274e81e-5b87-4237-aeb0-b016979a7323 tempest-VolumesActionsTest-852371490 None] Volume cd7cffc2-c309-4c3d-8fa8-6bb4f6b850df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd7cffc2-c309-4c3d-8fa8-6bb4f6b850df', 'volume_size': 1} Sep 16 20:26:46 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a274e81e-5b87-4237-aeb0-b016979a7323 tempest-VolumesActionsTest-852371490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:26:46 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-6f01d790-77f4-4e14-9874-79dc41f5c5a2 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Lock "cinder-86bb2612-a0e6-4a91-82cc-94b44fe9d0b4-delete_volume" acquired by "delete_volume" :: waited 0.090s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:26:46 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-6f01d790-77f4-4e14-9874-79dc41f5c5a2 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Acquiring lock "cinder-quobyte-86bb2612-a0e6-4a91-82cc-94b44fe9d0b4" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:26:46 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-6f01d790-77f4-4e14-9874-79dc41f5c5a2 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Lock "cinder-quobyte-86bb2612-a0e6-4a91-82cc-94b44fe9d0b4" acquired by "delete_volume" :: waited 0.019s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:26:47 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[3616db1a-2068-4bb9-9d76-af0d34b30795]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:26:47 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-6f01d790-77f4-4e14-9874-79dc41f5c5a2 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-86bb2612-a0e6-4a91-82cc-94b44fe9d0b4 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:47 devstack sudo[97563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-86bb2612-a0e6-4a91-82cc-94b44fe9d0b4 Sep 16 20:26:47 devstack sudo[97563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:47 devstack sudo[97557]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:47 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-9e99bafb-12fe-4b3c-92e2-2312ce89bb89 tempest-VolumesTransfersV355Test-794549451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-84c3055f-b785-401e-84c6-33cf1e804eb9 1073741824" returned: 0 in 0.671s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:47 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-9e99bafb-12fe-4b3c-92e2-2312ce89bb89 tempest-VolumesTransfersV355Test-794549451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-84c3055f-b785-401e-84c6-33cf1e804eb9 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:47 devstack sudo[97565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-84c3055f-b785-401e-84c6-33cf1e804eb9 Sep 16 20:26:47 devstack sudo[97565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:47 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-72c2d331-a7c5-412f-ab4e-c71597f8a18a tempest-VolumeQuotasNegativeTestJSON-404065516 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:26:47 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-72c2d331-a7c5-412f-ab4e-c71597f8a18a tempest-VolumeQuotasNegativeTestJSON-404065516 None] Flow 'volume_create_manager' (02594f8f-e308-4d4d-b8d4-f18fde763831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:26:47 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-72c2d331-a7c5-412f-ab4e-c71597f8a18a tempest-VolumeQuotasNegativeTestJSON-404065516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50411464-e263-4a7f-b79a-3519b7f1290a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:26:47 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-72c2d331-a7c5-412f-ab4e-c71597f8a18a tempest-VolumeQuotasNegativeTestJSON-404065516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50411464-e263-4a7f-b79a-3519b7f1290a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:26:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-447219280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1402ee26-fea1-4e5c-8fd1-c4797a4490d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9642d4811b2484087a28b0c6d4995cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:26:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:26:47Z,use_quota=True,user_id='3bf1f709cf5a43c19a0661399f3ea1eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:26:47 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-72c2d331-a7c5-412f-ab4e-c71597f8a18a tempest-VolumeQuotasNegativeTestJSON-404065516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e26bc462-4260-4ad8-9272-2e5ebb340246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:26:47 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-72c2d331-a7c5-412f-ab4e-c71597f8a18a tempest-VolumeQuotasNegativeTestJSON-404065516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e26bc462-4260-4ad8-9272-2e5ebb340246) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:26:47 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-72c2d331-a7c5-412f-ab4e-c71597f8a18a tempest-VolumeQuotasNegativeTestJSON-404065516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (897b7e4d-f89b-4872-9fc7-fc0c03d68537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:26:47 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-72c2d331-a7c5-412f-ab4e-c71597f8a18a tempest-VolumeQuotasNegativeTestJSON-404065516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (897b7e4d-f89b-4872-9fc7-fc0c03d68537) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1402ee26-fea1-4e5c-8fd1-c4797a4490d3', 'volume_name': 'volume-1402ee26-fea1-4e5c-8fd1-c4797a4490d3', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:26:47 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-72c2d331-a7c5-412f-ab4e-c71597f8a18a tempest-VolumeQuotasNegativeTestJSON-404065516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24ba86d4-2069-429e-a3d1-63bf3c9dd91b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:26:47 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-72c2d331-a7c5-412f-ab4e-c71597f8a18a tempest-VolumeQuotasNegativeTestJSON-404065516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24ba86d4-2069-429e-a3d1-63bf3c9dd91b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:26:47 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-72c2d331-a7c5-412f-ab4e-c71597f8a18a tempest-VolumeQuotasNegativeTestJSON-404065516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (862653bc-02a0-4785-9913-85c0cd89f089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:26:47 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-72c2d331-a7c5-412f-ab4e-c71597f8a18a tempest-VolumeQuotasNegativeTestJSON-404065516 None] Volume 1402ee26-fea1-4e5c-8fd1-c4797a4490d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1402ee26-fea1-4e5c-8fd1-c4797a4490d3', 'volume_size': 1} Sep 16 20:26:47 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-72c2d331-a7c5-412f-ab4e-c71597f8a18a tempest-VolumeQuotasNegativeTestJSON-404065516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:26:47 devstack sudo[97563]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:47 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-6f01d790-77f4-4e14-9874-79dc41f5c5a2 tempest-CreateVolumesFromSnapshotTest-1034816622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-86bb2612-a0e6-4a91-82cc-94b44fe9d0b4" returned: 0 in 0.439s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:47 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-6f01d790-77f4-4e14-9874-79dc41f5c5a2 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-86bb2612-a0e6-4a91-82cc-94b44fe9d0b4 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:47 devstack sudo[97571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-86bb2612-a0e6-4a91-82cc-94b44fe9d0b4 Sep 16 20:26:47 devstack sudo[97571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:47 devstack sudo[97565]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:47 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-9e99bafb-12fe-4b3c-92e2-2312ce89bb89 tempest-VolumesTransfersV355Test-794549451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-84c3055f-b785-401e-84c6-33cf1e804eb9" returned: 0 in 0.274s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:47 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-9e99bafb-12fe-4b3c-92e2-2312ce89bb89 tempest-VolumesTransfersV355Test-794549451 None] <== create_volume: return (993ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:26:47 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-9e99bafb-12fe-4b3c-92e2-2312ce89bb89 tempest-VolumesTransfersV355Test-794549451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.996s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:26:47 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a274e81e-5b87-4237-aeb0-b016979a7323 tempest-VolumesActionsTest-852371490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.592s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:26:47 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-a274e81e-5b87-4237-aeb0-b016979a7323 tempest-VolumesActionsTest-852371490 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:26:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2116806637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd7cffc2-c309-4c3d-8fa8-6bb4f6b850df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='241b8cb66c934319af2d98fd15cea960',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:26:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:26:47Z,use_quota=True,user_id='1ad5071e5a824fd7a960045be4b9a4db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:26:47 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-a274e81e-5b87-4237-aeb0-b016979a7323 tempest-VolumesActionsTest-852371490 None] Creating volume cd7cffc2-c309-4c3d-8fa8-6bb4f6b850df {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:26:47 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a274e81e-5b87-4237-aeb0-b016979a7323 tempest-VolumesActionsTest-852371490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:26:47 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a274e81e-5b87-4237-aeb0-b016979a7323 tempest-VolumesActionsTest-852371490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:26:47 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-a274e81e-5b87-4237-aeb0-b016979a7323 tempest-VolumesActionsTest-852371490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:26:47 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-a274e81e-5b87-4237-aeb0-b016979a7323 tempest-VolumesActionsTest-852371490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:26:47 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a274e81e-5b87-4237-aeb0-b016979a7323 tempest-VolumesActionsTest-852371490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:26:47 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-a274e81e-5b87-4237-aeb0-b016979a7323 tempest-VolumesActionsTest-852371490 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:26:47 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-a274e81e-5b87-4237-aeb0-b016979a7323 tempest-VolumesActionsTest-852371490 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:26:47 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a274e81e-5b87-4237-aeb0-b016979a7323 tempest-VolumesActionsTest-852371490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-cd7cffc2-c309-4c3d-8fa8-6bb4f6b850df 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:47 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-9e99bafb-12fe-4b3c-92e2-2312ce89bb89 tempest-VolumesTransfersV355Test-794549451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5ba747e-6852-4724-bb66-0b62fe2d60e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84c3055f-b785-401e-84c6-33cf1e804eb9', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:26:47 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-9e99bafb-12fe-4b3c-92e2-2312ce89bb89 tempest-VolumesTransfersV355Test-794549451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (039c7a37-a723-4633-9f76-a3a864dad974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:26:47 devstack sudo[97573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-cd7cffc2-c309-4c3d-8fa8-6bb4f6b850df 1073741824 Sep 16 20:26:47 devstack sudo[97573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:47 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-9e99bafb-12fe-4b3c-92e2-2312ce89bb89 tempest-VolumesTransfersV355Test-794549451 None] Volume volume-84c3055f-b785-401e-84c6-33cf1e804eb9 (84c3055f-b785-401e-84c6-33cf1e804eb9): created successfully Sep 16 20:26:47 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-9e99bafb-12fe-4b3c-92e2-2312ce89bb89 tempest-VolumesTransfersV355Test-794549451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (039c7a37-a723-4633-9f76-a3a864dad974) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:26:47 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-9e99bafb-12fe-4b3c-92e2-2312ce89bb89 tempest-VolumesTransfersV355Test-794549451 None] Flow 'volume_create_manager' (bed2f6fa-1cfd-448f-8321-e9a9f6c3d309) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:26:47 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-9e99bafb-12fe-4b3c-92e2-2312ce89bb89 tempest-VolumesTransfersV355Test-794549451 None] Created volume successfully. Sep 16 20:26:47 devstack sudo[97571]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:47 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-6f01d790-77f4-4e14-9874-79dc41f5c5a2 tempest-CreateVolumesFromSnapshotTest-1034816622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-86bb2612-a0e6-4a91-82cc-94b44fe9d0b4" returned: 0 in 0.270s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:47 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-6f01d790-77f4-4e14-9874-79dc41f5c5a2 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Lock "cinder-quobyte-86bb2612-a0e6-4a91-82cc-94b44fe9d0b4" released by "delete_volume" :: held 0.762s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:26:47 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-6f01d790-77f4-4e14-9874-79dc41f5c5a2 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Created reservations ['48167121-d9b2-4e8c-99be-467417857d44', '27518d01-e402-40c8-81a5-023033c2f541', '5169217f-f3fa-4e9d-8ac1-743201241c01', '95ed3e03-8b86-46e8-9fa2-ae908658594a'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:26:47 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-6f01d790-77f4-4e14-9874-79dc41f5c5a2 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:26:47 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-6f01d790-77f4-4e14-9874-79dc41f5c5a2 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:26:47 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-6f01d790-77f4-4e14-9874-79dc41f5c5a2 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:26:47 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-6f01d790-77f4-4e14-9874-79dc41f5c5a2 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:26:47 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-6f01d790-77f4-4e14-9874-79dc41f5c5a2 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:26:47 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-6f01d790-77f4-4e14-9874-79dc41f5c5a2 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:47 devstack sudo[97580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:26:47 devstack sudo[97580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:47 devstack sudo[97573]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:47 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a274e81e-5b87-4237-aeb0-b016979a7323 tempest-VolumesActionsTest-852371490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-cd7cffc2-c309-4c3d-8fa8-6bb4f6b850df 1073741824" returned: 0 in 0.476s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:48 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-c5ad1776-3bf0-4568-b694-f3e5f440d8de tempest-CreateVolumesFromSnapshotTest-1034816622 None] Acquiring lock "cinder-e81afbc9-de23-4c9a-a347-3113592f41e3-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:26:48 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a274e81e-5b87-4237-aeb0-b016979a7323 tempest-VolumesActionsTest-852371490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-cd7cffc2-c309-4c3d-8fa8-6bb4f6b850df {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:48 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-c5ad1776-3bf0-4568-b694-f3e5f440d8de tempest-CreateVolumesFromSnapshotTest-1034816622 None] Lock "cinder-e81afbc9-de23-4c9a-a347-3113592f41e3-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:26:48 devstack sudo[97582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-cd7cffc2-c309-4c3d-8fa8-6bb4f6b850df Sep 16 20:26:48 devstack sudo[97582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:48 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-c5ad1776-3bf0-4568-b694-f3e5f440d8de tempest-CreateVolumesFromSnapshotTest-1034816622 None] Acquiring lock "cinder-quobyte-e81afbc9-de23-4c9a-a347-3113592f41e3" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:26:48 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-c5ad1776-3bf0-4568-b694-f3e5f440d8de tempest-CreateVolumesFromSnapshotTest-1034816622 None] Lock "cinder-quobyte-e81afbc9-de23-4c9a-a347-3113592f41e3" acquired by "delete_volume" :: waited 0.017s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:26:48 devstack sudo[97580]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:48 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-6f01d790-77f4-4e14-9874-79dc41f5c5a2 tempest-CreateVolumesFromSnapshotTest-1034816622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.281s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:48 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-6f01d790-77f4-4e14-9874-79dc41f5c5a2 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:26:48 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-6f01d790-77f4-4e14-9874-79dc41f5c5a2 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Deleted volume successfully. Sep 16 20:26:48 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[c137314f-39d8-4287-8d11-335502bbe077]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:26:48 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-c5ad1776-3bf0-4568-b694-f3e5f440d8de tempest-CreateVolumesFromSnapshotTest-1034816622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e81afbc9-de23-4c9a-a347-3113592f41e3 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:48 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-6f01d790-77f4-4e14-9874-79dc41f5c5a2 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Lock "cinder-86bb2612-a0e6-4a91-82cc-94b44fe9d0b4-delete_volume" released by "delete_volume" :: held 1.285s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:26:48 devstack sudo[97585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e81afbc9-de23-4c9a-a347-3113592f41e3 Sep 16 20:26:48 devstack sudo[97585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:48 devstack sudo[97582]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:48 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a274e81e-5b87-4237-aeb0-b016979a7323 tempest-VolumesActionsTest-852371490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-cd7cffc2-c309-4c3d-8fa8-6bb4f6b850df" returned: 0 in 0.315s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:48 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-a274e81e-5b87-4237-aeb0-b016979a7323 tempest-VolumesActionsTest-852371490 None] <== create_volume: return (852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:26:48 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a274e81e-5b87-4237-aeb0-b016979a7323 tempest-VolumesActionsTest-852371490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.854s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:26:48 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-72c2d331-a7c5-412f-ab4e-c71597f8a18a tempest-VolumeQuotasNegativeTestJSON-404065516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.979s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:26:48 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-72c2d331-a7c5-412f-ab4e-c71597f8a18a tempest-VolumeQuotasNegativeTestJSON-404065516 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:26:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-447219280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1402ee26-fea1-4e5c-8fd1-c4797a4490d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9642d4811b2484087a28b0c6d4995cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:26:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:26:47Z,use_quota=True,user_id='3bf1f709cf5a43c19a0661399f3ea1eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:26:48 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-72c2d331-a7c5-412f-ab4e-c71597f8a18a tempest-VolumeQuotasNegativeTestJSON-404065516 None] Creating volume 1402ee26-fea1-4e5c-8fd1-c4797a4490d3 {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:26:48 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-72c2d331-a7c5-412f-ab4e-c71597f8a18a tempest-VolumeQuotasNegativeTestJSON-404065516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:26:48 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-72c2d331-a7c5-412f-ab4e-c71597f8a18a tempest-VolumeQuotasNegativeTestJSON-404065516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:26:48 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-72c2d331-a7c5-412f-ab4e-c71597f8a18a tempest-VolumeQuotasNegativeTestJSON-404065516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:26:48 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-72c2d331-a7c5-412f-ab4e-c71597f8a18a tempest-VolumeQuotasNegativeTestJSON-404065516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:26:48 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-72c2d331-a7c5-412f-ab4e-c71597f8a18a tempest-VolumeQuotasNegativeTestJSON-404065516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:26:48 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-72c2d331-a7c5-412f-ab4e-c71597f8a18a tempest-VolumeQuotasNegativeTestJSON-404065516 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:26:48 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-72c2d331-a7c5-412f-ab4e-c71597f8a18a tempest-VolumeQuotasNegativeTestJSON-404065516 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:26:48 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-72c2d331-a7c5-412f-ab4e-c71597f8a18a tempest-VolumeQuotasNegativeTestJSON-404065516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-1402ee26-fea1-4e5c-8fd1-c4797a4490d3 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:48 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a274e81e-5b87-4237-aeb0-b016979a7323 tempest-VolumesActionsTest-852371490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2635c68-a7ff-4c5a-bee8-29b831ec9e29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd7cffc2-c309-4c3d-8fa8-6bb4f6b850df', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:26:48 devstack sudo[97588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-1402ee26-fea1-4e5c-8fd1-c4797a4490d3 1073741824 Sep 16 20:26:48 devstack sudo[97588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:48 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a274e81e-5b87-4237-aeb0-b016979a7323 tempest-VolumesActionsTest-852371490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e697261-876c-4006-90ef-3b281040edbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:26:48 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-a274e81e-5b87-4237-aeb0-b016979a7323 tempest-VolumesActionsTest-852371490 None] Volume volume-cd7cffc2-c309-4c3d-8fa8-6bb4f6b850df (cd7cffc2-c309-4c3d-8fa8-6bb4f6b850df): created successfully Sep 16 20:26:48 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a274e81e-5b87-4237-aeb0-b016979a7323 tempest-VolumesActionsTest-852371490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e697261-876c-4006-90ef-3b281040edbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:26:48 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a274e81e-5b87-4237-aeb0-b016979a7323 tempest-VolumesActionsTest-852371490 None] Flow 'volume_create_manager' (63300d4d-757a-4ff0-b469-db1fecca870e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:26:48 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-a274e81e-5b87-4237-aeb0-b016979a7323 tempest-VolumesActionsTest-852371490 None] Created volume successfully. Sep 16 20:26:48 devstack sudo[97585]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:48 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-c5ad1776-3bf0-4568-b694-f3e5f440d8de tempest-CreateVolumesFromSnapshotTest-1034816622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e81afbc9-de23-4c9a-a347-3113592f41e3" returned: 0 in 0.474s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:48 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-c5ad1776-3bf0-4568-b694-f3e5f440d8de tempest-CreateVolumesFromSnapshotTest-1034816622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e81afbc9-de23-4c9a-a347-3113592f41e3 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:48 devstack sudo[97596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e81afbc9-de23-4c9a-a347-3113592f41e3 Sep 16 20:26:48 devstack sudo[97596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:48 devstack sudo[97588]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:48 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-72c2d331-a7c5-412f-ab4e-c71597f8a18a tempest-VolumeQuotasNegativeTestJSON-404065516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-1402ee26-fea1-4e5c-8fd1-c4797a4490d3 1073741824" returned: 0 in 0.523s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:48 devstack sudo[97596]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:48 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-72c2d331-a7c5-412f-ab4e-c71597f8a18a tempest-VolumeQuotasNegativeTestJSON-404065516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-1402ee26-fea1-4e5c-8fd1-c4797a4490d3 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:48 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-c5ad1776-3bf0-4568-b694-f3e5f440d8de tempest-CreateVolumesFromSnapshotTest-1034816622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e81afbc9-de23-4c9a-a347-3113592f41e3" returned: 0 in 0.308s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:48 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-c5ad1776-3bf0-4568-b694-f3e5f440d8de tempest-CreateVolumesFromSnapshotTest-1034816622 None] Lock "cinder-quobyte-e81afbc9-de23-4c9a-a347-3113592f41e3" released by "delete_volume" :: held 0.866s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:26:48 devstack sudo[97601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-1402ee26-fea1-4e5c-8fd1-c4797a4490d3 Sep 16 20:26:48 devstack sudo[97601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:49 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-c5ad1776-3bf0-4568-b694-f3e5f440d8de tempest-CreateVolumesFromSnapshotTest-1034816622 None] Created reservations ['dfcad2db-dd3d-4336-9a76-d4b72b4cfbe7', 'bd3a3ca6-33b7-43c6-930b-832d21079744', 'ed1c629e-b03c-4680-b340-2a8d0120ace3', '425ae0ed-2f31-4959-b96b-210145bb9404'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:26:49 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-6f6f6353-5dd6-44f5-a1ae-e344d328e294 tempest-VolumesTransfersV355Test-316095315 None] Transfer volume completed successfully. Sep 16 20:26:49 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-b3ccaf11-9abc-4b8f-8b7d-4291e523f486 tempest-VolumesActionsTest-1567958602 None] Acquiring lock "cinder-cd7cffc2-c309-4c3d-8fa8-6bb4f6b850df-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:26:49 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-b3ccaf11-9abc-4b8f-8b7d-4291e523f486 tempest-VolumesActionsTest-1567958602 None] Lock "cinder-cd7cffc2-c309-4c3d-8fa8-6bb4f6b850df-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:26:49 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-c5ad1776-3bf0-4568-b694-f3e5f440d8de tempest-CreateVolumesFromSnapshotTest-1034816622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:26:49 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-c5ad1776-3bf0-4568-b694-f3e5f440d8de tempest-CreateVolumesFromSnapshotTest-1034816622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:26:49 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-c5ad1776-3bf0-4568-b694-f3e5f440d8de tempest-CreateVolumesFromSnapshotTest-1034816622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:26:49 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-c5ad1776-3bf0-4568-b694-f3e5f440d8de tempest-CreateVolumesFromSnapshotTest-1034816622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:26:49 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-c5ad1776-3bf0-4568-b694-f3e5f440d8de tempest-CreateVolumesFromSnapshotTest-1034816622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:26:49 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-c5ad1776-3bf0-4568-b694-f3e5f440d8de tempest-CreateVolumesFromSnapshotTest-1034816622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:49 devstack sudo[97603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:26:49 devstack sudo[97603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:49 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-b3ccaf11-9abc-4b8f-8b7d-4291e523f486 tempest-VolumesActionsTest-1567958602 None] Acquiring lock "cinder-quobyte-cd7cffc2-c309-4c3d-8fa8-6bb4f6b850df" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:26:49 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-5240c531-af71-41db-b39a-0a55ade57a41 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Acquiring lock "cinder-12c9c84a-a2e6-4372-b94e-137555a4cd36-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:26:49 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-b3ccaf11-9abc-4b8f-8b7d-4291e523f486 tempest-VolumesActionsTest-1567958602 None] Lock "cinder-quobyte-cd7cffc2-c309-4c3d-8fa8-6bb4f6b850df" acquired by "delete_volume" :: waited 0.026s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:26:49 devstack sudo[97601]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:49 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-72c2d331-a7c5-412f-ab4e-c71597f8a18a tempest-VolumeQuotasNegativeTestJSON-404065516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-1402ee26-fea1-4e5c-8fd1-c4797a4490d3" returned: 0 in 0.346s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:49 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-72c2d331-a7c5-412f-ab4e-c71597f8a18a tempest-VolumeQuotasNegativeTestJSON-404065516 None] <== create_volume: return (926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:26:49 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-72c2d331-a7c5-412f-ab4e-c71597f8a18a tempest-VolumeQuotasNegativeTestJSON-404065516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.929s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:26:49 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-72c2d331-a7c5-412f-ab4e-c71597f8a18a tempest-VolumeQuotasNegativeTestJSON-404065516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (862653bc-02a0-4785-9913-85c0cd89f089) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1402ee26-fea1-4e5c-8fd1-c4797a4490d3', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:26:49 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-72c2d331-a7c5-412f-ab4e-c71597f8a18a tempest-VolumeQuotasNegativeTestJSON-404065516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b778575f-3aaf-4517-bd7a-d370611eebe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:26:49 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-5240c531-af71-41db-b39a-0a55ade57a41 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Lock "cinder-12c9c84a-a2e6-4372-b94e-137555a4cd36-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:26:49 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[97b5c33f-2de0-4b9c-94a5-a3d3262938d1]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:26:49 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b3ccaf11-9abc-4b8f-8b7d-4291e523f486 tempest-VolumesActionsTest-1567958602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-cd7cffc2-c309-4c3d-8fa8-6bb4f6b850df {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:49 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-72c2d331-a7c5-412f-ab4e-c71597f8a18a tempest-VolumeQuotasNegativeTestJSON-404065516 None] Volume volume-1402ee26-fea1-4e5c-8fd1-c4797a4490d3 (1402ee26-fea1-4e5c-8fd1-c4797a4490d3): created successfully Sep 16 20:26:49 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-72c2d331-a7c5-412f-ab4e-c71597f8a18a tempest-VolumeQuotasNegativeTestJSON-404065516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b778575f-3aaf-4517-bd7a-d370611eebe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:26:49 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-72c2d331-a7c5-412f-ab4e-c71597f8a18a tempest-VolumeQuotasNegativeTestJSON-404065516 None] Flow 'volume_create_manager' (02594f8f-e308-4d4d-b8d4-f18fde763831) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:26:49 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-72c2d331-a7c5-412f-ab4e-c71597f8a18a tempest-VolumeQuotasNegativeTestJSON-404065516 None] Created volume successfully. Sep 16 20:26:49 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-5240c531-af71-41db-b39a-0a55ade57a41 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Acquiring lock "cinder-quobyte-12c9c84a-a2e6-4372-b94e-137555a4cd36" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:26:49 devstack sudo[97606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-cd7cffc2-c309-4c3d-8fa8-6bb4f6b850df Sep 16 20:26:49 devstack sudo[97606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:49 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-5240c531-af71-41db-b39a-0a55ade57a41 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Lock "cinder-quobyte-12c9c84a-a2e6-4372-b94e-137555a4cd36" acquired by "delete_volume" :: waited 0.035s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:26:49 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e0b5a1e-9028-4071-ab1e-e18788750730]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:26:49 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-5240c531-af71-41db-b39a-0a55ade57a41 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-12c9c84a-a2e6-4372-b94e-137555a4cd36 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:49 devstack sudo[97603]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:49 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-c5ad1776-3bf0-4568-b694-f3e5f440d8de tempest-CreateVolumesFromSnapshotTest-1034816622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.454s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:49 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-c5ad1776-3bf0-4568-b694-f3e5f440d8de tempest-CreateVolumesFromSnapshotTest-1034816622 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:26:49 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-c5ad1776-3bf0-4568-b694-f3e5f440d8de tempest-CreateVolumesFromSnapshotTest-1034816622 None] Deleted volume successfully. Sep 16 20:26:49 devstack sudo[97608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-12c9c84a-a2e6-4372-b94e-137555a4cd36 Sep 16 20:26:49 devstack sudo[97608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:49 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-c5ad1776-3bf0-4568-b694-f3e5f440d8de tempest-CreateVolumesFromSnapshotTest-1034816622 None] Lock "cinder-e81afbc9-de23-4c9a-a347-3113592f41e3-delete_volume" released by "delete_volume" :: held 1.637s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:26:49 devstack sudo[97606]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:49 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b3ccaf11-9abc-4b8f-8b7d-4291e523f486 tempest-VolumesActionsTest-1567958602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-cd7cffc2-c309-4c3d-8fa8-6bb4f6b850df" returned: 0 in 0.430s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:49 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b3ccaf11-9abc-4b8f-8b7d-4291e523f486 tempest-VolumesActionsTest-1567958602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-cd7cffc2-c309-4c3d-8fa8-6bb4f6b850df {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:49 devstack sudo[97614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-cd7cffc2-c309-4c3d-8fa8-6bb4f6b850df Sep 16 20:26:49 devstack sudo[97614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:49 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-f2de86e5-0872-4293-a192-ec8d4b5e4560 tempest-VolumesTransfersV355Test-1415783764 None] Acquiring lock "cinder-84c3055f-b785-401e-84c6-33cf1e804eb9-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:26:49 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-f2de86e5-0872-4293-a192-ec8d4b5e4560 tempest-VolumesTransfersV355Test-1415783764 None] Lock "cinder-84c3055f-b785-401e-84c6-33cf1e804eb9-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:26:49 devstack sudo[97608]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:49 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-5240c531-af71-41db-b39a-0a55ade57a41 tempest-CreateVolumesFromSnapshotTest-1034816622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-12c9c84a-a2e6-4372-b94e-137555a4cd36" returned: 0 in 0.429s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:49 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-5240c531-af71-41db-b39a-0a55ade57a41 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-12c9c84a-a2e6-4372-b94e-137555a4cd36 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:49 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-f2de86e5-0872-4293-a192-ec8d4b5e4560 tempest-VolumesTransfersV355Test-1415783764 None] Acquiring lock "cinder-quobyte-84c3055f-b785-401e-84c6-33cf1e804eb9" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:26:49 devstack sudo[97619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-12c9c84a-a2e6-4372-b94e-137555a4cd36 Sep 16 20:26:49 devstack sudo[97619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:49 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-f2de86e5-0872-4293-a192-ec8d4b5e4560 tempest-VolumesTransfersV355Test-1415783764 None] Lock "cinder-quobyte-84c3055f-b785-401e-84c6-33cf1e804eb9" acquired by "delete_volume" :: waited 0.027s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:26:50 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa04900a-7682-440d-a767-339239b9c582]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:26:50 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f2de86e5-0872-4293-a192-ec8d4b5e4560 tempest-VolumesTransfersV355Test-1415783764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-84c3055f-b785-401e-84c6-33cf1e804eb9 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:50 devstack sudo[97614]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:50 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b3ccaf11-9abc-4b8f-8b7d-4291e523f486 tempest-VolumesActionsTest-1567958602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-cd7cffc2-c309-4c3d-8fa8-6bb4f6b850df" returned: 0 in 0.278s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:50 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-b3ccaf11-9abc-4b8f-8b7d-4291e523f486 tempest-VolumesActionsTest-1567958602 None] Lock "cinder-quobyte-cd7cffc2-c309-4c3d-8fa8-6bb4f6b850df" released by "delete_volume" :: held 0.787s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:26:50 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-b3ccaf11-9abc-4b8f-8b7d-4291e523f486 tempest-VolumesActionsTest-1567958602 None] Created reservations ['f770e0d1-f0d9-4fdb-89a0-a09a6a772e3b', 'ceab1dce-3cef-4137-b1a2-10a7710067b4', 'e54c9331-1401-4747-a5ab-2c82c95df1b3', '51e02d86-9ff5-49b1-8ab3-0de966ea59bd'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:26:50 devstack sudo[97622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-84c3055f-b785-401e-84c6-33cf1e804eb9 Sep 16 20:26:50 devstack sudo[97622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:50 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-b3ccaf11-9abc-4b8f-8b7d-4291e523f486 tempest-VolumesActionsTest-1567958602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:26:50 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-b3ccaf11-9abc-4b8f-8b7d-4291e523f486 tempest-VolumesActionsTest-1567958602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:26:50 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-b3ccaf11-9abc-4b8f-8b7d-4291e523f486 tempest-VolumesActionsTest-1567958602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:26:50 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-b3ccaf11-9abc-4b8f-8b7d-4291e523f486 tempest-VolumesActionsTest-1567958602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:26:50 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-b3ccaf11-9abc-4b8f-8b7d-4291e523f486 tempest-VolumesActionsTest-1567958602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:26:50 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b3ccaf11-9abc-4b8f-8b7d-4291e523f486 tempest-VolumesActionsTest-1567958602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:50 devstack sudo[97624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:26:50 devstack sudo[97624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:50 devstack sudo[97619]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:50 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-5240c531-af71-41db-b39a-0a55ade57a41 tempest-CreateVolumesFromSnapshotTest-1034816622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-12c9c84a-a2e6-4372-b94e-137555a4cd36" returned: 0 in 0.285s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:50 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-5240c531-af71-41db-b39a-0a55ade57a41 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Lock "cinder-quobyte-12c9c84a-a2e6-4372-b94e-137555a4cd36" released by "delete_volume" :: held 0.778s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:26:50 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-5240c531-af71-41db-b39a-0a55ade57a41 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Created reservations ['8313c5a1-8fe3-4ecd-87c7-58ea0de13ded', '6eec391e-9470-4a79-aafc-bef886d31294', '50a09edc-d66e-450c-a7e6-97681f2e20e5', '34727595-cbeb-417a-8d6c-ee09d9be0c04'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:26:50 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-5240c531-af71-41db-b39a-0a55ade57a41 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:26:50 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-5240c531-af71-41db-b39a-0a55ade57a41 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:26:50 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-5240c531-af71-41db-b39a-0a55ade57a41 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:26:50 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-5240c531-af71-41db-b39a-0a55ade57a41 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:26:50 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-5240c531-af71-41db-b39a-0a55ade57a41 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:26:50 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-5240c531-af71-41db-b39a-0a55ade57a41 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:50 devstack sudo[97624]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:50 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b3ccaf11-9abc-4b8f-8b7d-4291e523f486 tempest-VolumesActionsTest-1567958602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.293s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:50 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-b3ccaf11-9abc-4b8f-8b7d-4291e523f486 tempest-VolumesActionsTest-1567958602 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:26:50 devstack sudo[97622]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:50 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-b3ccaf11-9abc-4b8f-8b7d-4291e523f486 tempest-VolumesActionsTest-1567958602 None] Deleted volume successfully. Sep 16 20:26:50 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f2de86e5-0872-4293-a192-ec8d4b5e4560 tempest-VolumesTransfersV355Test-1415783764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-84c3055f-b785-401e-84c6-33cf1e804eb9" returned: 0 in 0.457s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:50 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f2de86e5-0872-4293-a192-ec8d4b5e4560 tempest-VolumesTransfersV355Test-1415783764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-84c3055f-b785-401e-84c6-33cf1e804eb9 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:50 devstack sudo[97631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:26:50 devstack sudo[97631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:50 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-b3ccaf11-9abc-4b8f-8b7d-4291e523f486 tempest-VolumesActionsTest-1567958602 None] Lock "cinder-cd7cffc2-c309-4c3d-8fa8-6bb4f6b850df-delete_volume" released by "delete_volume" :: held 1.374s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:26:50 devstack sudo[97633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-84c3055f-b785-401e-84c6-33cf1e804eb9 Sep 16 20:26:50 devstack sudo[97633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:50 devstack sudo[97631]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:50 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-5240c531-af71-41db-b39a-0a55ade57a41 tempest-CreateVolumesFromSnapshotTest-1034816622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.284s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:50 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-5240c531-af71-41db-b39a-0a55ade57a41 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:26:50 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-5240c531-af71-41db-b39a-0a55ade57a41 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Deleted volume successfully. Sep 16 20:26:50 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-68881833-0946-4e5c-b8a4-d520cc6e3a98 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Acquiring lock "cinder-80017b43-a037-4728-8c91-0c36afd31a3d-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:26:50 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-5240c531-af71-41db-b39a-0a55ade57a41 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Lock "cinder-12c9c84a-a2e6-4372-b94e-137555a4cd36-delete_volume" released by "delete_volume" :: held 1.454s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:26:50 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-68881833-0946-4e5c-b8a4-d520cc6e3a98 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Lock "cinder-80017b43-a037-4728-8c91-0c36afd31a3d-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:26:50 devstack sudo[97633]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:50 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f2de86e5-0872-4293-a192-ec8d4b5e4560 tempest-VolumesTransfersV355Test-1415783764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-84c3055f-b785-401e-84c6-33cf1e804eb9" returned: 0 in 0.370s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:50 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-f2de86e5-0872-4293-a192-ec8d4b5e4560 tempest-VolumesTransfersV355Test-1415783764 None] Lock "cinder-quobyte-84c3055f-b785-401e-84c6-33cf1e804eb9" released by "delete_volume" :: held 0.896s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:26:50 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-68881833-0946-4e5c-b8a4-d520cc6e3a98 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Acquiring lock "cinder-quobyte-80017b43-a037-4728-8c91-0c36afd31a3d" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:26:50 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-68881833-0946-4e5c-b8a4-d520cc6e3a98 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Lock "cinder-quobyte-80017b43-a037-4728-8c91-0c36afd31a3d" acquired by "delete_volume" :: waited 0.038s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:26:50 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c22c6cf-2199-4007-a910-daa0fb9baba1]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:26:50 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-68881833-0946-4e5c-b8a4-d520cc6e3a98 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-80017b43-a037-4728-8c91-0c36afd31a3d {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:51 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-f2de86e5-0872-4293-a192-ec8d4b5e4560 tempest-VolumesTransfersV355Test-1415783764 None] Created reservations ['6c06a32c-72e4-4a25-8dcf-01a2e22307e1', '3f602547-74b9-41a2-b229-2d9e2e75acfc', 'bd5fd9d2-1cb8-4f8a-9869-c47aa507d1dd', 'b2ac089f-04d7-4b21-8833-b51d8209c965'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:26:51 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8fa89eb-6876-461f-b942-57189b174669 tempest-VolumesActionsTest-852371490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:26:51 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e8fa89eb-6876-461f-b942-57189b174669 tempest-VolumesActionsTest-852371490 None] Flow 'volume_create_manager' (54be074c-0049-4b05-b322-89edc4c11cd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:26:51 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e8fa89eb-6876-461f-b942-57189b174669 tempest-VolumesActionsTest-852371490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6af1ec62-59b2-43b5-aace-7f710ed8efc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:26:51 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e8fa89eb-6876-461f-b942-57189b174669 tempest-VolumesActionsTest-852371490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6af1ec62-59b2-43b5-aace-7f710ed8efc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:26:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1205684104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0ccef0c-3957-47cc-93ae-5deb05bc0c0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='241b8cb66c934319af2d98fd15cea960',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:26:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:26:51Z,use_quota=True,user_id='1ad5071e5a824fd7a960045be4b9a4db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:26:51 devstack sudo[97637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-80017b43-a037-4728-8c91-0c36afd31a3d Sep 16 20:26:51 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e8fa89eb-6876-461f-b942-57189b174669 tempest-VolumesActionsTest-852371490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0d01189-2509-4138-a6da-11825452b4cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:26:51 devstack sudo[97637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:51 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e8fa89eb-6876-461f-b942-57189b174669 tempest-VolumesActionsTest-852371490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0d01189-2509-4138-a6da-11825452b4cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:26:51 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e8fa89eb-6876-461f-b942-57189b174669 tempest-VolumesActionsTest-852371490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (617dd016-f4ca-4948-827a-f90dbec80ba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:26:51 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e8fa89eb-6876-461f-b942-57189b174669 tempest-VolumesActionsTest-852371490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (617dd016-f4ca-4948-827a-f90dbec80ba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0ccef0c-3957-47cc-93ae-5deb05bc0c0f', 'volume_name': 'volume-a0ccef0c-3957-47cc-93ae-5deb05bc0c0f', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:26:51 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e8fa89eb-6876-461f-b942-57189b174669 tempest-VolumesActionsTest-852371490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe4e6692-31ef-43db-94de-a9b6400e69fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:26:51 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e8fa89eb-6876-461f-b942-57189b174669 tempest-VolumesActionsTest-852371490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe4e6692-31ef-43db-94de-a9b6400e69fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:26:51 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e8fa89eb-6876-461f-b942-57189b174669 tempest-VolumesActionsTest-852371490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4351a33-a599-4295-a646-eef8bde3cafe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:26:51 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-e8fa89eb-6876-461f-b942-57189b174669 tempest-VolumesActionsTest-852371490 None] Volume a0ccef0c-3957-47cc-93ae-5deb05bc0c0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0ccef0c-3957-47cc-93ae-5deb05bc0c0f', 'volume_size': 1} Sep 16 20:26:51 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-e8fa89eb-6876-461f-b942-57189b174669 tempest-VolumesActionsTest-852371490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:26:51 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-e8fa89eb-6876-461f-b942-57189b174669 tempest-VolumesActionsTest-852371490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:26:51 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-e8fa89eb-6876-461f-b942-57189b174669 tempest-VolumesActionsTest-852371490 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:26:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1205684104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0ccef0c-3957-47cc-93ae-5deb05bc0c0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='241b8cb66c934319af2d98fd15cea960',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:26:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:26:51Z,use_quota=True,user_id='1ad5071e5a824fd7a960045be4b9a4db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:26:51 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-e8fa89eb-6876-461f-b942-57189b174669 tempest-VolumesActionsTest-852371490 None] Creating volume a0ccef0c-3957-47cc-93ae-5deb05bc0c0f {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:26:51 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-e8fa89eb-6876-461f-b942-57189b174669 tempest-VolumesActionsTest-852371490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:26:51 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-e8fa89eb-6876-461f-b942-57189b174669 tempest-VolumesActionsTest-852371490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:26:51 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-e8fa89eb-6876-461f-b942-57189b174669 tempest-VolumesActionsTest-852371490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:26:51 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-e8fa89eb-6876-461f-b942-57189b174669 tempest-VolumesActionsTest-852371490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:26:51 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-e8fa89eb-6876-461f-b942-57189b174669 tempest-VolumesActionsTest-852371490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:26:51 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-e8fa89eb-6876-461f-b942-57189b174669 tempest-VolumesActionsTest-852371490 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:26:51 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-e8fa89eb-6876-461f-b942-57189b174669 tempest-VolumesActionsTest-852371490 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:26:51 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e8fa89eb-6876-461f-b942-57189b174669 tempest-VolumesActionsTest-852371490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a0ccef0c-3957-47cc-93ae-5deb05bc0c0f 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:51 devstack sudo[97639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a0ccef0c-3957-47cc-93ae-5deb05bc0c0f 1073741824 Sep 16 20:26:51 devstack sudo[97639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:51 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-f2de86e5-0872-4293-a192-ec8d4b5e4560 tempest-VolumesTransfersV355Test-1415783764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:26:51 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-f2de86e5-0872-4293-a192-ec8d4b5e4560 tempest-VolumesTransfersV355Test-1415783764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:26:51 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-f2de86e5-0872-4293-a192-ec8d4b5e4560 tempest-VolumesTransfersV355Test-1415783764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:26:51 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-f2de86e5-0872-4293-a192-ec8d4b5e4560 tempest-VolumesTransfersV355Test-1415783764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:26:51 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-f2de86e5-0872-4293-a192-ec8d4b5e4560 tempest-VolumesTransfersV355Test-1415783764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:26:51 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f2de86e5-0872-4293-a192-ec8d4b5e4560 tempest-VolumesTransfersV355Test-1415783764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:51 devstack sudo[97641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:26:51 devstack sudo[97641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:51 devstack sudo[97637]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:51 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-68881833-0946-4e5c-b8a4-d520cc6e3a98 tempest-CreateVolumesFromSnapshotTest-1034816622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-80017b43-a037-4728-8c91-0c36afd31a3d" returned: 0 in 0.451s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:51 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-68881833-0946-4e5c-b8a4-d520cc6e3a98 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-80017b43-a037-4728-8c91-0c36afd31a3d {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:51 devstack sudo[97648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-80017b43-a037-4728-8c91-0c36afd31a3d Sep 16 20:26:51 devstack sudo[97648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:51 devstack sudo[97641]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:51 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f2de86e5-0872-4293-a192-ec8d4b5e4560 tempest-VolumesTransfersV355Test-1415783764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.323s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:51 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-f2de86e5-0872-4293-a192-ec8d4b5e4560 tempest-VolumesTransfersV355Test-1415783764 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:26:51 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-f2de86e5-0872-4293-a192-ec8d4b5e4560 tempest-VolumesTransfersV355Test-1415783764 None] Deleted volume successfully. Sep 16 20:26:51 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-f2de86e5-0872-4293-a192-ec8d4b5e4560 tempest-VolumesTransfersV355Test-1415783764 None] Lock "cinder-84c3055f-b785-401e-84c6-33cf1e804eb9-delete_volume" released by "delete_volume" :: held 1.757s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:26:51 devstack sudo[97639]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:51 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e8fa89eb-6876-461f-b942-57189b174669 tempest-VolumesActionsTest-852371490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a0ccef0c-3957-47cc-93ae-5deb05bc0c0f 1073741824" returned: 0 in 0.557s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:51 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e8fa89eb-6876-461f-b942-57189b174669 tempest-VolumesActionsTest-852371490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a0ccef0c-3957-47cc-93ae-5deb05bc0c0f {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:51 devstack sudo[97648]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:51 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-68881833-0946-4e5c-b8a4-d520cc6e3a98 tempest-CreateVolumesFromSnapshotTest-1034816622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-80017b43-a037-4728-8c91-0c36afd31a3d" returned: 0 in 0.340s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:51 devstack sudo[97653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a0ccef0c-3957-47cc-93ae-5deb05bc0c0f Sep 16 20:26:51 devstack sudo[97653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:51 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-68881833-0946-4e5c-b8a4-d520cc6e3a98 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Lock "cinder-quobyte-80017b43-a037-4728-8c91-0c36afd31a3d" released by "delete_volume" :: held 0.853s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:26:51 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-68881833-0946-4e5c-b8a4-d520cc6e3a98 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Created reservations ['c9824eab-6222-4fe7-bdb4-730cc3ff1740', '44390f16-5cc8-4cba-8d4e-c4f8f4615501', '9877c128-bc0d-4483-b5c7-a607402bebdd', '5f4037db-19f7-45c3-b1fc-c77dddd5e374'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:26:51 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-e13dcacd-9420-4e0c-aaf2-2155e15dd8cf tempest-VolumeQuotasNegativeTestJSON-404065516 None] Acquiring lock "cinder-1402ee26-fea1-4e5c-8fd1-c4797a4490d3-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:26:51 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-e13dcacd-9420-4e0c-aaf2-2155e15dd8cf tempest-VolumeQuotasNegativeTestJSON-404065516 None] Lock "cinder-1402ee26-fea1-4e5c-8fd1-c4797a4490d3-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:26:51 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-68881833-0946-4e5c-b8a4-d520cc6e3a98 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:26:51 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-68881833-0946-4e5c-b8a4-d520cc6e3a98 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:26:51 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-68881833-0946-4e5c-b8a4-d520cc6e3a98 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:26:51 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-68881833-0946-4e5c-b8a4-d520cc6e3a98 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:26:51 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-68881833-0946-4e5c-b8a4-d520cc6e3a98 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:26:51 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-68881833-0946-4e5c-b8a4-d520cc6e3a98 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:51 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-e13dcacd-9420-4e0c-aaf2-2155e15dd8cf tempest-VolumeQuotasNegativeTestJSON-404065516 None] Acquiring lock "cinder-quobyte-1402ee26-fea1-4e5c-8fd1-c4797a4490d3" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:26:52 devstack sudo[97655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:26:52 devstack sudo[97655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:52 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-e13dcacd-9420-4e0c-aaf2-2155e15dd8cf tempest-VolumeQuotasNegativeTestJSON-404065516 None] Lock "cinder-quobyte-1402ee26-fea1-4e5c-8fd1-c4797a4490d3" acquired by "delete_volume" :: waited 0.029s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:26:52 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-6504dd86-9e77-44c8-b64b-c3d41976fa68 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Acquiring lock "cinder-c2119929-a780-495d-9855-3c8adc0b9205-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:26:52 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb8cc72b-5ea4-455d-a729-2e3cf680fa63]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:26:52 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e13dcacd-9420-4e0c-aaf2-2155e15dd8cf tempest-VolumeQuotasNegativeTestJSON-404065516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-1402ee26-fea1-4e5c-8fd1-c4797a4490d3 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:52 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-6504dd86-9e77-44c8-b64b-c3d41976fa68 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Lock "cinder-c2119929-a780-495d-9855-3c8adc0b9205-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:26:52 devstack sudo[97653]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:52 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e8fa89eb-6876-461f-b942-57189b174669 tempest-VolumesActionsTest-852371490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a0ccef0c-3957-47cc-93ae-5deb05bc0c0f" returned: 0 in 0.412s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:52 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-e8fa89eb-6876-461f-b942-57189b174669 tempest-VolumesActionsTest-852371490 None] <== create_volume: return (1010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:26:52 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-e8fa89eb-6876-461f-b942-57189b174669 tempest-VolumesActionsTest-852371490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.014s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:26:52 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e8fa89eb-6876-461f-b942-57189b174669 tempest-VolumesActionsTest-852371490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4351a33-a599-4295-a646-eef8bde3cafe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0ccef0c-3957-47cc-93ae-5deb05bc0c0f', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:26:52 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e8fa89eb-6876-461f-b942-57189b174669 tempest-VolumesActionsTest-852371490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3df5b73-ec1c-4b8c-80c7-8121938db545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:26:52 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-6504dd86-9e77-44c8-b64b-c3d41976fa68 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Acquiring lock "cinder-quobyte-c2119929-a780-495d-9855-3c8adc0b9205" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:26:52 devstack sudo[97658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-1402ee26-fea1-4e5c-8fd1-c4797a4490d3 Sep 16 20:26:52 devstack sudo[97658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:52 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-e8fa89eb-6876-461f-b942-57189b174669 tempest-VolumesActionsTest-852371490 None] Volume volume-a0ccef0c-3957-47cc-93ae-5deb05bc0c0f (a0ccef0c-3957-47cc-93ae-5deb05bc0c0f): created successfully Sep 16 20:26:52 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e8fa89eb-6876-461f-b942-57189b174669 tempest-VolumesActionsTest-852371490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3df5b73-ec1c-4b8c-80c7-8121938db545) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:26:52 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e8fa89eb-6876-461f-b942-57189b174669 tempest-VolumesActionsTest-852371490 None] Flow 'volume_create_manager' (54be074c-0049-4b05-b322-89edc4c11cd4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:26:52 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-e8fa89eb-6876-461f-b942-57189b174669 tempest-VolumesActionsTest-852371490 None] Created volume successfully. Sep 16 20:26:52 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-6504dd86-9e77-44c8-b64b-c3d41976fa68 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Lock "cinder-quobyte-c2119929-a780-495d-9855-3c8adc0b9205" acquired by "delete_volume" :: waited 0.050s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:26:52 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[67a06fe8-a5b0-49a7-b92e-3176a14107e6]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:26:52 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-6504dd86-9e77-44c8-b64b-c3d41976fa68 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c2119929-a780-495d-9855-3c8adc0b9205 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:52 devstack sudo[97655]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:52 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-68881833-0946-4e5c-b8a4-d520cc6e3a98 tempest-CreateVolumesFromSnapshotTest-1034816622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.387s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:52 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-68881833-0946-4e5c-b8a4-d520cc6e3a98 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:26:52 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-68881833-0946-4e5c-b8a4-d520cc6e3a98 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Deleted volume successfully. Sep 16 20:26:52 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-68881833-0946-4e5c-b8a4-d520cc6e3a98 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Lock "cinder-80017b43-a037-4728-8c91-0c36afd31a3d-delete_volume" released by "delete_volume" :: held 1.579s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:26:52 devstack sudo[97660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c2119929-a780-495d-9855-3c8adc0b9205 Sep 16 20:26:52 devstack sudo[97660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:52 devstack sudo[97658]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:52 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e13dcacd-9420-4e0c-aaf2-2155e15dd8cf tempest-VolumeQuotasNegativeTestJSON-404065516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-1402ee26-fea1-4e5c-8fd1-c4797a4490d3" returned: 0 in 0.434s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:52 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e13dcacd-9420-4e0c-aaf2-2155e15dd8cf tempest-VolumeQuotasNegativeTestJSON-404065516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-1402ee26-fea1-4e5c-8fd1-c4797a4490d3 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:52 devstack sudo[97667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-1402ee26-fea1-4e5c-8fd1-c4797a4490d3 Sep 16 20:26:52 devstack sudo[97667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:52 devstack sudo[97660]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:52 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-6504dd86-9e77-44c8-b64b-c3d41976fa68 tempest-CreateVolumesFromSnapshotTest-1034816622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c2119929-a780-495d-9855-3c8adc0b9205" returned: 0 in 0.433s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:52 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-6504dd86-9e77-44c8-b64b-c3d41976fa68 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c2119929-a780-495d-9855-3c8adc0b9205 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:52 devstack sudo[97672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c2119929-a780-495d-9855-3c8adc0b9205 Sep 16 20:26:52 devstack sudo[97672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:52 devstack sudo[97667]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:52 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb2c38a0-654a-45ea-8888-b1d06c09a022 tempest-VolumesTransfersV355Test-794549451 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:26:52 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-eb2c38a0-654a-45ea-8888-b1d06c09a022 tempest-VolumesTransfersV355Test-794549451 None] Flow 'volume_create_manager' (69ea899f-9740-4cab-beeb-f74916cec535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:26:52 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-eb2c38a0-654a-45ea-8888-b1d06c09a022 tempest-VolumesTransfersV355Test-794549451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8afd5ac5-ebc3-4015-8c6d-c7d1a740a2f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:26:52 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e13dcacd-9420-4e0c-aaf2-2155e15dd8cf tempest-VolumeQuotasNegativeTestJSON-404065516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-1402ee26-fea1-4e5c-8fd1-c4797a4490d3" returned: 0 in 0.346s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:52 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-eb2c38a0-654a-45ea-8888-b1d06c09a022 tempest-VolumesTransfersV355Test-794549451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8afd5ac5-ebc3-4015-8c6d-c7d1a740a2f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:26:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-715070225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1203de21-3f18-4d6c-bf23-4ab971077c36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd52b8c18dc04478a49b4f0e7badc689',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:26:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:26:53Z,use_quota=True,user_id='1b27637ce44248328484cb5084d67dc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:26:52 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-eb2c38a0-654a-45ea-8888-b1d06c09a022 tempest-VolumesTransfersV355Test-794549451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4489b5ee-4e2d-49cf-83c9-7b7b0f27f236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:26:52 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-eb2c38a0-654a-45ea-8888-b1d06c09a022 tempest-VolumesTransfersV355Test-794549451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4489b5ee-4e2d-49cf-83c9-7b7b0f27f236) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:26:52 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-eb2c38a0-654a-45ea-8888-b1d06c09a022 tempest-VolumesTransfersV355Test-794549451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e129ea8e-d782-4edb-8bf2-f501db02d8ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:26:52 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-eb2c38a0-654a-45ea-8888-b1d06c09a022 tempest-VolumesTransfersV355Test-794549451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e129ea8e-d782-4edb-8bf2-f501db02d8ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1203de21-3f18-4d6c-bf23-4ab971077c36', 'volume_name': 'volume-1203de21-3f18-4d6c-bf23-4ab971077c36', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:26:52 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-eb2c38a0-654a-45ea-8888-b1d06c09a022 tempest-VolumesTransfersV355Test-794549451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (879d1376-9cdf-4fc0-87ff-58d9a53c82cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:26:52 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-eb2c38a0-654a-45ea-8888-b1d06c09a022 tempest-VolumesTransfersV355Test-794549451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (879d1376-9cdf-4fc0-87ff-58d9a53c82cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:26:52 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-eb2c38a0-654a-45ea-8888-b1d06c09a022 tempest-VolumesTransfersV355Test-794549451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (942dc690-acb0-48a7-b34c-6d611418491f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:26:52 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-eb2c38a0-654a-45ea-8888-b1d06c09a022 tempest-VolumesTransfersV355Test-794549451 None] Volume 1203de21-3f18-4d6c-bf23-4ab971077c36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1203de21-3f18-4d6c-bf23-4ab971077c36', 'volume_size': 1} Sep 16 20:26:52 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-eb2c38a0-654a-45ea-8888-b1d06c09a022 tempest-VolumesTransfersV355Test-794549451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:26:52 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-eb2c38a0-654a-45ea-8888-b1d06c09a022 tempest-VolumesTransfersV355Test-794549451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:26:52 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-eb2c38a0-654a-45ea-8888-b1d06c09a022 tempest-VolumesTransfersV355Test-794549451 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:26:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-715070225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1203de21-3f18-4d6c-bf23-4ab971077c36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd52b8c18dc04478a49b4f0e7badc689',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:26:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:26:53Z,use_quota=True,user_id='1b27637ce44248328484cb5084d67dc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:26:52 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-eb2c38a0-654a-45ea-8888-b1d06c09a022 tempest-VolumesTransfersV355Test-794549451 None] Creating volume 1203de21-3f18-4d6c-bf23-4ab971077c36 {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:26:52 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-eb2c38a0-654a-45ea-8888-b1d06c09a022 tempest-VolumesTransfersV355Test-794549451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:26:52 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-eb2c38a0-654a-45ea-8888-b1d06c09a022 tempest-VolumesTransfersV355Test-794549451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:26:52 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-eb2c38a0-654a-45ea-8888-b1d06c09a022 tempest-VolumesTransfersV355Test-794549451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:26:52 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-eb2c38a0-654a-45ea-8888-b1d06c09a022 tempest-VolumesTransfersV355Test-794549451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:26:52 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-eb2c38a0-654a-45ea-8888-b1d06c09a022 tempest-VolumesTransfersV355Test-794549451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:26:52 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-eb2c38a0-654a-45ea-8888-b1d06c09a022 tempest-VolumesTransfersV355Test-794549451 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:26:52 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-eb2c38a0-654a-45ea-8888-b1d06c09a022 tempest-VolumesTransfersV355Test-794549451 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:26:52 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-eb2c38a0-654a-45ea-8888-b1d06c09a022 tempest-VolumesTransfersV355Test-794549451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-1203de21-3f18-4d6c-bf23-4ab971077c36 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:52 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-e13dcacd-9420-4e0c-aaf2-2155e15dd8cf tempest-VolumeQuotasNegativeTestJSON-404065516 None] Lock "cinder-quobyte-1402ee26-fea1-4e5c-8fd1-c4797a4490d3" released by "delete_volume" :: held 0.915s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:26:52 devstack sudo[97675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-1203de21-3f18-4d6c-bf23-4ab971077c36 1073741824 Sep 16 20:26:52 devstack sudo[97675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:52 devstack sudo[97672]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:52 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-6504dd86-9e77-44c8-b64b-c3d41976fa68 tempest-CreateVolumesFromSnapshotTest-1034816622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c2119929-a780-495d-9855-3c8adc0b9205" returned: 0 in 0.265s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:52 devstack cinder-volume[86188]: DEBUG oslo_service.periodic_task [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86188) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 20:26:52 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:26:52 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:26:52 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:26:53 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:26:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:26:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:53 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-6504dd86-9e77-44c8-b64b-c3d41976fa68 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Lock "cinder-quobyte-c2119929-a780-495d-9855-3c8adc0b9205" released by "delete_volume" :: held 0.779s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:26:53 devstack sudo[97678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:26:53 devstack sudo[97678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:53 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-e13dcacd-9420-4e0c-aaf2-2155e15dd8cf tempest-VolumeQuotasNegativeTestJSON-404065516 None] Created reservations ['41b4c6f9-b711-4efb-9019-3d9c502dabb4', '2ea98c35-8acc-40be-8afd-014a3e055333', '49356400-cb24-467a-8c82-72f7893143c2', 'baeb50e5-effb-4bd5-878d-331f4fbff5e2'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:26:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-e13dcacd-9420-4e0c-aaf2-2155e15dd8cf tempest-VolumeQuotasNegativeTestJSON-404065516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:26:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-e13dcacd-9420-4e0c-aaf2-2155e15dd8cf tempest-VolumeQuotasNegativeTestJSON-404065516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:26:53 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-e13dcacd-9420-4e0c-aaf2-2155e15dd8cf tempest-VolumeQuotasNegativeTestJSON-404065516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:26:53 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-e13dcacd-9420-4e0c-aaf2-2155e15dd8cf tempest-VolumeQuotasNegativeTestJSON-404065516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:26:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-e13dcacd-9420-4e0c-aaf2-2155e15dd8cf tempest-VolumeQuotasNegativeTestJSON-404065516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:26:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e13dcacd-9420-4e0c-aaf2-2155e15dd8cf tempest-VolumeQuotasNegativeTestJSON-404065516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:53 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-6504dd86-9e77-44c8-b64b-c3d41976fa68 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Created reservations ['b62f8126-9805-4558-9f95-1d264decad25', 'b3ef1545-4ff4-4f42-a069-b89094532b44', '5e867217-b4d0-44a3-8667-5d95ef2d93d4', '15a4146d-43b9-451b-9cf8-2573829a82db'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:26:53 devstack sudo[97681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:26:53 devstack sudo[97681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-6504dd86-9e77-44c8-b64b-c3d41976fa68 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:26:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-6504dd86-9e77-44c8-b64b-c3d41976fa68 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:26:53 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-6504dd86-9e77-44c8-b64b-c3d41976fa68 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:26:53 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-6504dd86-9e77-44c8-b64b-c3d41976fa68 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:26:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-6504dd86-9e77-44c8-b64b-c3d41976fa68 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:26:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-6504dd86-9e77-44c8-b64b-c3d41976fa68 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:53 devstack sudo[97685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:26:53 devstack sudo[97685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:53 devstack sudo[97678]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.343s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:53 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:26:53 devstack cinder-volume[86188]: DEBUG oslo_service.periodic_task [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Running periodic task VolumeManager._thread_info {{(pid=86188) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 20:26:53 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] thread count: 28 {{(pid=86188) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 16 20:26:53 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] thread info: [<_MainThread(MainThread, started 139858124406912)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86188) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 16 20:26:53 devstack sudo[97675]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-eb2c38a0-654a-45ea-8888-b1d06c09a022 tempest-VolumesTransfersV355Test-794549451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-1203de21-3f18-4d6c-bf23-4ab971077c36 1073741824" returned: 0 in 0.556s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-eb2c38a0-654a-45ea-8888-b1d06c09a022 tempest-VolumesTransfersV355Test-794549451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-1203de21-3f18-4d6c-bf23-4ab971077c36 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:53 devstack sudo[97681]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e13dcacd-9420-4e0c-aaf2-2155e15dd8cf tempest-VolumeQuotasNegativeTestJSON-404065516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.406s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:53 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-e13dcacd-9420-4e0c-aaf2-2155e15dd8cf tempest-VolumeQuotasNegativeTestJSON-404065516 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:26:53 devstack sudo[97691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-1203de21-3f18-4d6c-bf23-4ab971077c36 Sep 16 20:26:53 devstack sudo[97691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:53 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-e13dcacd-9420-4e0c-aaf2-2155e15dd8cf tempest-VolumeQuotasNegativeTestJSON-404065516 None] Deleted volume successfully. Sep 16 20:26:53 devstack sudo[97685]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-6504dd86-9e77-44c8-b64b-c3d41976fa68 tempest-CreateVolumesFromSnapshotTest-1034816622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.318s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:53 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-6504dd86-9e77-44c8-b64b-c3d41976fa68 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:26:53 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-6504dd86-9e77-44c8-b64b-c3d41976fa68 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Deleted volume successfully. Sep 16 20:26:53 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-e13dcacd-9420-4e0c-aaf2-2155e15dd8cf tempest-VolumeQuotasNegativeTestJSON-404065516 None] Lock "cinder-1402ee26-fea1-4e5c-8fd1-c4797a4490d3-delete_volume" released by "delete_volume" :: held 1.673s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:26:53 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-6504dd86-9e77-44c8-b64b-c3d41976fa68 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Lock "cinder-c2119929-a780-495d-9855-3c8adc0b9205-delete_volume" released by "delete_volume" :: held 1.476s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:26:53 devstack sudo[97691]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-eb2c38a0-654a-45ea-8888-b1d06c09a022 tempest-VolumesTransfersV355Test-794549451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-1203de21-3f18-4d6c-bf23-4ab971077c36" returned: 0 in 0.291s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:53 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-eb2c38a0-654a-45ea-8888-b1d06c09a022 tempest-VolumesTransfersV355Test-794549451 None] <== create_volume: return (894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:26:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-eb2c38a0-654a-45ea-8888-b1d06c09a022 tempest-VolumesTransfersV355Test-794549451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:26:53 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-eb2c38a0-654a-45ea-8888-b1d06c09a022 tempest-VolumesTransfersV355Test-794549451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (942dc690-acb0-48a7-b34c-6d611418491f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1203de21-3f18-4d6c-bf23-4ab971077c36', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:26:53 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-eb2c38a0-654a-45ea-8888-b1d06c09a022 tempest-VolumesTransfersV355Test-794549451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4e23329-1d03-4cd3-b2cc-59800f4ae060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:26:53 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-eb2c38a0-654a-45ea-8888-b1d06c09a022 tempest-VolumesTransfersV355Test-794549451 None] Volume volume-1203de21-3f18-4d6c-bf23-4ab971077c36 (1203de21-3f18-4d6c-bf23-4ab971077c36): created successfully Sep 16 20:26:53 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-eb2c38a0-654a-45ea-8888-b1d06c09a022 tempest-VolumesTransfersV355Test-794549451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4e23329-1d03-4cd3-b2cc-59800f4ae060) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:26:53 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-eb2c38a0-654a-45ea-8888-b1d06c09a022 tempest-VolumesTransfersV355Test-794549451 None] Flow 'volume_create_manager' (69ea899f-9740-4cab-beeb-f74916cec535) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:26:53 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-eb2c38a0-654a-45ea-8888-b1d06c09a022 tempest-VolumesTransfersV355Test-794549451 None] Created volume successfully. Sep 16 20:26:53 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-53226a5b-e3cf-4a0a-a4b8-b1063cf137f4 tempest-VolumesActionsTest-852371490 None] Acquiring lock "cinder-a0ccef0c-3957-47cc-93ae-5deb05bc0c0f-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:26:53 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-53226a5b-e3cf-4a0a-a4b8-b1063cf137f4 tempest-VolumesActionsTest-852371490 None] Lock "cinder-a0ccef0c-3957-47cc-93ae-5deb05bc0c0f-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:26:53 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-53226a5b-e3cf-4a0a-a4b8-b1063cf137f4 tempest-VolumesActionsTest-852371490 None] Acquiring lock "cinder-quobyte-a0ccef0c-3957-47cc-93ae-5deb05bc0c0f" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:26:54 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-53226a5b-e3cf-4a0a-a4b8-b1063cf137f4 tempest-VolumesActionsTest-852371490 None] Lock "cinder-quobyte-a0ccef0c-3957-47cc-93ae-5deb05bc0c0f" acquired by "delete_volume" :: waited 0.016s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:26:54 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[674cf563-ec82-4246-9bf6-e7128ef92b43]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:26:54 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-53226a5b-e3cf-4a0a-a4b8-b1063cf137f4 tempest-VolumesActionsTest-852371490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a0ccef0c-3957-47cc-93ae-5deb05bc0c0f {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:54 devstack sudo[97694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a0ccef0c-3957-47cc-93ae-5deb05bc0c0f Sep 16 20:26:54 devstack sudo[97694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:54 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-2d9445ae-3e56-4595-92ac-0b90ed5b112a tempest-CreateVolumesFromSnapshotTest-1034816622 None] Acquiring lock "cinder-fa81d337-0581-4321-88b0-f7694a722a13-delete_snapshot" by "delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:26:54 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-2d9445ae-3e56-4595-92ac-0b90ed5b112a tempest-CreateVolumesFromSnapshotTest-1034816622 None] Lock "cinder-fa81d337-0581-4321-88b0-f7694a722a13-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:26:54 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-2d9445ae-3e56-4595-92ac-0b90ed5b112a tempest-CreateVolumesFromSnapshotTest-1034816622 None] Acquiring lock "cinder-quobyte-86fe5af1-92c6-45b0-81eb-04a5259b0964" by "delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:26:54 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-2d9445ae-3e56-4595-92ac-0b90ed5b112a tempest-CreateVolumesFromSnapshotTest-1034816622 None] Lock "cinder-quobyte-86fe5af1-92c6-45b0-81eb-04a5259b0964" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:26:54 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-2d9445ae-3e56-4595-92ac-0b90ed5b112a tempest-CreateVolumesFromSnapshotTest-1034816622 None] Acquiring lock "cinder-quobyte-fa81d337-0581-4321-88b0-f7694a722a13" by "_delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:26:54 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-2d9445ae-3e56-4595-92ac-0b90ed5b112a tempest-CreateVolumesFromSnapshotTest-1034816622 None] Lock "cinder-quobyte-fa81d337-0581-4321-88b0-f7694a722a13" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:26:54 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-2d9445ae-3e56-4595-92ac-0b90ed5b112a tempest-CreateVolumesFromSnapshotTest-1034816622 None] Deleting offline snapshot fa81d337-0581-4321-88b0-f7694a722a13 of volume 86fe5af1-92c6-45b0-81eb-04a5259b0964 {{(pid=86188) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 20:26:54 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-2d9445ae-3e56-4595-92ac-0b90ed5b112a tempest-CreateVolumesFromSnapshotTest-1034816622 None] snapshot_file for this snap is: volume-86fe5af1-92c6-45b0-81eb-04a5259b0964.fa81d337-0581-4321-88b0-f7694a722a13 {{(pid=86188) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 20:26:54 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aa8d2e0-ba56-453a-892a-28fe335a4ae2]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:26:54 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-2d9445ae-3e56-4595-92ac-0b90ed5b112a tempest-CreateVolumesFromSnapshotTest-1034816622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-86fe5af1-92c6-45b0-81eb-04a5259b0964.fa81d337-0581-4321-88b0-f7694a722a13 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:54 devstack sudo[97694]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:54 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-53226a5b-e3cf-4a0a-a4b8-b1063cf137f4 tempest-VolumesActionsTest-852371490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a0ccef0c-3957-47cc-93ae-5deb05bc0c0f" returned: 0 in 0.437s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:54 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-53226a5b-e3cf-4a0a-a4b8-b1063cf137f4 tempest-VolumesActionsTest-852371490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a0ccef0c-3957-47cc-93ae-5deb05bc0c0f {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:54 devstack sudo[97716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a0ccef0c-3957-47cc-93ae-5deb05bc0c0f Sep 16 20:26:54 devstack sudo[97716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:54 devstack sudo[97714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-86fe5af1-92c6-45b0-81eb-04a5259b0964.fa81d337-0581-4321-88b0-f7694a722a13 Sep 16 20:26:54 devstack sudo[97714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:54 devstack sudo[97716]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:54 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-53226a5b-e3cf-4a0a-a4b8-b1063cf137f4 tempest-VolumesActionsTest-852371490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a0ccef0c-3957-47cc-93ae-5deb05bc0c0f" returned: 0 in 0.265s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:54 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-53226a5b-e3cf-4a0a-a4b8-b1063cf137f4 tempest-VolumesActionsTest-852371490 None] Lock "cinder-quobyte-a0ccef0c-3957-47cc-93ae-5deb05bc0c0f" released by "delete_volume" :: held 0.754s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:26:54 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-53226a5b-e3cf-4a0a-a4b8-b1063cf137f4 tempest-VolumesActionsTest-852371490 None] Created reservations ['6cebdaa9-7890-448f-9c33-ce1a86a9d8a7', '122abcc0-bebf-434f-8890-15ad9d3a7bef', '5c12f0d6-c8cc-4e30-99f9-706b6423e119', 'd25640d2-9999-47a8-88bf-3f8ad3920232'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:26:54 devstack sudo[97714]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:54 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-2d9445ae-3e56-4595-92ac-0b90ed5b112a tempest-CreateVolumesFromSnapshotTest-1034816622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-86fe5af1-92c6-45b0-81eb-04a5259b0964.fa81d337-0581-4321-88b0-f7694a722a13" returned: 0 in 0.419s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:54 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-2d9445ae-3e56-4595-92ac-0b90ed5b112a tempest-CreateVolumesFromSnapshotTest-1034816622 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-86fe5af1-92c6-45b0-81eb-04a5259b0964(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86188) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 20:26:54 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f849a95-07d5-45e5-bcf1-e52addd3f40c]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:26:54 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-2d9445ae-3e56-4595-92ac-0b90ed5b112a tempest-CreateVolumesFromSnapshotTest-1034816622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-86fe5af1-92c6-45b0-81eb-04a5259b0964 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:54 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-53226a5b-e3cf-4a0a-a4b8-b1063cf137f4 tempest-VolumesActionsTest-852371490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:26:54 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-53226a5b-e3cf-4a0a-a4b8-b1063cf137f4 tempest-VolumesActionsTest-852371490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:26:54 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-53226a5b-e3cf-4a0a-a4b8-b1063cf137f4 tempest-VolumesActionsTest-852371490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:26:54 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-53226a5b-e3cf-4a0a-a4b8-b1063cf137f4 tempest-VolumesActionsTest-852371490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:26:54 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-53226a5b-e3cf-4a0a-a4b8-b1063cf137f4 tempest-VolumesActionsTest-852371490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:26:54 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-53226a5b-e3cf-4a0a-a4b8-b1063cf137f4 tempest-VolumesActionsTest-852371490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:54 devstack sudo[97744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:26:54 devstack sudo[97744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:55 devstack sudo[97742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-86fe5af1-92c6-45b0-81eb-04a5259b0964 Sep 16 20:26:55 devstack sudo[97742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:55 devstack sudo[97744]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:55 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-53226a5b-e3cf-4a0a-a4b8-b1063cf137f4 tempest-VolumesActionsTest-852371490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.327s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:55 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-53226a5b-e3cf-4a0a-a4b8-b1063cf137f4 tempest-VolumesActionsTest-852371490 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:26:55 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-53226a5b-e3cf-4a0a-a4b8-b1063cf137f4 tempest-VolumesActionsTest-852371490 None] Deleted volume successfully. Sep 16 20:26:55 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-1815edff-e1e1-4f40-9b92-6a85b4e3d6c6 tempest-VolumesTransfersV355Test-1415783764 None] Acquiring lock "cinder-1203de21-3f18-4d6c-bf23-4ab971077c36-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:26:55 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-53226a5b-e3cf-4a0a-a4b8-b1063cf137f4 tempest-VolumesActionsTest-852371490 None] Lock "cinder-a0ccef0c-3957-47cc-93ae-5deb05bc0c0f-delete_volume" released by "delete_volume" :: held 1.385s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:26:55 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-1815edff-e1e1-4f40-9b92-6a85b4e3d6c6 tempest-VolumesTransfersV355Test-1415783764 None] Lock "cinder-1203de21-3f18-4d6c-bf23-4ab971077c36-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:26:55 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-1815edff-e1e1-4f40-9b92-6a85b4e3d6c6 tempest-VolumesTransfersV355Test-1415783764 None] Acquiring lock "cinder-quobyte-1203de21-3f18-4d6c-bf23-4ab971077c36" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:26:55 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-1815edff-e1e1-4f40-9b92-6a85b4e3d6c6 tempest-VolumesTransfersV355Test-1415783764 None] Lock "cinder-quobyte-1203de21-3f18-4d6c-bf23-4ab971077c36" acquired by "delete_volume" :: waited 0.024s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:26:55 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[13e2db14-171f-4b72-a110-33340e5caccf]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:26:55 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-1815edff-e1e1-4f40-9b92-6a85b4e3d6c6 tempest-VolumesTransfersV355Test-1415783764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-1203de21-3f18-4d6c-bf23-4ab971077c36 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:55 devstack sudo[97742]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:55 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-2d9445ae-3e56-4595-92ac-0b90ed5b112a tempest-CreateVolumesFromSnapshotTest-1034816622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-86fe5af1-92c6-45b0-81eb-04a5259b0964" returned: 0 in 0.628s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:55 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-2d9445ae-3e56-4595-92ac-0b90ed5b112a tempest-CreateVolumesFromSnapshotTest-1034816622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-86fe5af1-92c6-45b0-81eb-04a5259b0964.fa81d337-0581-4321-88b0-f7694a722a13 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:55 devstack sudo[97753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-86fe5af1-92c6-45b0-81eb-04a5259b0964.fa81d337-0581-4321-88b0-f7694a722a13 Sep 16 20:26:55 devstack sudo[97753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:55 devstack sudo[97752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-1203de21-3f18-4d6c-bf23-4ab971077c36 Sep 16 20:26:55 devstack sudo[97752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:56 devstack sudo[97753]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:56 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-2d9445ae-3e56-4595-92ac-0b90ed5b112a tempest-CreateVolumesFromSnapshotTest-1034816622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-86fe5af1-92c6-45b0-81eb-04a5259b0964.fa81d337-0581-4321-88b0-f7694a722a13" returned: 0 in 0.495s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:56 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-2d9445ae-3e56-4595-92ac-0b90ed5b112a tempest-CreateVolumesFromSnapshotTest-1034816622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-86fe5af1-92c6-45b0-81eb-04a5259b0964.fa81d337-0581-4321-88b0-f7694a722a13 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:56 devstack sudo[97752]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:56 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-1815edff-e1e1-4f40-9b92-6a85b4e3d6c6 tempest-VolumesTransfersV355Test-1415783764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-1203de21-3f18-4d6c-bf23-4ab971077c36" returned: 0 in 0.538s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:56 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-1815edff-e1e1-4f40-9b92-6a85b4e3d6c6 tempest-VolumesTransfersV355Test-1415783764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-1203de21-3f18-4d6c-bf23-4ab971077c36 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:56 devstack sudo[97763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-86fe5af1-92c6-45b0-81eb-04a5259b0964.fa81d337-0581-4321-88b0-f7694a722a13 Sep 16 20:26:56 devstack sudo[97763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:56 devstack sudo[97764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-1203de21-3f18-4d6c-bf23-4ab971077c36 Sep 16 20:26:56 devstack sudo[97764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:56 devstack sudo[97763]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:56 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-2d9445ae-3e56-4595-92ac-0b90ed5b112a tempest-CreateVolumesFromSnapshotTest-1034816622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-86fe5af1-92c6-45b0-81eb-04a5259b0964.fa81d337-0581-4321-88b0-f7694a722a13" returned: 0 in 0.320s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:56 devstack sudo[97764]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:56 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-1815edff-e1e1-4f40-9b92-6a85b4e3d6c6 tempest-VolumesTransfersV355Test-1415783764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-1203de21-3f18-4d6c-bf23-4ab971077c36" returned: 0 in 0.332s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:56 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-2d9445ae-3e56-4595-92ac-0b90ed5b112a tempest-CreateVolumesFromSnapshotTest-1034816622 None] Lock "cinder-quobyte-fa81d337-0581-4321-88b0-f7694a722a13" released by "_delete_snapshot" :: held 2.011s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:26:56 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-1815edff-e1e1-4f40-9b92-6a85b4e3d6c6 tempest-VolumesTransfersV355Test-1415783764 None] Lock "cinder-quobyte-1203de21-3f18-4d6c-bf23-4ab971077c36" released by "delete_volume" :: held 0.947s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:26:56 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-2d9445ae-3e56-4595-92ac-0b90ed5b112a tempest-CreateVolumesFromSnapshotTest-1034816622 None] Lock "cinder-quobyte-86fe5af1-92c6-45b0-81eb-04a5259b0964" released by "delete_snapshot" :: held 2.058s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:26:56 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-1815edff-e1e1-4f40-9b92-6a85b4e3d6c6 tempest-VolumesTransfersV355Test-1415783764 None] Created reservations ['727132f9-1f64-47ef-9de5-d979caf09cab', '0a039aff-47b3-461b-9101-637c402d3508', '5fc942d5-0130-494f-a144-009d8f6751e9', 'aaa98c88-7984-470a-a211-d741d5152016'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:26:56 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-2d9445ae-3e56-4595-92ac-0b90ed5b112a tempest-CreateVolumesFromSnapshotTest-1034816622 None] Created reservations ['71064b61-4801-4bd9-bfd1-c59333081ee9', '78e0018d-6bb2-4e43-a684-755bc1779369', 'be3ec9ea-7f9f-406b-871e-3da8ffd3b7e6', '57644c65-f895-4bf1-8708-c9e0b1b30593'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:26:56 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-1815edff-e1e1-4f40-9b92-6a85b4e3d6c6 tempest-VolumesTransfersV355Test-1415783764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:26:56 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-1815edff-e1e1-4f40-9b92-6a85b4e3d6c6 tempest-VolumesTransfersV355Test-1415783764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:26:56 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-1815edff-e1e1-4f40-9b92-6a85b4e3d6c6 tempest-VolumesTransfersV355Test-1415783764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:26:56 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-1815edff-e1e1-4f40-9b92-6a85b4e3d6c6 tempest-VolumesTransfersV355Test-1415783764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:26:56 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-1815edff-e1e1-4f40-9b92-6a85b4e3d6c6 tempest-VolumesTransfersV355Test-1415783764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:26:56 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-1815edff-e1e1-4f40-9b92-6a85b4e3d6c6 tempest-VolumesTransfersV355Test-1415783764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:56 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-2d9445ae-3e56-4595-92ac-0b90ed5b112a tempest-CreateVolumesFromSnapshotTest-1034816622 None] Delete snapshot completed successfully. Sep 16 20:26:56 devstack sudo[97769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:26:56 devstack sudo[97769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:56 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-2d9445ae-3e56-4595-92ac-0b90ed5b112a tempest-CreateVolumesFromSnapshotTest-1034816622 None] Lock "cinder-fa81d337-0581-4321-88b0-f7694a722a13-delete_snapshot" released by "delete_snapshot" :: held 2.304s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:26:56 devstack sudo[97769]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:56 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-1815edff-e1e1-4f40-9b92-6a85b4e3d6c6 tempest-VolumesTransfersV355Test-1415783764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.329s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:56 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-1815edff-e1e1-4f40-9b92-6a85b4e3d6c6 tempest-VolumesTransfersV355Test-1415783764 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:26:56 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-1815edff-e1e1-4f40-9b92-6a85b4e3d6c6 tempest-VolumesTransfersV355Test-1415783764 None] Deleted volume successfully. Sep 16 20:26:56 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-1815edff-e1e1-4f40-9b92-6a85b4e3d6c6 tempest-VolumesTransfersV355Test-1415783764 None] Lock "cinder-1203de21-3f18-4d6c-bf23-4ab971077c36-delete_volume" released by "delete_volume" :: held 1.597s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:26:57 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-a1163169-d62f-4513-b70c-dab70796aef0 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Acquiring lock "cinder-86fe5af1-92c6-45b0-81eb-04a5259b0964-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:26:57 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-a1163169-d62f-4513-b70c-dab70796aef0 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Lock "cinder-86fe5af1-92c6-45b0-81eb-04a5259b0964-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:26:57 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-a1163169-d62f-4513-b70c-dab70796aef0 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Acquiring lock "cinder-quobyte-86fe5af1-92c6-45b0-81eb-04a5259b0964" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:26:57 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-a1163169-d62f-4513-b70c-dab70796aef0 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Lock "cinder-quobyte-86fe5af1-92c6-45b0-81eb-04a5259b0964" acquired by "delete_volume" :: waited 0.023s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:26:57 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[79c08d22-0682-4db3-88b8-667790842cbd]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:26:57 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a1163169-d62f-4513-b70c-dab70796aef0 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-86fe5af1-92c6-45b0-81eb-04a5259b0964 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:57 devstack sudo[97773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-86fe5af1-92c6-45b0-81eb-04a5259b0964 Sep 16 20:26:57 devstack sudo[97773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:58 devstack sudo[97773]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:58 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a1163169-d62f-4513-b70c-dab70796aef0 tempest-CreateVolumesFromSnapshotTest-1034816622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-86fe5af1-92c6-45b0-81eb-04a5259b0964" returned: 0 in 0.519s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:58 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a1163169-d62f-4513-b70c-dab70796aef0 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-86fe5af1-92c6-45b0-81eb-04a5259b0964 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:58 devstack sudo[97778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-86fe5af1-92c6-45b0-81eb-04a5259b0964 Sep 16 20:26:58 devstack sudo[97778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:58 devstack sudo[97778]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:58 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a1163169-d62f-4513-b70c-dab70796aef0 tempest-CreateVolumesFromSnapshotTest-1034816622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-86fe5af1-92c6-45b0-81eb-04a5259b0964" returned: 0 in 0.267s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:58 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-a1163169-d62f-4513-b70c-dab70796aef0 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Lock "cinder-quobyte-86fe5af1-92c6-45b0-81eb-04a5259b0964" released by "delete_volume" :: held 0.865s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:26:58 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-a1163169-d62f-4513-b70c-dab70796aef0 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Created reservations ['543c6b3b-3a9c-4e53-b852-f2288c6c6c8a', 'ceb4d881-9bce-4869-832e-aecc84cd2b7e', 'c7c17630-1ebf-4716-9aa5-a5995a05a62a', 'c3c31cda-846c-4a26-af97-e3a422c9e052'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:26:58 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a1163169-d62f-4513-b70c-dab70796aef0 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:26:58 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a1163169-d62f-4513-b70c-dab70796aef0 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:26:58 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-a1163169-d62f-4513-b70c-dab70796aef0 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:26:58 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-a1163169-d62f-4513-b70c-dab70796aef0 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:26:58 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a1163169-d62f-4513-b70c-dab70796aef0 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:26:58 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a1163169-d62f-4513-b70c-dab70796aef0 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:26:58 devstack sudo[97781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:26:58 devstack sudo[97781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:26:59 devstack sudo[97781]: pam_unix(sudo:session): session closed for user root Sep 16 20:26:59 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a1163169-d62f-4513-b70c-dab70796aef0 tempest-CreateVolumesFromSnapshotTest-1034816622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.347s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:26:59 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-a1163169-d62f-4513-b70c-dab70796aef0 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:26:59 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-a1163169-d62f-4513-b70c-dab70796aef0 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Deleted volume successfully. Sep 16 20:26:59 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-a1163169-d62f-4513-b70c-dab70796aef0 tempest-CreateVolumesFromSnapshotTest-1034816622 None] Lock "cinder-86fe5af1-92c6-45b0-81eb-04a5259b0964-delete_volume" released by "delete_volume" :: held 1.479s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:27:04 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ab170c6-357c-42ce-a57e-674beaf22011 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:27:04 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-9ab170c6-357c-42ce-a57e-674beaf22011 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Flow 'volume_create_manager' (ae0c4125-ba35-4548-b96d-6882bd4c9601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:27:04 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-9ab170c6-357c-42ce-a57e-674beaf22011 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e00271c-b711-4945-ab89-f2d2959e119b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:04 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-9ab170c6-357c-42ce-a57e-674beaf22011 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e00271c-b711-4945-ab89-f2d2959e119b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:27:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1622576353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbc4ebb2-0859-41a8-8e67-995881a2cb35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f2eaa41dcc346978f512f69470baeee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:27:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:27:04Z,use_quota=True,user_id='9fa47e5ed67f41e5bd07f732ca09f2f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:04 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-9ab170c6-357c-42ce-a57e-674beaf22011 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d60e7364-75a0-4d36-a0c5-291a681849d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:04 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-9ab170c6-357c-42ce-a57e-674beaf22011 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d60e7364-75a0-4d36-a0c5-291a681849d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:04 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-9ab170c6-357c-42ce-a57e-674beaf22011 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13cd33b0-154a-48ca-8c71-85e09e4eb902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:04 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-9ab170c6-357c-42ce-a57e-674beaf22011 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13cd33b0-154a-48ca-8c71-85e09e4eb902) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fbc4ebb2-0859-41a8-8e67-995881a2cb35', 'volume_name': 'volume-fbc4ebb2-0859-41a8-8e67-995881a2cb35', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:04 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-9ab170c6-357c-42ce-a57e-674beaf22011 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82055150-9daf-4491-9588-bec54be29094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:04 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-9ab170c6-357c-42ce-a57e-674beaf22011 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82055150-9daf-4491-9588-bec54be29094) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:04 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-9ab170c6-357c-42ce-a57e-674beaf22011 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a6452df-76e4-4717-81ac-701ffef004cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:04 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-9ab170c6-357c-42ce-a57e-674beaf22011 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Volume fbc4ebb2-0859-41a8-8e67-995881a2cb35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fbc4ebb2-0859-41a8-8e67-995881a2cb35', 'volume_size': 1} Sep 16 20:27:04 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-9ab170c6-357c-42ce-a57e-674beaf22011 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:27:04 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-9ab170c6-357c-42ce-a57e-674beaf22011 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:27:04 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-9ab170c6-357c-42ce-a57e-674beaf22011 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:27:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1622576353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbc4ebb2-0859-41a8-8e67-995881a2cb35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f2eaa41dcc346978f512f69470baeee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:27:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:27:04Z,use_quota=True,user_id='9fa47e5ed67f41e5bd07f732ca09f2f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:27:04 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-9ab170c6-357c-42ce-a57e-674beaf22011 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Creating volume fbc4ebb2-0859-41a8-8e67-995881a2cb35 {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:27:04 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-9ab170c6-357c-42ce-a57e-674beaf22011 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:27:04 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-9ab170c6-357c-42ce-a57e-674beaf22011 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:27:04 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-9ab170c6-357c-42ce-a57e-674beaf22011 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:27:04 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-9ab170c6-357c-42ce-a57e-674beaf22011 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:27:04 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-9ab170c6-357c-42ce-a57e-674beaf22011 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:27:04 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-9ab170c6-357c-42ce-a57e-674beaf22011 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:27:04 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-9ab170c6-357c-42ce-a57e-674beaf22011 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:27:04 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-9ab170c6-357c-42ce-a57e-674beaf22011 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-fbc4ebb2-0859-41a8-8e67-995881a2cb35 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:04 devstack sudo[97787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-fbc4ebb2-0859-41a8-8e67-995881a2cb35 1073741824 Sep 16 20:27:04 devstack sudo[97787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:04 devstack sudo[97787]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:04 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-9ab170c6-357c-42ce-a57e-674beaf22011 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-fbc4ebb2-0859-41a8-8e67-995881a2cb35 1073741824" returned: 0 in 0.522s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:04 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-9ab170c6-357c-42ce-a57e-674beaf22011 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-fbc4ebb2-0859-41a8-8e67-995881a2cb35 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:04 devstack sudo[97800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-fbc4ebb2-0859-41a8-8e67-995881a2cb35 Sep 16 20:27:04 devstack sudo[97800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:05 devstack sudo[97800]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:05 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-9ab170c6-357c-42ce-a57e-674beaf22011 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-fbc4ebb2-0859-41a8-8e67-995881a2cb35" returned: 0 in 0.311s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:05 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-9ab170c6-357c-42ce-a57e-674beaf22011 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:27:05 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-9ab170c6-357c-42ce-a57e-674beaf22011 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:27:05 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-9ab170c6-357c-42ce-a57e-674beaf22011 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a6452df-76e4-4717-81ac-701ffef004cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fbc4ebb2-0859-41a8-8e67-995881a2cb35', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:05 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-9ab170c6-357c-42ce-a57e-674beaf22011 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (035d0627-d27c-48cd-b167-dc29af8935e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:05 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-9ab170c6-357c-42ce-a57e-674beaf22011 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Volume volume-fbc4ebb2-0859-41a8-8e67-995881a2cb35 (fbc4ebb2-0859-41a8-8e67-995881a2cb35): created successfully Sep 16 20:27:05 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-9ab170c6-357c-42ce-a57e-674beaf22011 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (035d0627-d27c-48cd-b167-dc29af8935e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:05 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-9ab170c6-357c-42ce-a57e-674beaf22011 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Flow 'volume_create_manager' (ae0c4125-ba35-4548-b96d-6882bd4c9601) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:27:05 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-9ab170c6-357c-42ce-a57e-674beaf22011 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Created volume successfully. Sep 16 20:27:06 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-0dca6983-396d-4d26-b6b2-468c813dd2f9 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:27:06 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-0dca6983-396d-4d26-b6b2-468c813dd2f9 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Flow 'volume_create_manager' (2d0f1f81-e533-472a-99d2-cfe3727f10e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:27:06 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-0dca6983-396d-4d26-b6b2-468c813dd2f9 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (979bba6e-f180-4ed4-a657-5b054478a59c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:07 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-0dca6983-396d-4d26-b6b2-468c813dd2f9 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (979bba6e-f180-4ed4-a657-5b054478a59c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:27:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-277816067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0c88952-3fc7-4c7e-a7f0-9608de9345a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f2eaa41dcc346978f512f69470baeee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:27:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:27:07Z,use_quota=True,user_id='9fa47e5ed67f41e5bd07f732ca09f2f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:07 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-0dca6983-396d-4d26-b6b2-468c813dd2f9 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6294297d-6489-4fef-ab0c-529f49acd9d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:07 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-0dca6983-396d-4d26-b6b2-468c813dd2f9 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6294297d-6489-4fef-ab0c-529f49acd9d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:07 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-0dca6983-396d-4d26-b6b2-468c813dd2f9 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38949f3d-1f57-4bbf-8fc3-de9c57702171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:07 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-0dca6983-396d-4d26-b6b2-468c813dd2f9 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38949f3d-1f57-4bbf-8fc3-de9c57702171) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0c88952-3fc7-4c7e-a7f0-9608de9345a3', 'volume_name': 'volume-d0c88952-3fc7-4c7e-a7f0-9608de9345a3', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:07 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-0dca6983-396d-4d26-b6b2-468c813dd2f9 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b972a06c-ddcc-4312-98aa-c389f2fa3e46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:07 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-0dca6983-396d-4d26-b6b2-468c813dd2f9 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b972a06c-ddcc-4312-98aa-c389f2fa3e46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:07 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-0dca6983-396d-4d26-b6b2-468c813dd2f9 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6e42cbb-d7a3-4965-a8a6-346d0acfc156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:07 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-0dca6983-396d-4d26-b6b2-468c813dd2f9 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Volume d0c88952-3fc7-4c7e-a7f0-9608de9345a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0c88952-3fc7-4c7e-a7f0-9608de9345a3', 'volume_size': 1} Sep 16 20:27:07 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-0dca6983-396d-4d26-b6b2-468c813dd2f9 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:27:07 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-0dca6983-396d-4d26-b6b2-468c813dd2f9 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:27:07 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-0dca6983-396d-4d26-b6b2-468c813dd2f9 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:27:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-277816067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0c88952-3fc7-4c7e-a7f0-9608de9345a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f2eaa41dcc346978f512f69470baeee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:27:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:27:07Z,use_quota=True,user_id='9fa47e5ed67f41e5bd07f732ca09f2f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:27:07 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-0dca6983-396d-4d26-b6b2-468c813dd2f9 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Creating volume d0c88952-3fc7-4c7e-a7f0-9608de9345a3 {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:27:07 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-0dca6983-396d-4d26-b6b2-468c813dd2f9 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:27:07 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-0dca6983-396d-4d26-b6b2-468c813dd2f9 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:27:07 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-0dca6983-396d-4d26-b6b2-468c813dd2f9 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:27:07 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-0dca6983-396d-4d26-b6b2-468c813dd2f9 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:27:07 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-0dca6983-396d-4d26-b6b2-468c813dd2f9 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:27:07 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-0dca6983-396d-4d26-b6b2-468c813dd2f9 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:27:07 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-0dca6983-396d-4d26-b6b2-468c813dd2f9 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:27:07 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-0dca6983-396d-4d26-b6b2-468c813dd2f9 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d0c88952-3fc7-4c7e-a7f0-9608de9345a3 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:07 devstack sudo[97806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d0c88952-3fc7-4c7e-a7f0-9608de9345a3 1073741824 Sep 16 20:27:07 devstack sudo[97806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:07 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-ede971d7-cb98-4a36-99a1-4062a2b1e3ab tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:27:07 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ede971d7-cb98-4a36-99a1-4062a2b1e3ab tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Flow 'volume_create_manager' (01880753-9945-4911-b061-2265bdf7f655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:27:07 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ede971d7-cb98-4a36-99a1-4062a2b1e3ab tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3efdedb-e38e-41f4-a26c-a6ce527cc1b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:07 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ede971d7-cb98-4a36-99a1-4062a2b1e3ab tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3efdedb-e38e-41f4-a26c-a6ce527cc1b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:27:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1280669246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d9d32a8-b42d-48f4-a0e9-db597ce4c77a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f2eaa41dcc346978f512f69470baeee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:27:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:27:07Z,use_quota=True,user_id='9fa47e5ed67f41e5bd07f732ca09f2f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:07 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ede971d7-cb98-4a36-99a1-4062a2b1e3ab tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b537cdf7-6d81-4835-ab27-59e7057c0678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:07 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ede971d7-cb98-4a36-99a1-4062a2b1e3ab tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b537cdf7-6d81-4835-ab27-59e7057c0678) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:07 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ede971d7-cb98-4a36-99a1-4062a2b1e3ab tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8d05d66-385a-4d10-92e7-2e5414c3b51e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:07 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ede971d7-cb98-4a36-99a1-4062a2b1e3ab tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8d05d66-385a-4d10-92e7-2e5414c3b51e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d9d32a8-b42d-48f4-a0e9-db597ce4c77a', 'volume_name': 'volume-5d9d32a8-b42d-48f4-a0e9-db597ce4c77a', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:07 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ede971d7-cb98-4a36-99a1-4062a2b1e3ab tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49315743-de9d-4e7b-b177-9fa651b04e91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:07 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ede971d7-cb98-4a36-99a1-4062a2b1e3ab tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49315743-de9d-4e7b-b177-9fa651b04e91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:07 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ede971d7-cb98-4a36-99a1-4062a2b1e3ab tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (912e586f-d011-46bb-bd61-6ad69f5d2b5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:07 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-ede971d7-cb98-4a36-99a1-4062a2b1e3ab tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Volume 5d9d32a8-b42d-48f4-a0e9-db597ce4c77a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d9d32a8-b42d-48f4-a0e9-db597ce4c77a', 'volume_size': 1} Sep 16 20:27:07 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-ede971d7-cb98-4a36-99a1-4062a2b1e3ab tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:27:07 devstack sudo[97806]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:07 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-0dca6983-396d-4d26-b6b2-468c813dd2f9 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d0c88952-3fc7-4c7e-a7f0-9608de9345a3 1073741824" returned: 0 in 0.710s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:07 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-0dca6983-396d-4d26-b6b2-468c813dd2f9 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d0c88952-3fc7-4c7e-a7f0-9608de9345a3 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:07 devstack sudo[97812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d0c88952-3fc7-4c7e-a7f0-9608de9345a3 Sep 16 20:27:07 devstack sudo[97812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:07 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-15f6b936-b6b2-4c38-8f98-de3d4b815260 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:27:07 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-15f6b936-b6b2-4c38-8f98-de3d4b815260 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Flow 'volume_create_manager' (7c60f2f2-911f-4191-b7b0-ddc88b3b615b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:27:07 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-15f6b936-b6b2-4c38-8f98-de3d4b815260 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8af83eaa-87b2-469c-b1b0-fc6c94f42cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:08 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-15f6b936-b6b2-4c38-8f98-de3d4b815260 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8af83eaa-87b2-469c-b1b0-fc6c94f42cfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:27:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-934387302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b625bad0-f6f9-4603-a255-27aac3890ffb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f2eaa41dcc346978f512f69470baeee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:27:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:27:08Z,use_quota=True,user_id='9fa47e5ed67f41e5bd07f732ca09f2f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:08 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-15f6b936-b6b2-4c38-8f98-de3d4b815260 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0bc7c44-9529-4c33-ae8f-34d6770fff1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:08 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-15f6b936-b6b2-4c38-8f98-de3d4b815260 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0bc7c44-9529-4c33-ae8f-34d6770fff1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:08 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-15f6b936-b6b2-4c38-8f98-de3d4b815260 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (191b050d-d632-44c8-9d04-49270a534a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:08 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-15f6b936-b6b2-4c38-8f98-de3d4b815260 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (191b050d-d632-44c8-9d04-49270a534a9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b625bad0-f6f9-4603-a255-27aac3890ffb', 'volume_name': 'volume-b625bad0-f6f9-4603-a255-27aac3890ffb', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:08 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-15f6b936-b6b2-4c38-8f98-de3d4b815260 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d816857a-84fe-499b-bed2-df4b0d87e159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:08 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-15f6b936-b6b2-4c38-8f98-de3d4b815260 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d816857a-84fe-499b-bed2-df4b0d87e159) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:08 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-15f6b936-b6b2-4c38-8f98-de3d4b815260 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (154c4096-23bd-4ee1-944d-9ef05386720c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:08 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-15f6b936-b6b2-4c38-8f98-de3d4b815260 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Volume b625bad0-f6f9-4603-a255-27aac3890ffb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b625bad0-f6f9-4603-a255-27aac3890ffb', 'volume_size': 1} Sep 16 20:27:08 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-15f6b936-b6b2-4c38-8f98-de3d4b815260 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:27:08 devstack sudo[97812]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:08 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-0dca6983-396d-4d26-b6b2-468c813dd2f9 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d0c88952-3fc7-4c7e-a7f0-9608de9345a3" returned: 0 in 0.488s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:08 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-0dca6983-396d-4d26-b6b2-468c813dd2f9 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] <== create_volume: return (1285ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:27:08 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-0dca6983-396d-4d26-b6b2-468c813dd2f9 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.292s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:27:08 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-ede971d7-cb98-4a36-99a1-4062a2b1e3ab tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.846s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:27:08 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-ede971d7-cb98-4a36-99a1-4062a2b1e3ab tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:27:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1280669246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d9d32a8-b42d-48f4-a0e9-db597ce4c77a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f2eaa41dcc346978f512f69470baeee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:27:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:27:07Z,use_quota=True,user_id='9fa47e5ed67f41e5bd07f732ca09f2f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:27:08 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-ede971d7-cb98-4a36-99a1-4062a2b1e3ab tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Creating volume 5d9d32a8-b42d-48f4-a0e9-db597ce4c77a {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:27:08 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-ede971d7-cb98-4a36-99a1-4062a2b1e3ab tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:27:08 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-ede971d7-cb98-4a36-99a1-4062a2b1e3ab tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:27:08 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-ede971d7-cb98-4a36-99a1-4062a2b1e3ab tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:27:08 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-ede971d7-cb98-4a36-99a1-4062a2b1e3ab tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:27:08 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-ede971d7-cb98-4a36-99a1-4062a2b1e3ab tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:27:08 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-ede971d7-cb98-4a36-99a1-4062a2b1e3ab tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:27:08 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-ede971d7-cb98-4a36-99a1-4062a2b1e3ab tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:27:08 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ede971d7-cb98-4a36-99a1-4062a2b1e3ab tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-5d9d32a8-b42d-48f4-a0e9-db597ce4c77a 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:08 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-0dca6983-396d-4d26-b6b2-468c813dd2f9 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6e42cbb-d7a3-4965-a8a6-346d0acfc156) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0c88952-3fc7-4c7e-a7f0-9608de9345a3', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:08 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-0dca6983-396d-4d26-b6b2-468c813dd2f9 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4542f65-0e07-4f00-a444-3b9f0578ec7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:08 devstack sudo[97817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-5d9d32a8-b42d-48f4-a0e9-db597ce4c77a 1073741824 Sep 16 20:27:08 devstack sudo[97817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:08 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-0dca6983-396d-4d26-b6b2-468c813dd2f9 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Volume volume-d0c88952-3fc7-4c7e-a7f0-9608de9345a3 (d0c88952-3fc7-4c7e-a7f0-9608de9345a3): created successfully Sep 16 20:27:08 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-0dca6983-396d-4d26-b6b2-468c813dd2f9 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4542f65-0e07-4f00-a444-3b9f0578ec7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:08 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-0dca6983-396d-4d26-b6b2-468c813dd2f9 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Flow 'volume_create_manager' (2d0f1f81-e533-472a-99d2-cfe3727f10e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:27:08 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-0dca6983-396d-4d26-b6b2-468c813dd2f9 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Created volume successfully. Sep 16 20:27:08 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-02dd3b49-4577-423f-9651-4c63e508a6da tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:27:08 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-02dd3b49-4577-423f-9651-4c63e508a6da tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Flow 'volume_create_manager' (51402d03-620d-4539-8ff4-7ec91e825094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:27:08 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-02dd3b49-4577-423f-9651-4c63e508a6da tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55b28dea-3d2a-49b9-a727-ff3ec834e70e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:08 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-02dd3b49-4577-423f-9651-4c63e508a6da tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55b28dea-3d2a-49b9-a727-ff3ec834e70e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:27:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-667379223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=035147c0-1ace-4d1f-bbd4-cf9c7161d671,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f2eaa41dcc346978f512f69470baeee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:27:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:27:08Z,use_quota=True,user_id='9fa47e5ed67f41e5bd07f732ca09f2f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:08 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-02dd3b49-4577-423f-9651-4c63e508a6da tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1610c628-e2f5-4ab4-a78a-f180f21e3f26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:08 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-02dd3b49-4577-423f-9651-4c63e508a6da tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1610c628-e2f5-4ab4-a78a-f180f21e3f26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:08 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-02dd3b49-4577-423f-9651-4c63e508a6da tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96180d13-a561-4140-bc04-f4a1ac8555be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:08 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-02dd3b49-4577-423f-9651-4c63e508a6da tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96180d13-a561-4140-bc04-f4a1ac8555be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '035147c0-1ace-4d1f-bbd4-cf9c7161d671', 'volume_name': 'volume-035147c0-1ace-4d1f-bbd4-cf9c7161d671', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:08 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-02dd3b49-4577-423f-9651-4c63e508a6da tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ce27655-0df3-43a4-870d-81c15ec9ef0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:08 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-02dd3b49-4577-423f-9651-4c63e508a6da tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ce27655-0df3-43a4-870d-81c15ec9ef0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:08 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-02dd3b49-4577-423f-9651-4c63e508a6da tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31402d3f-eb20-48bc-9a5e-d4e9f0e5c715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:08 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-02dd3b49-4577-423f-9651-4c63e508a6da tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Volume 035147c0-1ace-4d1f-bbd4-cf9c7161d671: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-035147c0-1ace-4d1f-bbd4-cf9c7161d671', 'volume_size': 1} Sep 16 20:27:08 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-02dd3b49-4577-423f-9651-4c63e508a6da tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:27:09 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9223869-3626-4f4e-8bd6-e85318fd7968 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:27:09 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-d9223869-3626-4f4e-8bd6-e85318fd7968 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Flow 'volume_create_manager' (d024259e-dca2-4a2b-91bb-6ce148975112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:27:09 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-d9223869-3626-4f4e-8bd6-e85318fd7968 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1080da80-7b14-4894-85f2-5f98ea459183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:09 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-d9223869-3626-4f4e-8bd6-e85318fd7968 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1080da80-7b14-4894-85f2-5f98ea459183) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:27:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1534795130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80ea14ed-d2d4-46d6-8d0c-9b82cc181b16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f2eaa41dcc346978f512f69470baeee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:27:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:27:09Z,use_quota=True,user_id='9fa47e5ed67f41e5bd07f732ca09f2f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:09 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-d9223869-3626-4f4e-8bd6-e85318fd7968 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ceb0d876-e5b6-45ef-8f76-eb0fee5847a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:09 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-d9223869-3626-4f4e-8bd6-e85318fd7968 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ceb0d876-e5b6-45ef-8f76-eb0fee5847a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:09 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-d9223869-3626-4f4e-8bd6-e85318fd7968 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ea66a45-d095-4b11-b228-2bbd79750bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:09 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-d9223869-3626-4f4e-8bd6-e85318fd7968 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ea66a45-d095-4b11-b228-2bbd79750bf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80ea14ed-d2d4-46d6-8d0c-9b82cc181b16', 'volume_name': 'volume-80ea14ed-d2d4-46d6-8d0c-9b82cc181b16', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:09 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-d9223869-3626-4f4e-8bd6-e85318fd7968 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3e6d3ca-125b-4edc-8736-76e3c891d282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:09 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-d9223869-3626-4f4e-8bd6-e85318fd7968 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3e6d3ca-125b-4edc-8736-76e3c891d282) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:09 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-d9223869-3626-4f4e-8bd6-e85318fd7968 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9c71488-97bc-4ef5-9ece-fc9a0c531a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:09 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-d9223869-3626-4f4e-8bd6-e85318fd7968 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Volume 80ea14ed-d2d4-46d6-8d0c-9b82cc181b16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80ea14ed-d2d4-46d6-8d0c-9b82cc181b16', 'volume_size': 1} Sep 16 20:27:09 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-d9223869-3626-4f4e-8bd6-e85318fd7968 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:27:09 devstack sudo[97817]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:09 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ede971d7-cb98-4a36-99a1-4062a2b1e3ab tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-5d9d32a8-b42d-48f4-a0e9-db597ce4c77a 1073741824" returned: 0 in 0.912s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:09 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ede971d7-cb98-4a36-99a1-4062a2b1e3ab tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-5d9d32a8-b42d-48f4-a0e9-db597ce4c77a {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:09 devstack sudo[97824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-5d9d32a8-b42d-48f4-a0e9-db597ce4c77a Sep 16 20:27:09 devstack sudo[97824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:09 devstack sudo[97824]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:09 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ede971d7-cb98-4a36-99a1-4062a2b1e3ab tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-5d9d32a8-b42d-48f4-a0e9-db597ce4c77a" returned: 0 in 0.305s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:09 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-ede971d7-cb98-4a36-99a1-4062a2b1e3ab tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] <== create_volume: return (1289ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:27:09 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-ede971d7-cb98-4a36-99a1-4062a2b1e3ab tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.299s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:27:09 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-15f6b936-b6b2-4c38-8f98-de3d4b815260 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.588s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:27:09 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-15f6b936-b6b2-4c38-8f98-de3d4b815260 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:27:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-934387302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b625bad0-f6f9-4603-a255-27aac3890ffb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f2eaa41dcc346978f512f69470baeee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:27:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:27:08Z,use_quota=True,user_id='9fa47e5ed67f41e5bd07f732ca09f2f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:27:09 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-15f6b936-b6b2-4c38-8f98-de3d4b815260 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Creating volume b625bad0-f6f9-4603-a255-27aac3890ffb {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:27:09 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-15f6b936-b6b2-4c38-8f98-de3d4b815260 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:27:09 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-15f6b936-b6b2-4c38-8f98-de3d4b815260 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:27:09 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-15f6b936-b6b2-4c38-8f98-de3d4b815260 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:27:09 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-15f6b936-b6b2-4c38-8f98-de3d4b815260 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:27:09 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-15f6b936-b6b2-4c38-8f98-de3d4b815260 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:27:09 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-15f6b936-b6b2-4c38-8f98-de3d4b815260 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:27:09 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-15f6b936-b6b2-4c38-8f98-de3d4b815260 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:27:09 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-15f6b936-b6b2-4c38-8f98-de3d4b815260 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b625bad0-f6f9-4603-a255-27aac3890ffb 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:09 devstack sudo[97827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b625bad0-f6f9-4603-a255-27aac3890ffb 1073741824 Sep 16 20:27:09 devstack sudo[97827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:09 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ede971d7-cb98-4a36-99a1-4062a2b1e3ab tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (912e586f-d011-46bb-bd61-6ad69f5d2b5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d9d32a8-b42d-48f4-a0e9-db597ce4c77a', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:09 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ede971d7-cb98-4a36-99a1-4062a2b1e3ab tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ac52853-4e37-4f63-9c0b-c69035767349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:09 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-ede971d7-cb98-4a36-99a1-4062a2b1e3ab tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Volume volume-5d9d32a8-b42d-48f4-a0e9-db597ce4c77a (5d9d32a8-b42d-48f4-a0e9-db597ce4c77a): created successfully Sep 16 20:27:09 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ede971d7-cb98-4a36-99a1-4062a2b1e3ab tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ac52853-4e37-4f63-9c0b-c69035767349) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:09 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ede971d7-cb98-4a36-99a1-4062a2b1e3ab tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Flow 'volume_create_manager' (01880753-9945-4911-b061-2265bdf7f655) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:27:09 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-b14f8ee4-3167-4621-bde9-87400325c03c tempest-VolumesTransfersV357Test-1371718851 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:27:09 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-b14f8ee4-3167-4621-bde9-87400325c03c tempest-VolumesTransfersV357Test-1371718851 None] Flow 'volume_create_manager' (dea7ebbe-8476-4225-9d80-22747967c55a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:27:09 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-b14f8ee4-3167-4621-bde9-87400325c03c tempest-VolumesTransfersV357Test-1371718851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (491023be-ad88-45a6-94e0-6b10df7a29b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:09 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-b14f8ee4-3167-4621-bde9-87400325c03c tempest-VolumesTransfersV357Test-1371718851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (491023be-ad88-45a6-94e0-6b10df7a29b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:27:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1158178877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09b46950-1107-4062-b631-35f563e19587,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1b0dbad006e4076baed8563fa0b83bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:27:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:27:10Z,use_quota=True,user_id='ce6e317a9e824476b97e0f70b1e711f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:09 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-b14f8ee4-3167-4621-bde9-87400325c03c tempest-VolumesTransfersV357Test-1371718851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe0c6002-e7f0-46ea-994c-b2779c276d92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:09 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-b14f8ee4-3167-4621-bde9-87400325c03c tempest-VolumesTransfersV357Test-1371718851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe0c6002-e7f0-46ea-994c-b2779c276d92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:09 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-b14f8ee4-3167-4621-bde9-87400325c03c tempest-VolumesTransfersV357Test-1371718851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff38835f-3f42-421b-b8cc-ca6a8910d1a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:09 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-b14f8ee4-3167-4621-bde9-87400325c03c tempest-VolumesTransfersV357Test-1371718851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff38835f-3f42-421b-b8cc-ca6a8910d1a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09b46950-1107-4062-b631-35f563e19587', 'volume_name': 'volume-09b46950-1107-4062-b631-35f563e19587', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:09 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-b14f8ee4-3167-4621-bde9-87400325c03c tempest-VolumesTransfersV357Test-1371718851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c2c23d8-6207-45d0-9be2-5a7145cef54d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:09 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-b14f8ee4-3167-4621-bde9-87400325c03c tempest-VolumesTransfersV357Test-1371718851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c2c23d8-6207-45d0-9be2-5a7145cef54d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:09 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-b14f8ee4-3167-4621-bde9-87400325c03c tempest-VolumesTransfersV357Test-1371718851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce547d1e-2efd-4445-ab28-7dadafa55ba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:09 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-b14f8ee4-3167-4621-bde9-87400325c03c tempest-VolumesTransfersV357Test-1371718851 None] Volume 09b46950-1107-4062-b631-35f563e19587: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09b46950-1107-4062-b631-35f563e19587', 'volume_size': 1} Sep 16 20:27:09 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-b14f8ee4-3167-4621-bde9-87400325c03c tempest-VolumesTransfersV357Test-1371718851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:27:09 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-ede971d7-cb98-4a36-99a1-4062a2b1e3ab tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Created volume successfully. Sep 16 20:27:10 devstack sudo[97827]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:10 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-15f6b936-b6b2-4c38-8f98-de3d4b815260 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b625bad0-f6f9-4603-a255-27aac3890ffb 1073741824" returned: 0 in 0.573s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:10 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-15f6b936-b6b2-4c38-8f98-de3d4b815260 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b625bad0-f6f9-4603-a255-27aac3890ffb {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:10 devstack sudo[97834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b625bad0-f6f9-4603-a255-27aac3890ffb Sep 16 20:27:10 devstack sudo[97834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:10 devstack sudo[97834]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:10 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-15f6b936-b6b2-4c38-8f98-de3d4b815260 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b625bad0-f6f9-4603-a255-27aac3890ffb" returned: 0 in 0.301s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:10 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-15f6b936-b6b2-4c38-8f98-de3d4b815260 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:27:10 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-15f6b936-b6b2-4c38-8f98-de3d4b815260 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.926s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:27:10 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-02dd3b49-4577-423f-9651-4c63e508a6da tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.841s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:27:10 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-02dd3b49-4577-423f-9651-4c63e508a6da tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:27:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-667379223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=035147c0-1ace-4d1f-bbd4-cf9c7161d671,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f2eaa41dcc346978f512f69470baeee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:27:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:27:08Z,use_quota=True,user_id='9fa47e5ed67f41e5bd07f732ca09f2f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:27:10 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-02dd3b49-4577-423f-9651-4c63e508a6da tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Creating volume 035147c0-1ace-4d1f-bbd4-cf9c7161d671 {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:27:10 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-02dd3b49-4577-423f-9651-4c63e508a6da tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:27:10 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-02dd3b49-4577-423f-9651-4c63e508a6da tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:27:10 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-02dd3b49-4577-423f-9651-4c63e508a6da tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:27:10 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-02dd3b49-4577-423f-9651-4c63e508a6da tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:27:10 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-02dd3b49-4577-423f-9651-4c63e508a6da tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:27:10 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-02dd3b49-4577-423f-9651-4c63e508a6da tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:27:10 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-02dd3b49-4577-423f-9651-4c63e508a6da tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:27:10 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-02dd3b49-4577-423f-9651-4c63e508a6da tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-035147c0-1ace-4d1f-bbd4-cf9c7161d671 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:10 devstack sudo[97837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-035147c0-1ace-4d1f-bbd4-cf9c7161d671 1073741824 Sep 16 20:27:10 devstack sudo[97837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:10 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-15f6b936-b6b2-4c38-8f98-de3d4b815260 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (154c4096-23bd-4ee1-944d-9ef05386720c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b625bad0-f6f9-4603-a255-27aac3890ffb', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:10 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-15f6b936-b6b2-4c38-8f98-de3d4b815260 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a3d5811-d6e2-4c0c-a156-14d912be20ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:10 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-15f6b936-b6b2-4c38-8f98-de3d4b815260 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Volume volume-b625bad0-f6f9-4603-a255-27aac3890ffb (b625bad0-f6f9-4603-a255-27aac3890ffb): created successfully Sep 16 20:27:10 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-15f6b936-b6b2-4c38-8f98-de3d4b815260 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a3d5811-d6e2-4c0c-a156-14d912be20ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:10 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-15f6b936-b6b2-4c38-8f98-de3d4b815260 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Flow 'volume_create_manager' (7c60f2f2-911f-4191-b7b0-ddc88b3b615b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:27:10 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-15f6b936-b6b2-4c38-8f98-de3d4b815260 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Created volume successfully. Sep 16 20:27:11 devstack sudo[97837]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:11 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-02dd3b49-4577-423f-9651-4c63e508a6da tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-035147c0-1ace-4d1f-bbd4-cf9c7161d671 1073741824" returned: 0 in 0.508s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:11 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-02dd3b49-4577-423f-9651-4c63e508a6da tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-035147c0-1ace-4d1f-bbd4-cf9c7161d671 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:11 devstack sudo[97844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-035147c0-1ace-4d1f-bbd4-cf9c7161d671 Sep 16 20:27:11 devstack sudo[97844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:11 devstack sudo[97844]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:11 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-02dd3b49-4577-423f-9651-4c63e508a6da tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-035147c0-1ace-4d1f-bbd4-cf9c7161d671" returned: 0 in 0.273s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:11 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-02dd3b49-4577-423f-9651-4c63e508a6da tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] <== create_volume: return (828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:27:11 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-02dd3b49-4577-423f-9651-4c63e508a6da tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.832s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:27:11 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-d9223869-3626-4f4e-8bd6-e85318fd7968 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.202s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:27:11 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-d9223869-3626-4f4e-8bd6-e85318fd7968 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:27:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1534795130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80ea14ed-d2d4-46d6-8d0c-9b82cc181b16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f2eaa41dcc346978f512f69470baeee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:27:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:27:09Z,use_quota=True,user_id='9fa47e5ed67f41e5bd07f732ca09f2f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:27:11 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-d9223869-3626-4f4e-8bd6-e85318fd7968 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Creating volume 80ea14ed-d2d4-46d6-8d0c-9b82cc181b16 {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:27:11 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-d9223869-3626-4f4e-8bd6-e85318fd7968 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:27:11 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-d9223869-3626-4f4e-8bd6-e85318fd7968 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:27:11 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-d9223869-3626-4f4e-8bd6-e85318fd7968 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:27:11 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-d9223869-3626-4f4e-8bd6-e85318fd7968 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:27:11 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-d9223869-3626-4f4e-8bd6-e85318fd7968 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:27:11 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-d9223869-3626-4f4e-8bd6-e85318fd7968 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:27:11 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-d9223869-3626-4f4e-8bd6-e85318fd7968 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:27:11 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-d9223869-3626-4f4e-8bd6-e85318fd7968 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-80ea14ed-d2d4-46d6-8d0c-9b82cc181b16 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:11 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-02dd3b49-4577-423f-9651-4c63e508a6da tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31402d3f-eb20-48bc-9a5e-d4e9f0e5c715) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-035147c0-1ace-4d1f-bbd4-cf9c7161d671', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:11 devstack sudo[97847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-80ea14ed-d2d4-46d6-8d0c-9b82cc181b16 1073741824 Sep 16 20:27:11 devstack sudo[97847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:11 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-02dd3b49-4577-423f-9651-4c63e508a6da tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (234369ec-f009-47a3-be75-82f645bca73c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:11 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-02dd3b49-4577-423f-9651-4c63e508a6da tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Volume volume-035147c0-1ace-4d1f-bbd4-cf9c7161d671 (035147c0-1ace-4d1f-bbd4-cf9c7161d671): created successfully Sep 16 20:27:11 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-02dd3b49-4577-423f-9651-4c63e508a6da tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (234369ec-f009-47a3-be75-82f645bca73c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:11 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-02dd3b49-4577-423f-9651-4c63e508a6da tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Flow 'volume_create_manager' (51402d03-620d-4539-8ff4-7ec91e825094) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:27:11 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-02dd3b49-4577-423f-9651-4c63e508a6da tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Created volume successfully. Sep 16 20:27:11 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc1d20e9-b03f-499b-9f54-2f6294f13730 tempest-VolumesListAdminTestJSON-323842265 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:27:11 devstack sudo[97847]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:12 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-dc1d20e9-b03f-499b-9f54-2f6294f13730 tempest-VolumesListAdminTestJSON-323842265 None] Flow 'volume_create_manager' (a1a49aa1-fcb5-4417-8a82-279049260e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:27:12 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-dc1d20e9-b03f-499b-9f54-2f6294f13730 tempest-VolumesListAdminTestJSON-323842265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63e77463-291e-42d5-a546-107025b71eb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:12 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-d9223869-3626-4f4e-8bd6-e85318fd7968 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-80ea14ed-d2d4-46d6-8d0c-9b82cc181b16 1073741824" returned: 0 in 0.567s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:12 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-dc1d20e9-b03f-499b-9f54-2f6294f13730 tempest-VolumesListAdminTestJSON-323842265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63e77463-291e-42d5-a546-107025b71eb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:27:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1702936327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f8bbd1a-06dc-45cc-882a-8f967a95c38c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ff5a009eb004b84a96d26f2acab6b03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:27:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:27:12Z,use_quota=True,user_id='fc3f90db027849be8b99dfa3f9d80edf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:12 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-dc1d20e9-b03f-499b-9f54-2f6294f13730 tempest-VolumesListAdminTestJSON-323842265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26eee388-40e6-478b-b6b4-e043d729d62c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:12 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-dc1d20e9-b03f-499b-9f54-2f6294f13730 tempest-VolumesListAdminTestJSON-323842265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26eee388-40e6-478b-b6b4-e043d729d62c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:12 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-dc1d20e9-b03f-499b-9f54-2f6294f13730 tempest-VolumesListAdminTestJSON-323842265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (515701d6-3000-45d4-8418-55534cf4ef9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:12 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-dc1d20e9-b03f-499b-9f54-2f6294f13730 tempest-VolumesListAdminTestJSON-323842265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (515701d6-3000-45d4-8418-55534cf4ef9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f8bbd1a-06dc-45cc-882a-8f967a95c38c', 'volume_name': 'volume-9f8bbd1a-06dc-45cc-882a-8f967a95c38c', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:12 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-dc1d20e9-b03f-499b-9f54-2f6294f13730 tempest-VolumesListAdminTestJSON-323842265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e09c537c-5e60-4ed4-a562-aefc43523df3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:12 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-dc1d20e9-b03f-499b-9f54-2f6294f13730 tempest-VolumesListAdminTestJSON-323842265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e09c537c-5e60-4ed4-a562-aefc43523df3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:12 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-dc1d20e9-b03f-499b-9f54-2f6294f13730 tempest-VolumesListAdminTestJSON-323842265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1f6a2e7-a05f-4d05-9b5d-aca64bbb5446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:12 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-dc1d20e9-b03f-499b-9f54-2f6294f13730 tempest-VolumesListAdminTestJSON-323842265 None] Volume 9f8bbd1a-06dc-45cc-882a-8f967a95c38c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f8bbd1a-06dc-45cc-882a-8f967a95c38c', 'volume_size': 1} Sep 16 20:27:12 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-dc1d20e9-b03f-499b-9f54-2f6294f13730 tempest-VolumesListAdminTestJSON-323842265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:27:12 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-d9223869-3626-4f4e-8bd6-e85318fd7968 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-80ea14ed-d2d4-46d6-8d0c-9b82cc181b16 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:12 devstack sudo[97853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-80ea14ed-d2d4-46d6-8d0c-9b82cc181b16 Sep 16 20:27:12 devstack sudo[97853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:12 devstack sudo[97853]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:12 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-d9223869-3626-4f4e-8bd6-e85318fd7968 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-80ea14ed-d2d4-46d6-8d0c-9b82cc181b16" returned: 0 in 0.257s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:12 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-d9223869-3626-4f4e-8bd6-e85318fd7968 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] <== create_volume: return (912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:27:12 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-d9223869-3626-4f4e-8bd6-e85318fd7968 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:27:12 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-b14f8ee4-3167-4621-bde9-87400325c03c tempest-VolumesTransfersV357Test-1371718851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.490s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:27:12 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-b14f8ee4-3167-4621-bde9-87400325c03c tempest-VolumesTransfersV357Test-1371718851 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:27:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1158178877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09b46950-1107-4062-b631-35f563e19587,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1b0dbad006e4076baed8563fa0b83bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:27:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:27:10Z,use_quota=True,user_id='ce6e317a9e824476b97e0f70b1e711f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:27:12 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-b14f8ee4-3167-4621-bde9-87400325c03c tempest-VolumesTransfersV357Test-1371718851 None] Creating volume 09b46950-1107-4062-b631-35f563e19587 {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:27:12 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-b14f8ee4-3167-4621-bde9-87400325c03c tempest-VolumesTransfersV357Test-1371718851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:27:12 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-b14f8ee4-3167-4621-bde9-87400325c03c tempest-VolumesTransfersV357Test-1371718851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:27:12 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-b14f8ee4-3167-4621-bde9-87400325c03c tempest-VolumesTransfersV357Test-1371718851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:27:12 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-b14f8ee4-3167-4621-bde9-87400325c03c tempest-VolumesTransfersV357Test-1371718851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:27:12 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-b14f8ee4-3167-4621-bde9-87400325c03c tempest-VolumesTransfersV357Test-1371718851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:27:12 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-b14f8ee4-3167-4621-bde9-87400325c03c tempest-VolumesTransfersV357Test-1371718851 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:27:12 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-b14f8ee4-3167-4621-bde9-87400325c03c tempest-VolumesTransfersV357Test-1371718851 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:27:12 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b14f8ee4-3167-4621-bde9-87400325c03c tempest-VolumesTransfersV357Test-1371718851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-09b46950-1107-4062-b631-35f563e19587 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:12 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-d9223869-3626-4f4e-8bd6-e85318fd7968 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9c71488-97bc-4ef5-9ece-fc9a0c531a44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80ea14ed-d2d4-46d6-8d0c-9b82cc181b16', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:12 devstack sudo[97856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-09b46950-1107-4062-b631-35f563e19587 1073741824 Sep 16 20:27:12 devstack sudo[97856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:12 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-d9223869-3626-4f4e-8bd6-e85318fd7968 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89af3f9c-75da-4e6c-abda-f7afba231df8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:12 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-d9223869-3626-4f4e-8bd6-e85318fd7968 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Volume volume-80ea14ed-d2d4-46d6-8d0c-9b82cc181b16 (80ea14ed-d2d4-46d6-8d0c-9b82cc181b16): created successfully Sep 16 20:27:12 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-d9223869-3626-4f4e-8bd6-e85318fd7968 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89af3f9c-75da-4e6c-abda-f7afba231df8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:12 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-d9223869-3626-4f4e-8bd6-e85318fd7968 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Flow 'volume_create_manager' (d024259e-dca2-4a2b-91bb-6ce148975112) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:27:12 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-d9223869-3626-4f4e-8bd6-e85318fd7968 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Created volume successfully. Sep 16 20:27:12 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-c928eff7-29e2-4b17-a5e9-dae18c4c530c tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Acquiring lock "cinder-80ea14ed-d2d4-46d6-8d0c-9b82cc181b16-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:27:12 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-c928eff7-29e2-4b17-a5e9-dae18c4c530c tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Lock "cinder-80ea14ed-d2d4-46d6-8d0c-9b82cc181b16-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:27:12 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-c928eff7-29e2-4b17-a5e9-dae18c4c530c tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Acquiring lock "cinder-quobyte-80ea14ed-d2d4-46d6-8d0c-9b82cc181b16" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:27:12 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-c928eff7-29e2-4b17-a5e9-dae18c4c530c tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Lock "cinder-quobyte-80ea14ed-d2d4-46d6-8d0c-9b82cc181b16" acquired by "delete_volume" :: waited 0.018s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:27:12 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a0e1454-6306-4894-adbe-33d350a0b38d]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:27:12 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-c928eff7-29e2-4b17-a5e9-dae18c4c530c tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-80ea14ed-d2d4-46d6-8d0c-9b82cc181b16 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:12 devstack sudo[97861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-80ea14ed-d2d4-46d6-8d0c-9b82cc181b16 Sep 16 20:27:12 devstack sudo[97861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:12 devstack sudo[97856]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:12 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b14f8ee4-3167-4621-bde9-87400325c03c tempest-VolumesTransfersV357Test-1371718851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-09b46950-1107-4062-b631-35f563e19587 1073741824" returned: 0 in 0.558s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:12 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b14f8ee4-3167-4621-bde9-87400325c03c tempest-VolumesTransfersV357Test-1371718851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-09b46950-1107-4062-b631-35f563e19587 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:13 devstack sudo[97865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-09b46950-1107-4062-b631-35f563e19587 Sep 16 20:27:13 devstack sudo[97865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:13 devstack sudo[97861]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:13 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-c928eff7-29e2-4b17-a5e9-dae18c4c530c tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-80ea14ed-d2d4-46d6-8d0c-9b82cc181b16" returned: 0 in 0.423s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:13 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-c928eff7-29e2-4b17-a5e9-dae18c4c530c tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-80ea14ed-d2d4-46d6-8d0c-9b82cc181b16 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:13 devstack sudo[97871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-80ea14ed-d2d4-46d6-8d0c-9b82cc181b16 Sep 16 20:27:13 devstack sudo[97871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:13 devstack sudo[97865]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:13 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b14f8ee4-3167-4621-bde9-87400325c03c tempest-VolumesTransfersV357Test-1371718851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-09b46950-1107-4062-b631-35f563e19587" returned: 0 in 0.266s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:13 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-b14f8ee4-3167-4621-bde9-87400325c03c tempest-VolumesTransfersV357Test-1371718851 None] <== create_volume: return (879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:27:13 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-b14f8ee4-3167-4621-bde9-87400325c03c tempest-VolumesTransfersV357Test-1371718851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.881s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:27:13 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-dc1d20e9-b03f-499b-9f54-2f6294f13730 tempest-VolumesListAdminTestJSON-323842265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.175s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:27:13 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-dc1d20e9-b03f-499b-9f54-2f6294f13730 tempest-VolumesListAdminTestJSON-323842265 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:27:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1702936327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f8bbd1a-06dc-45cc-882a-8f967a95c38c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ff5a009eb004b84a96d26f2acab6b03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:27:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:27:12Z,use_quota=True,user_id='fc3f90db027849be8b99dfa3f9d80edf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:27:13 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-dc1d20e9-b03f-499b-9f54-2f6294f13730 tempest-VolumesListAdminTestJSON-323842265 None] Creating volume 9f8bbd1a-06dc-45cc-882a-8f967a95c38c {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:27:13 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-dc1d20e9-b03f-499b-9f54-2f6294f13730 tempest-VolumesListAdminTestJSON-323842265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:27:13 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-dc1d20e9-b03f-499b-9f54-2f6294f13730 tempest-VolumesListAdminTestJSON-323842265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:27:13 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-dc1d20e9-b03f-499b-9f54-2f6294f13730 tempest-VolumesListAdminTestJSON-323842265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:27:13 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-dc1d20e9-b03f-499b-9f54-2f6294f13730 tempest-VolumesListAdminTestJSON-323842265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:27:13 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-dc1d20e9-b03f-499b-9f54-2f6294f13730 tempest-VolumesListAdminTestJSON-323842265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:27:13 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-dc1d20e9-b03f-499b-9f54-2f6294f13730 tempest-VolumesListAdminTestJSON-323842265 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:27:13 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-dc1d20e9-b03f-499b-9f54-2f6294f13730 tempest-VolumesListAdminTestJSON-323842265 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:27:13 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-dc1d20e9-b03f-499b-9f54-2f6294f13730 tempest-VolumesListAdminTestJSON-323842265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9f8bbd1a-06dc-45cc-882a-8f967a95c38c 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:13 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-b14f8ee4-3167-4621-bde9-87400325c03c tempest-VolumesTransfersV357Test-1371718851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce547d1e-2efd-4445-ab28-7dadafa55ba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09b46950-1107-4062-b631-35f563e19587', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:13 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-b14f8ee4-3167-4621-bde9-87400325c03c tempest-VolumesTransfersV357Test-1371718851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d0bc51f-3f95-4efa-95e6-c1a448fd6811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:13 devstack sudo[97874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9f8bbd1a-06dc-45cc-882a-8f967a95c38c 1073741824 Sep 16 20:27:13 devstack sudo[97874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:13 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-b14f8ee4-3167-4621-bde9-87400325c03c tempest-VolumesTransfersV357Test-1371718851 None] Volume volume-09b46950-1107-4062-b631-35f563e19587 (09b46950-1107-4062-b631-35f563e19587): created successfully Sep 16 20:27:13 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-b14f8ee4-3167-4621-bde9-87400325c03c tempest-VolumesTransfersV357Test-1371718851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d0bc51f-3f95-4efa-95e6-c1a448fd6811) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:13 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-b14f8ee4-3167-4621-bde9-87400325c03c tempest-VolumesTransfersV357Test-1371718851 None] Flow 'volume_create_manager' (dea7ebbe-8476-4225-9d80-22747967c55a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:27:13 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-b14f8ee4-3167-4621-bde9-87400325c03c tempest-VolumesTransfersV357Test-1371718851 None] Created volume successfully. Sep 16 20:27:13 devstack sudo[97871]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:13 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-c928eff7-29e2-4b17-a5e9-dae18c4c530c tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-80ea14ed-d2d4-46d6-8d0c-9b82cc181b16" returned: 0 in 0.302s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:13 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-c928eff7-29e2-4b17-a5e9-dae18c4c530c tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Lock "cinder-quobyte-80ea14ed-d2d4-46d6-8d0c-9b82cc181b16" released by "delete_volume" :: held 0.778s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:27:13 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-c928eff7-29e2-4b17-a5e9-dae18c4c530c tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Created reservations ['b382b3b2-c23a-45b7-b271-2a6c8ddc27fd', '2e9c9f7d-6496-436c-bf77-3621238b8d32', '2dba06d6-87aa-4f40-9ce7-b8bb3b1b2400', '7f72ad62-9bb6-469c-b41b-42b1f0452539'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:27:13 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-c928eff7-29e2-4b17-a5e9-dae18c4c530c tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:27:13 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-c928eff7-29e2-4b17-a5e9-dae18c4c530c tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:27:13 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-c928eff7-29e2-4b17-a5e9-dae18c4c530c tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:27:13 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-c928eff7-29e2-4b17-a5e9-dae18c4c530c tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:27:13 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-c928eff7-29e2-4b17-a5e9-dae18c4c530c tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:27:13 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-c928eff7-29e2-4b17-a5e9-dae18c4c530c tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:13 devstack sudo[97880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:27:13 devstack sudo[97880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:13 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-c46e92ac-9c09-452d-a722-892fd4551679 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Acquiring lock "cinder-035147c0-1ace-4d1f-bbd4-cf9c7161d671-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:27:13 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-c46e92ac-9c09-452d-a722-892fd4551679 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Lock "cinder-035147c0-1ace-4d1f-bbd4-cf9c7161d671-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:27:13 devstack sudo[97874]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:13 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-dc1d20e9-b03f-499b-9f54-2f6294f13730 tempest-VolumesListAdminTestJSON-323842265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9f8bbd1a-06dc-45cc-882a-8f967a95c38c 1073741824" returned: 0 in 0.619s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:13 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-c46e92ac-9c09-452d-a722-892fd4551679 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Acquiring lock "cinder-quobyte-035147c0-1ace-4d1f-bbd4-cf9c7161d671" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:27:13 devstack sudo[97880]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:13 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-c46e92ac-9c09-452d-a722-892fd4551679 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Lock "cinder-quobyte-035147c0-1ace-4d1f-bbd4-cf9c7161d671" acquired by "delete_volume" :: waited 0.020s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:27:13 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-c928eff7-29e2-4b17-a5e9-dae18c4c530c tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.359s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:13 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-c928eff7-29e2-4b17-a5e9-dae18c4c530c tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:27:13 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-dc1d20e9-b03f-499b-9f54-2f6294f13730 tempest-VolumesListAdminTestJSON-323842265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9f8bbd1a-06dc-45cc-882a-8f967a95c38c {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:13 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbc739f0-9c98-4ca4-8182-e74ab4902f3f]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:27:13 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-c46e92ac-9c09-452d-a722-892fd4551679 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-035147c0-1ace-4d1f-bbd4-cf9c7161d671 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:14 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-c928eff7-29e2-4b17-a5e9-dae18c4c530c tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Deleted volume successfully. Sep 16 20:27:14 devstack sudo[97884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9f8bbd1a-06dc-45cc-882a-8f967a95c38c Sep 16 20:27:14 devstack sudo[97884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:14 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-c928eff7-29e2-4b17-a5e9-dae18c4c530c tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Lock "cinder-80ea14ed-d2d4-46d6-8d0c-9b82cc181b16-delete_volume" released by "delete_volume" :: held 1.426s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:27:14 devstack sudo[97885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-035147c0-1ace-4d1f-bbd4-cf9c7161d671 Sep 16 20:27:14 devstack sudo[97885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:14 devstack sudo[97884]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:14 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-dc1d20e9-b03f-499b-9f54-2f6294f13730 tempest-VolumesListAdminTestJSON-323842265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9f8bbd1a-06dc-45cc-882a-8f967a95c38c" returned: 0 in 0.315s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:14 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-dc1d20e9-b03f-499b-9f54-2f6294f13730 tempest-VolumesListAdminTestJSON-323842265 None] <== create_volume: return (1028ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:27:14 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-dc1d20e9-b03f-499b-9f54-2f6294f13730 tempest-VolumesListAdminTestJSON-323842265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.031s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:27:14 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-dc1d20e9-b03f-499b-9f54-2f6294f13730 tempest-VolumesListAdminTestJSON-323842265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1f6a2e7-a05f-4d05-9b5d-aca64bbb5446) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f8bbd1a-06dc-45cc-882a-8f967a95c38c', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:14 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-dc1d20e9-b03f-499b-9f54-2f6294f13730 tempest-VolumesListAdminTestJSON-323842265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ac749fc-ba25-45ad-888b-bae41643a7ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:14 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-dc1d20e9-b03f-499b-9f54-2f6294f13730 tempest-VolumesListAdminTestJSON-323842265 None] Volume volume-9f8bbd1a-06dc-45cc-882a-8f967a95c38c (9f8bbd1a-06dc-45cc-882a-8f967a95c38c): created successfully Sep 16 20:27:14 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-dc1d20e9-b03f-499b-9f54-2f6294f13730 tempest-VolumesListAdminTestJSON-323842265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ac749fc-ba25-45ad-888b-bae41643a7ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:14 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-dc1d20e9-b03f-499b-9f54-2f6294f13730 tempest-VolumesListAdminTestJSON-323842265 None] Flow 'volume_create_manager' (a1a49aa1-fcb5-4417-8a82-279049260e06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:27:14 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-dc1d20e9-b03f-499b-9f54-2f6294f13730 tempest-VolumesListAdminTestJSON-323842265 None] Created volume successfully. Sep 16 20:27:14 devstack sudo[97885]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:14 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-c46e92ac-9c09-452d-a722-892fd4551679 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-035147c0-1ace-4d1f-bbd4-cf9c7161d671" returned: 0 in 0.452s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:14 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-c46e92ac-9c09-452d-a722-892fd4551679 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-035147c0-1ace-4d1f-bbd4-cf9c7161d671 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:14 devstack sudo[97892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-035147c0-1ace-4d1f-bbd4-cf9c7161d671 Sep 16 20:27:14 devstack sudo[97892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:14 devstack sudo[97892]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:14 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-c46e92ac-9c09-452d-a722-892fd4551679 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-035147c0-1ace-4d1f-bbd4-cf9c7161d671" returned: 0 in 0.276s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:14 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-c46e92ac-9c09-452d-a722-892fd4551679 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Lock "cinder-quobyte-035147c0-1ace-4d1f-bbd4-cf9c7161d671" released by "delete_volume" :: held 0.803s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:27:14 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-c46e92ac-9c09-452d-a722-892fd4551679 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Created reservations ['2645d9d2-d0c9-4867-8eb5-6b7052002231', '3447273d-18b2-49a5-b3fc-6e1e0208b80d', 'f1202c9a-f57e-4721-aacb-ec3cff12af39', 'aae4e2de-4745-493f-b9ce-d046aaffab3d'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:27:14 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-c46e92ac-9c09-452d-a722-892fd4551679 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:27:14 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-c46e92ac-9c09-452d-a722-892fd4551679 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:27:14 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-c46e92ac-9c09-452d-a722-892fd4551679 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:27:14 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-c46e92ac-9c09-452d-a722-892fd4551679 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:27:14 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-c46e92ac-9c09-452d-a722-892fd4551679 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:27:14 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-c46e92ac-9c09-452d-a722-892fd4551679 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:14 devstack sudo[97895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:27:14 devstack sudo[97895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:15 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-84866844-74b8-4088-b6cc-008717531077 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Acquiring lock "cinder-b625bad0-f6f9-4603-a255-27aac3890ffb-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:27:15 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-84866844-74b8-4088-b6cc-008717531077 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Lock "cinder-b625bad0-f6f9-4603-a255-27aac3890ffb-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:27:15 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-84866844-74b8-4088-b6cc-008717531077 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Acquiring lock "cinder-quobyte-b625bad0-f6f9-4603-a255-27aac3890ffb" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:27:15 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-5601ac10-3bcd-42fd-a7eb-4926f01af018 tempest-VolumesTransfersV357Test-253382226 None] Transfer volume completed successfully. Sep 16 20:27:15 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-84866844-74b8-4088-b6cc-008717531077 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Lock "cinder-quobyte-b625bad0-f6f9-4603-a255-27aac3890ffb" acquired by "delete_volume" :: waited 0.040s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:27:15 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[82959bd7-d7c8-4933-a764-63a98ee9860c]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:27:15 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-84866844-74b8-4088-b6cc-008717531077 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b625bad0-f6f9-4603-a255-27aac3890ffb {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:15 devstack sudo[97895]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:15 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-c46e92ac-9c09-452d-a722-892fd4551679 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.377s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:15 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-c46e92ac-9c09-452d-a722-892fd4551679 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:27:15 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-c46e92ac-9c09-452d-a722-892fd4551679 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Deleted volume successfully. Sep 16 20:27:15 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-c46e92ac-9c09-452d-a722-892fd4551679 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Lock "cinder-035147c0-1ace-4d1f-bbd4-cf9c7161d671-delete_volume" released by "delete_volume" :: held 1.468s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:27:15 devstack sudo[97898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b625bad0-f6f9-4603-a255-27aac3890ffb Sep 16 20:27:15 devstack sudo[97898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:15 devstack sudo[97898]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:15 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-84866844-74b8-4088-b6cc-008717531077 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b625bad0-f6f9-4603-a255-27aac3890ffb" returned: 0 in 0.466s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:15 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-84866844-74b8-4088-b6cc-008717531077 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b625bad0-f6f9-4603-a255-27aac3890ffb {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:15 devstack sudo[97903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b625bad0-f6f9-4603-a255-27aac3890ffb Sep 16 20:27:15 devstack sudo[97903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:15 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-29562bd6-68ad-4f98-9ab5-69a262731c61 tempest-VolumesListAdminTestJSON-323842265 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:27:15 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-29562bd6-68ad-4f98-9ab5-69a262731c61 tempest-VolumesListAdminTestJSON-323842265 None] Flow 'volume_create_manager' (bfbd7d89-439a-4390-bd6b-b9164faae205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:27:15 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-29562bd6-68ad-4f98-9ab5-69a262731c61 tempest-VolumesListAdminTestJSON-323842265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54c408ab-d1e7-463b-a03d-c4eb778a9fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:15 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-29562bd6-68ad-4f98-9ab5-69a262731c61 tempest-VolumesListAdminTestJSON-323842265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54c408ab-d1e7-463b-a03d-c4eb778a9fc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:27:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-837677725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1eafafe-bcae-4a08-9d0f-b395877fcb7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ff5a009eb004b84a96d26f2acab6b03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:27:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:27:16Z,use_quota=True,user_id='fc3f90db027849be8b99dfa3f9d80edf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:15 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-29562bd6-68ad-4f98-9ab5-69a262731c61 tempest-VolumesListAdminTestJSON-323842265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e28c9ddb-4a17-4405-a3dc-ef37383c63c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:15 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-29562bd6-68ad-4f98-9ab5-69a262731c61 tempest-VolumesListAdminTestJSON-323842265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e28c9ddb-4a17-4405-a3dc-ef37383c63c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:15 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-29562bd6-68ad-4f98-9ab5-69a262731c61 tempest-VolumesListAdminTestJSON-323842265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30ffb2f0-76d7-4b2f-82ef-418f16585078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:15 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-29562bd6-68ad-4f98-9ab5-69a262731c61 tempest-VolumesListAdminTestJSON-323842265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30ffb2f0-76d7-4b2f-82ef-418f16585078) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1eafafe-bcae-4a08-9d0f-b395877fcb7c', 'volume_name': 'volume-e1eafafe-bcae-4a08-9d0f-b395877fcb7c', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:15 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-29562bd6-68ad-4f98-9ab5-69a262731c61 tempest-VolumesListAdminTestJSON-323842265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e84aeb49-0ac3-4b8f-9435-8e6a07561421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:15 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-29562bd6-68ad-4f98-9ab5-69a262731c61 tempest-VolumesListAdminTestJSON-323842265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e84aeb49-0ac3-4b8f-9435-8e6a07561421) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:15 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-29562bd6-68ad-4f98-9ab5-69a262731c61 tempest-VolumesListAdminTestJSON-323842265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25abe7db-724e-43f6-9bb7-b699dd13572a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:15 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-29562bd6-68ad-4f98-9ab5-69a262731c61 tempest-VolumesListAdminTestJSON-323842265 None] Volume e1eafafe-bcae-4a08-9d0f-b395877fcb7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1eafafe-bcae-4a08-9d0f-b395877fcb7c', 'volume_size': 1} Sep 16 20:27:15 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-29562bd6-68ad-4f98-9ab5-69a262731c61 tempest-VolumesListAdminTestJSON-323842265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:27:15 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-29562bd6-68ad-4f98-9ab5-69a262731c61 tempest-VolumesListAdminTestJSON-323842265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:27:15 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-29562bd6-68ad-4f98-9ab5-69a262731c61 tempest-VolumesListAdminTestJSON-323842265 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:27:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-837677725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1eafafe-bcae-4a08-9d0f-b395877fcb7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ff5a009eb004b84a96d26f2acab6b03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:27:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:27:16Z,use_quota=True,user_id='fc3f90db027849be8b99dfa3f9d80edf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:27:15 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-29562bd6-68ad-4f98-9ab5-69a262731c61 tempest-VolumesListAdminTestJSON-323842265 None] Creating volume e1eafafe-bcae-4a08-9d0f-b395877fcb7c {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:27:15 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-29562bd6-68ad-4f98-9ab5-69a262731c61 tempest-VolumesListAdminTestJSON-323842265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:27:15 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-29562bd6-68ad-4f98-9ab5-69a262731c61 tempest-VolumesListAdminTestJSON-323842265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:27:15 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-29562bd6-68ad-4f98-9ab5-69a262731c61 tempest-VolumesListAdminTestJSON-323842265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:27:15 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-29562bd6-68ad-4f98-9ab5-69a262731c61 tempest-VolumesListAdminTestJSON-323842265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:27:15 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-29562bd6-68ad-4f98-9ab5-69a262731c61 tempest-VolumesListAdminTestJSON-323842265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:27:15 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-29562bd6-68ad-4f98-9ab5-69a262731c61 tempest-VolumesListAdminTestJSON-323842265 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:27:15 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-29562bd6-68ad-4f98-9ab5-69a262731c61 tempest-VolumesListAdminTestJSON-323842265 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:27:15 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-29562bd6-68ad-4f98-9ab5-69a262731c61 tempest-VolumesListAdminTestJSON-323842265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e1eafafe-bcae-4a08-9d0f-b395877fcb7c 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:15 devstack sudo[97905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e1eafafe-bcae-4a08-9d0f-b395877fcb7c 1073741824 Sep 16 20:27:15 devstack sudo[97905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:16 devstack sudo[97903]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:16 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-84866844-74b8-4088-b6cc-008717531077 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b625bad0-f6f9-4603-a255-27aac3890ffb" returned: 0 in 0.331s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:16 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-84866844-74b8-4088-b6cc-008717531077 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Lock "cinder-quobyte-b625bad0-f6f9-4603-a255-27aac3890ffb" released by "delete_volume" :: held 0.861s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:27:16 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-84866844-74b8-4088-b6cc-008717531077 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Created reservations ['5cd11f64-a6fe-4a56-b3ac-53efd2ce28d8', 'c9fd208c-d055-4ce3-97f2-2b298e2e74ba', '1eb9d091-76ec-4fc8-a83b-f6a4cd7d0c6a', '1699852a-f977-4daa-a89b-6ad034219933'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:27:16 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-5672f70e-c01f-4427-84c6-f17bcef0e33d tempest-VolumesTransfersV357Test-2119510101 None] Acquiring lock "cinder-09b46950-1107-4062-b631-35f563e19587-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:27:16 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-5672f70e-c01f-4427-84c6-f17bcef0e33d tempest-VolumesTransfersV357Test-2119510101 None] Lock "cinder-09b46950-1107-4062-b631-35f563e19587-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:27:16 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-84866844-74b8-4088-b6cc-008717531077 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:27:16 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-84866844-74b8-4088-b6cc-008717531077 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:27:16 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-84866844-74b8-4088-b6cc-008717531077 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:27:16 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-84866844-74b8-4088-b6cc-008717531077 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:27:16 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-84866844-74b8-4088-b6cc-008717531077 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:27:16 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-84866844-74b8-4088-b6cc-008717531077 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:16 devstack sudo[97911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:27:16 devstack sudo[97911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:16 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-5672f70e-c01f-4427-84c6-f17bcef0e33d tempest-VolumesTransfersV357Test-2119510101 None] Acquiring lock "cinder-quobyte-09b46950-1107-4062-b631-35f563e19587" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:27:16 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-5672f70e-c01f-4427-84c6-f17bcef0e33d tempest-VolumesTransfersV357Test-2119510101 None] Lock "cinder-quobyte-09b46950-1107-4062-b631-35f563e19587" acquired by "delete_volume" :: waited 0.032s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:27:16 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-2b0591dc-906c-487f-93a9-798e33439a1c tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Acquiring lock "cinder-5d9d32a8-b42d-48f4-a0e9-db597ce4c77a-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:27:16 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[90d3db77-1d36-4cc5-b879-8ec86419dfeb]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:27:16 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-5672f70e-c01f-4427-84c6-f17bcef0e33d tempest-VolumesTransfersV357Test-2119510101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-09b46950-1107-4062-b631-35f563e19587 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:16 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-2b0591dc-906c-487f-93a9-798e33439a1c tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Lock "cinder-5d9d32a8-b42d-48f4-a0e9-db597ce4c77a-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:27:16 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc6adaf7-fa0f-4a01-a983-bfda8042a605 tempest-VolumesMetadataTest-890480603 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:27:16 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-fc6adaf7-fa0f-4a01-a983-bfda8042a605 tempest-VolumesMetadataTest-890480603 None] Flow 'volume_create_manager' (b66c96c6-8134-4872-b55e-bc814ffa7811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:27:16 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-fc6adaf7-fa0f-4a01-a983-bfda8042a605 tempest-VolumesMetadataTest-890480603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8efc58a6-27d1-4f06-bfd1-ca3cf01d128e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:16 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-fc6adaf7-fa0f-4a01-a983-bfda8042a605 tempest-VolumesMetadataTest-890480603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8efc58a6-27d1-4f06-bfd1-ca3cf01d128e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:27:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1920470278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cdaa4f2-0a62-4e22-9e13-cc8caf6b4c44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de58f5ba002946e6b07dfe4a128a2388',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:27:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:27:16Z,use_quota=True,user_id='bc15a1b407b640279c4e522bc4a78969',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:16 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-fc6adaf7-fa0f-4a01-a983-bfda8042a605 tempest-VolumesMetadataTest-890480603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cf12c4e-6869-4201-b2f4-a583fa8fbee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:16 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-fc6adaf7-fa0f-4a01-a983-bfda8042a605 tempest-VolumesMetadataTest-890480603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cf12c4e-6869-4201-b2f4-a583fa8fbee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:16 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-fc6adaf7-fa0f-4a01-a983-bfda8042a605 tempest-VolumesMetadataTest-890480603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (badbd952-e0e7-4c21-aabf-56abaecb1882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:16 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-fc6adaf7-fa0f-4a01-a983-bfda8042a605 tempest-VolumesMetadataTest-890480603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (badbd952-e0e7-4c21-aabf-56abaecb1882) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3cdaa4f2-0a62-4e22-9e13-cc8caf6b4c44', 'volume_name': 'volume-3cdaa4f2-0a62-4e22-9e13-cc8caf6b4c44', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:16 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-fc6adaf7-fa0f-4a01-a983-bfda8042a605 tempest-VolumesMetadataTest-890480603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a317b8c-e0c7-461f-8d00-495d4a325040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:16 devstack sudo[97905]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:16 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-fc6adaf7-fa0f-4a01-a983-bfda8042a605 tempest-VolumesMetadataTest-890480603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a317b8c-e0c7-461f-8d00-495d4a325040) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:16 devstack sudo[97914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-09b46950-1107-4062-b631-35f563e19587 Sep 16 20:27:16 devstack sudo[97914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:16 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-fc6adaf7-fa0f-4a01-a983-bfda8042a605 tempest-VolumesMetadataTest-890480603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6e05f60-b3b9-48a2-adc4-cda6bdd1c1a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:16 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-fc6adaf7-fa0f-4a01-a983-bfda8042a605 tempest-VolumesMetadataTest-890480603 None] Volume 3cdaa4f2-0a62-4e22-9e13-cc8caf6b4c44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3cdaa4f2-0a62-4e22-9e13-cc8caf6b4c44', 'volume_size': 1} Sep 16 20:27:16 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-fc6adaf7-fa0f-4a01-a983-bfda8042a605 tempest-VolumesMetadataTest-890480603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:27:16 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-2b0591dc-906c-487f-93a9-798e33439a1c tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Acquiring lock "cinder-quobyte-5d9d32a8-b42d-48f4-a0e9-db597ce4c77a" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:27:16 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-29562bd6-68ad-4f98-9ab5-69a262731c61 tempest-VolumesListAdminTestJSON-323842265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e1eafafe-bcae-4a08-9d0f-b395877fcb7c 1073741824" returned: 0 in 0.633s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:16 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-2b0591dc-906c-487f-93a9-798e33439a1c tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Lock "cinder-quobyte-5d9d32a8-b42d-48f4-a0e9-db597ce4c77a" acquired by "delete_volume" :: waited 0.025s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:27:16 devstack sudo[97911]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:16 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-84866844-74b8-4088-b6cc-008717531077 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.363s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:16 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-84866844-74b8-4088-b6cc-008717531077 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:27:16 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-29562bd6-68ad-4f98-9ab5-69a262731c61 tempest-VolumesListAdminTestJSON-323842265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e1eafafe-bcae-4a08-9d0f-b395877fcb7c {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:16 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-84866844-74b8-4088-b6cc-008717531077 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Deleted volume successfully. Sep 16 20:27:16 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[10c297d7-1c93-49b9-ba9c-7f455f176a2f]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:27:16 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-2b0591dc-906c-487f-93a9-798e33439a1c tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-5d9d32a8-b42d-48f4-a0e9-db597ce4c77a {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:16 devstack sudo[97917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e1eafafe-bcae-4a08-9d0f-b395877fcb7c Sep 16 20:27:16 devstack sudo[97917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:16 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-84866844-74b8-4088-b6cc-008717531077 tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Lock "cinder-b625bad0-f6f9-4603-a255-27aac3890ffb-delete_volume" released by "delete_volume" :: held 1.600s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:27:16 devstack sudo[97919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-5d9d32a8-b42d-48f4-a0e9-db597ce4c77a Sep 16 20:27:16 devstack sudo[97919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:16 devstack sudo[97914]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:16 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-5672f70e-c01f-4427-84c6-f17bcef0e33d tempest-VolumesTransfersV357Test-2119510101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-09b46950-1107-4062-b631-35f563e19587" returned: 0 in 0.504s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:16 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-5672f70e-c01f-4427-84c6-f17bcef0e33d tempest-VolumesTransfersV357Test-2119510101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-09b46950-1107-4062-b631-35f563e19587 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:16 devstack sudo[97917]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:16 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-29562bd6-68ad-4f98-9ab5-69a262731c61 tempest-VolumesListAdminTestJSON-323842265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e1eafafe-bcae-4a08-9d0f-b395877fcb7c" returned: 0 in 0.281s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:16 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-29562bd6-68ad-4f98-9ab5-69a262731c61 tempest-VolumesListAdminTestJSON-323842265 None] <== create_volume: return (982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:27:16 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-29562bd6-68ad-4f98-9ab5-69a262731c61 tempest-VolumesListAdminTestJSON-323842265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.985s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:27:16 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-fc6adaf7-fa0f-4a01-a983-bfda8042a605 tempest-VolumesMetadataTest-890480603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.354s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:27:16 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-fc6adaf7-fa0f-4a01-a983-bfda8042a605 tempest-VolumesMetadataTest-890480603 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:27:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1920470278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cdaa4f2-0a62-4e22-9e13-cc8caf6b4c44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de58f5ba002946e6b07dfe4a128a2388',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:27:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:27:16Z,use_quota=True,user_id='bc15a1b407b640279c4e522bc4a78969',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:27:16 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-fc6adaf7-fa0f-4a01-a983-bfda8042a605 tempest-VolumesMetadataTest-890480603 None] Creating volume 3cdaa4f2-0a62-4e22-9e13-cc8caf6b4c44 {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:27:16 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-fc6adaf7-fa0f-4a01-a983-bfda8042a605 tempest-VolumesMetadataTest-890480603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:27:16 devstack sudo[97926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-09b46950-1107-4062-b631-35f563e19587 Sep 16 20:27:16 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-fc6adaf7-fa0f-4a01-a983-bfda8042a605 tempest-VolumesMetadataTest-890480603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:27:16 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-fc6adaf7-fa0f-4a01-a983-bfda8042a605 tempest-VolumesMetadataTest-890480603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:27:16 devstack sudo[97926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:16 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-fc6adaf7-fa0f-4a01-a983-bfda8042a605 tempest-VolumesMetadataTest-890480603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:27:16 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-fc6adaf7-fa0f-4a01-a983-bfda8042a605 tempest-VolumesMetadataTest-890480603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:27:16 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-fc6adaf7-fa0f-4a01-a983-bfda8042a605 tempest-VolumesMetadataTest-890480603 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:27:16 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-fc6adaf7-fa0f-4a01-a983-bfda8042a605 tempest-VolumesMetadataTest-890480603 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:27:16 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-fc6adaf7-fa0f-4a01-a983-bfda8042a605 tempest-VolumesMetadataTest-890480603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-3cdaa4f2-0a62-4e22-9e13-cc8caf6b4c44 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:16 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-29562bd6-68ad-4f98-9ab5-69a262731c61 tempest-VolumesListAdminTestJSON-323842265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25abe7db-724e-43f6-9bb7-b699dd13572a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1eafafe-bcae-4a08-9d0f-b395877fcb7c', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:16 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-29562bd6-68ad-4f98-9ab5-69a262731c61 tempest-VolumesListAdminTestJSON-323842265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e5f7bbc-ee33-45cf-ba33-10ba25601aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:16 devstack sudo[97928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-3cdaa4f2-0a62-4e22-9e13-cc8caf6b4c44 1073741824 Sep 16 20:27:16 devstack sudo[97928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:16 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-29562bd6-68ad-4f98-9ab5-69a262731c61 tempest-VolumesListAdminTestJSON-323842265 None] Volume volume-e1eafafe-bcae-4a08-9d0f-b395877fcb7c (e1eafafe-bcae-4a08-9d0f-b395877fcb7c): created successfully Sep 16 20:27:16 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-29562bd6-68ad-4f98-9ab5-69a262731c61 tempest-VolumesListAdminTestJSON-323842265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e5f7bbc-ee33-45cf-ba33-10ba25601aeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:16 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-29562bd6-68ad-4f98-9ab5-69a262731c61 tempest-VolumesListAdminTestJSON-323842265 None] Flow 'volume_create_manager' (bfbd7d89-439a-4390-bd6b-b9164faae205) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:27:17 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-29562bd6-68ad-4f98-9ab5-69a262731c61 tempest-VolumesListAdminTestJSON-323842265 None] Created volume successfully. Sep 16 20:27:17 devstack sudo[97919]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:17 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-2b0591dc-906c-487f-93a9-798e33439a1c tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-5d9d32a8-b42d-48f4-a0e9-db597ce4c77a" returned: 0 in 0.387s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:17 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-2b0591dc-906c-487f-93a9-798e33439a1c tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-5d9d32a8-b42d-48f4-a0e9-db597ce4c77a {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:17 devstack sudo[97933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-5d9d32a8-b42d-48f4-a0e9-db597ce4c77a Sep 16 20:27:17 devstack sudo[97933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:17 devstack sudo[97926]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:17 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-5672f70e-c01f-4427-84c6-f17bcef0e33d tempest-VolumesTransfersV357Test-2119510101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-09b46950-1107-4062-b631-35f563e19587" returned: 0 in 0.277s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:17 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-5672f70e-c01f-4427-84c6-f17bcef0e33d tempest-VolumesTransfersV357Test-2119510101 None] Lock "cinder-quobyte-09b46950-1107-4062-b631-35f563e19587" released by "delete_volume" :: held 0.851s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:27:17 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-5672f70e-c01f-4427-84c6-f17bcef0e33d tempest-VolumesTransfersV357Test-2119510101 None] Created reservations ['01462645-66b4-449a-93d5-caeb722e1f42', '6d568f90-c363-4a5b-b73f-ae68180de5d8', 'e5cd22f0-70a4-405a-8ac7-aac581d1eb7b', '9bc4c4d4-6ba0-4355-9140-208dd8ebbbe7'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:27:17 devstack sudo[97933]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:17 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-5672f70e-c01f-4427-84c6-f17bcef0e33d tempest-VolumesTransfersV357Test-2119510101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:27:17 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-5672f70e-c01f-4427-84c6-f17bcef0e33d tempest-VolumesTransfersV357Test-2119510101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:27:17 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-5672f70e-c01f-4427-84c6-f17bcef0e33d tempest-VolumesTransfersV357Test-2119510101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:27:17 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-5672f70e-c01f-4427-84c6-f17bcef0e33d tempest-VolumesTransfersV357Test-2119510101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:27:17 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-5672f70e-c01f-4427-84c6-f17bcef0e33d tempest-VolumesTransfersV357Test-2119510101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:27:17 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-5672f70e-c01f-4427-84c6-f17bcef0e33d tempest-VolumesTransfersV357Test-2119510101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:17 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-2b0591dc-906c-487f-93a9-798e33439a1c tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-5d9d32a8-b42d-48f4-a0e9-db597ce4c77a" returned: 0 in 0.292s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:17 devstack sudo[97941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:27:17 devstack sudo[97941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:17 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-2b0591dc-906c-487f-93a9-798e33439a1c tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Lock "cinder-quobyte-5d9d32a8-b42d-48f4-a0e9-db597ce4c77a" released by "delete_volume" :: held 0.760s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:27:17 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-2b0591dc-906c-487f-93a9-798e33439a1c tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Created reservations ['e4441cbb-f357-45a7-a047-2741583d02f2', '7a1b505c-50e8-420b-be4f-62120ce50362', 'c553450b-9b84-4d0a-8cc4-570c28f32900', 'edf7432c-404f-4221-b6b3-9398d9b912fd'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:27:17 devstack sudo[97928]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:17 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-2b0591dc-906c-487f-93a9-798e33439a1c tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:27:17 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-2b0591dc-906c-487f-93a9-798e33439a1c tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:27:17 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-2b0591dc-906c-487f-93a9-798e33439a1c tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:27:17 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-2b0591dc-906c-487f-93a9-798e33439a1c tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:27:17 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-2b0591dc-906c-487f-93a9-798e33439a1c tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:27:17 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-2b0591dc-906c-487f-93a9-798e33439a1c tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:17 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-fc6adaf7-fa0f-4a01-a983-bfda8042a605 tempest-VolumesMetadataTest-890480603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-3cdaa4f2-0a62-4e22-9e13-cc8caf6b4c44 1073741824" returned: 0 in 0.595s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:17 devstack sudo[97943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:27:17 devstack sudo[97943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:17 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-fc6adaf7-fa0f-4a01-a983-bfda8042a605 tempest-VolumesMetadataTest-890480603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-3cdaa4f2-0a62-4e22-9e13-cc8caf6b4c44 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:17 devstack sudo[97945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-3cdaa4f2-0a62-4e22-9e13-cc8caf6b4c44 Sep 16 20:27:17 devstack sudo[97945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:17 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-1d823ebd-185e-4eed-9d84-3b012846768a tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Acquiring lock "cinder-d0c88952-3fc7-4c7e-a7f0-9608de9345a3-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:27:17 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-1d823ebd-185e-4eed-9d84-3b012846768a tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Lock "cinder-d0c88952-3fc7-4c7e-a7f0-9608de9345a3-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:27:17 devstack sudo[97941]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:17 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-5672f70e-c01f-4427-84c6-f17bcef0e33d tempest-VolumesTransfersV357Test-2119510101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.372s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:17 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-5672f70e-c01f-4427-84c6-f17bcef0e33d tempest-VolumesTransfersV357Test-2119510101 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:27:17 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-1d823ebd-185e-4eed-9d84-3b012846768a tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Acquiring lock "cinder-quobyte-d0c88952-3fc7-4c7e-a7f0-9608de9345a3" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:27:17 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-5672f70e-c01f-4427-84c6-f17bcef0e33d tempest-VolumesTransfersV357Test-2119510101 None] Deleted volume successfully. Sep 16 20:27:17 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-1d823ebd-185e-4eed-9d84-3b012846768a tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Lock "cinder-quobyte-d0c88952-3fc7-4c7e-a7f0-9608de9345a3" acquired by "delete_volume" :: waited 0.034s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:27:17 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-5672f70e-c01f-4427-84c6-f17bcef0e33d tempest-VolumesTransfersV357Test-2119510101 None] Lock "cinder-09b46950-1107-4062-b631-35f563e19587-delete_volume" released by "delete_volume" :: held 1.551s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:27:17 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e613207-f841-4c9a-89c4-2d59eb01eb8f]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:27:17 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-1d823ebd-185e-4eed-9d84-3b012846768a tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d0c88952-3fc7-4c7e-a7f0-9608de9345a3 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:17 devstack sudo[97945]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:17 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-fc6adaf7-fa0f-4a01-a983-bfda8042a605 tempest-VolumesMetadataTest-890480603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-3cdaa4f2-0a62-4e22-9e13-cc8caf6b4c44" returned: 0 in 0.317s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:17 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-fc6adaf7-fa0f-4a01-a983-bfda8042a605 tempest-VolumesMetadataTest-890480603 None] <== create_volume: return (961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:27:17 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-fc6adaf7-fa0f-4a01-a983-bfda8042a605 tempest-VolumesMetadataTest-890480603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:27:17 devstack sudo[97948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d0c88952-3fc7-4c7e-a7f0-9608de9345a3 Sep 16 20:27:17 devstack sudo[97948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:17 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-fc6adaf7-fa0f-4a01-a983-bfda8042a605 tempest-VolumesMetadataTest-890480603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6e05f60-b3b9-48a2-adc4-cda6bdd1c1a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3cdaa4f2-0a62-4e22-9e13-cc8caf6b4c44', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:17 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-fc6adaf7-fa0f-4a01-a983-bfda8042a605 tempest-VolumesMetadataTest-890480603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afc12025-3c7e-4a32-9916-91eff015eac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:17 devstack sudo[97943]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:17 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-2b0591dc-906c-487f-93a9-798e33439a1c tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.438s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:17 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-2b0591dc-906c-487f-93a9-798e33439a1c tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:27:17 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-2b0591dc-906c-487f-93a9-798e33439a1c tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Deleted volume successfully. Sep 16 20:27:17 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-fc6adaf7-fa0f-4a01-a983-bfda8042a605 tempest-VolumesMetadataTest-890480603 None] Volume volume-3cdaa4f2-0a62-4e22-9e13-cc8caf6b4c44 (3cdaa4f2-0a62-4e22-9e13-cc8caf6b4c44): created successfully Sep 16 20:27:17 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-fc6adaf7-fa0f-4a01-a983-bfda8042a605 tempest-VolumesMetadataTest-890480603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afc12025-3c7e-4a32-9916-91eff015eac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:18 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-fc6adaf7-fa0f-4a01-a983-bfda8042a605 tempest-VolumesMetadataTest-890480603 None] Flow 'volume_create_manager' (b66c96c6-8134-4872-b55e-bc814ffa7811) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:27:18 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-fc6adaf7-fa0f-4a01-a983-bfda8042a605 tempest-VolumesMetadataTest-890480603 None] Created volume successfully. Sep 16 20:27:18 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-2b0591dc-906c-487f-93a9-798e33439a1c tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Lock "cinder-5d9d32a8-b42d-48f4-a0e9-db597ce4c77a-delete_volume" released by "delete_volume" :: held 1.593s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:27:18 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-e17f4e8f-71ac-48ed-865b-c60956707ff5 tempest-VolumesTransfersV357Test-1371718851 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:27:18 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e17f4e8f-71ac-48ed-865b-c60956707ff5 tempest-VolumesTransfersV357Test-1371718851 None] Flow 'volume_create_manager' (a8b3dac2-3aa1-4dc1-a278-0c6f365f04cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:27:18 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e17f4e8f-71ac-48ed-865b-c60956707ff5 tempest-VolumesTransfersV357Test-1371718851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (576c4843-d2f7-45c3-b31c-c152d8e8023f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:18 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e17f4e8f-71ac-48ed-865b-c60956707ff5 tempest-VolumesTransfersV357Test-1371718851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (576c4843-d2f7-45c3-b31c-c152d8e8023f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:27:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1126851762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e26a8401-71fd-4c60-84a3-d2fc6be1f061,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1b0dbad006e4076baed8563fa0b83bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:27:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:27:18Z,use_quota=True,user_id='ce6e317a9e824476b97e0f70b1e711f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:18 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e17f4e8f-71ac-48ed-865b-c60956707ff5 tempest-VolumesTransfersV357Test-1371718851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f33839a-fdff-40d1-8f99-e52ebb1cc23b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:18 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e17f4e8f-71ac-48ed-865b-c60956707ff5 tempest-VolumesTransfersV357Test-1371718851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f33839a-fdff-40d1-8f99-e52ebb1cc23b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:18 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e17f4e8f-71ac-48ed-865b-c60956707ff5 tempest-VolumesTransfersV357Test-1371718851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b307bee-2a86-4f4b-96d9-7b2a7cc9d9ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:18 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e17f4e8f-71ac-48ed-865b-c60956707ff5 tempest-VolumesTransfersV357Test-1371718851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b307bee-2a86-4f4b-96d9-7b2a7cc9d9ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e26a8401-71fd-4c60-84a3-d2fc6be1f061', 'volume_name': 'volume-e26a8401-71fd-4c60-84a3-d2fc6be1f061', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:18 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e17f4e8f-71ac-48ed-865b-c60956707ff5 tempest-VolumesTransfersV357Test-1371718851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5678cbf2-954b-467a-8b38-f5319350feb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:18 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e17f4e8f-71ac-48ed-865b-c60956707ff5 tempest-VolumesTransfersV357Test-1371718851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5678cbf2-954b-467a-8b38-f5319350feb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:18 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e17f4e8f-71ac-48ed-865b-c60956707ff5 tempest-VolumesTransfersV357Test-1371718851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18670765-9b66-4750-a89a-8bde8f7de3d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:18 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-e17f4e8f-71ac-48ed-865b-c60956707ff5 tempest-VolumesTransfersV357Test-1371718851 None] Volume e26a8401-71fd-4c60-84a3-d2fc6be1f061: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e26a8401-71fd-4c60-84a3-d2fc6be1f061', 'volume_size': 1} Sep 16 20:27:18 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-e17f4e8f-71ac-48ed-865b-c60956707ff5 tempest-VolumesTransfersV357Test-1371718851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:27:18 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-e17f4e8f-71ac-48ed-865b-c60956707ff5 tempest-VolumesTransfersV357Test-1371718851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:27:18 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-e17f4e8f-71ac-48ed-865b-c60956707ff5 tempest-VolumesTransfersV357Test-1371718851 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:27:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1126851762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e26a8401-71fd-4c60-84a3-d2fc6be1f061,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1b0dbad006e4076baed8563fa0b83bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:27:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:27:18Z,use_quota=True,user_id='ce6e317a9e824476b97e0f70b1e711f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:27:18 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-e17f4e8f-71ac-48ed-865b-c60956707ff5 tempest-VolumesTransfersV357Test-1371718851 None] Creating volume e26a8401-71fd-4c60-84a3-d2fc6be1f061 {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:27:18 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-e17f4e8f-71ac-48ed-865b-c60956707ff5 tempest-VolumesTransfersV357Test-1371718851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:27:18 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-e17f4e8f-71ac-48ed-865b-c60956707ff5 tempest-VolumesTransfersV357Test-1371718851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:27:18 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-e17f4e8f-71ac-48ed-865b-c60956707ff5 tempest-VolumesTransfersV357Test-1371718851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:27:18 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-e17f4e8f-71ac-48ed-865b-c60956707ff5 tempest-VolumesTransfersV357Test-1371718851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:27:18 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-e17f4e8f-71ac-48ed-865b-c60956707ff5 tempest-VolumesTransfersV357Test-1371718851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:27:18 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-e17f4e8f-71ac-48ed-865b-c60956707ff5 tempest-VolumesTransfersV357Test-1371718851 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:27:18 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-e17f4e8f-71ac-48ed-865b-c60956707ff5 tempest-VolumesTransfersV357Test-1371718851 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:27:18 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e17f4e8f-71ac-48ed-865b-c60956707ff5 tempest-VolumesTransfersV357Test-1371718851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e26a8401-71fd-4c60-84a3-d2fc6be1f061 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:18 devstack sudo[97948]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:18 devstack sudo[97955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e26a8401-71fd-4c60-84a3-d2fc6be1f061 1073741824 Sep 16 20:27:18 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-1d823ebd-185e-4eed-9d84-3b012846768a tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d0c88952-3fc7-4c7e-a7f0-9608de9345a3" returned: 0 in 0.491s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:18 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-1d823ebd-185e-4eed-9d84-3b012846768a tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d0c88952-3fc7-4c7e-a7f0-9608de9345a3 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:18 devstack sudo[97955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:18 devstack sudo[97957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d0c88952-3fc7-4c7e-a7f0-9608de9345a3 Sep 16 20:27:18 devstack sudo[97957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:18 devstack sudo[97957]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:18 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-1d823ebd-185e-4eed-9d84-3b012846768a tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d0c88952-3fc7-4c7e-a7f0-9608de9345a3" returned: 0 in 0.294s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:18 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-1d823ebd-185e-4eed-9d84-3b012846768a tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Lock "cinder-quobyte-d0c88952-3fc7-4c7e-a7f0-9608de9345a3" released by "delete_volume" :: held 0.848s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:27:18 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-1d823ebd-185e-4eed-9d84-3b012846768a tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Created reservations ['d855c855-7586-4510-84a1-6df1df64370a', '0957500f-166b-43e9-979e-a740d8fc3aee', '6b0d06b6-3f6a-4c46-b611-f4757561f6d3', 'a28e0494-1300-45f1-9e71-9cee8a92fbc1'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:27:18 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-adfb5b2d-3424-4f4f-84ff-be51516568b3 tempest-VolumesListAdminTestJSON-323842265 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:27:18 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-adfb5b2d-3424-4f4f-84ff-be51516568b3 tempest-VolumesListAdminTestJSON-323842265 None] Flow 'volume_create_manager' (21743cfe-2f79-4786-9556-569553b58413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:27:18 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-adfb5b2d-3424-4f4f-84ff-be51516568b3 tempest-VolumesListAdminTestJSON-323842265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (248b234d-bb7f-4f9c-b352-f58f5370c764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:18 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-adfb5b2d-3424-4f4f-84ff-be51516568b3 tempest-VolumesListAdminTestJSON-323842265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (248b234d-bb7f-4f9c-b352-f58f5370c764) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:27:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-773694924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd7c1127-a7c2-4ebc-8d37-e07d5d080eb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ff5a009eb004b84a96d26f2acab6b03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:27:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:27:19Z,use_quota=True,user_id='fc3f90db027849be8b99dfa3f9d80edf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:18 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-adfb5b2d-3424-4f4f-84ff-be51516568b3 tempest-VolumesListAdminTestJSON-323842265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1395519f-a9a6-4ed6-ad84-3895423d11a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:18 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-adfb5b2d-3424-4f4f-84ff-be51516568b3 tempest-VolumesListAdminTestJSON-323842265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1395519f-a9a6-4ed6-ad84-3895423d11a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:18 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-adfb5b2d-3424-4f4f-84ff-be51516568b3 tempest-VolumesListAdminTestJSON-323842265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ec48bc3-a68d-4432-9d76-78019f322786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:18 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-adfb5b2d-3424-4f4f-84ff-be51516568b3 tempest-VolumesListAdminTestJSON-323842265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ec48bc3-a68d-4432-9d76-78019f322786) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd7c1127-a7c2-4ebc-8d37-e07d5d080eb5', 'volume_name': 'volume-bd7c1127-a7c2-4ebc-8d37-e07d5d080eb5', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:18 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-adfb5b2d-3424-4f4f-84ff-be51516568b3 tempest-VolumesListAdminTestJSON-323842265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0739a46-5033-4438-87a7-542963d0d92a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:18 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-adfb5b2d-3424-4f4f-84ff-be51516568b3 tempest-VolumesListAdminTestJSON-323842265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0739a46-5033-4438-87a7-542963d0d92a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:18 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-adfb5b2d-3424-4f4f-84ff-be51516568b3 tempest-VolumesListAdminTestJSON-323842265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc7a6681-967f-43ef-a647-887580054c06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:18 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-adfb5b2d-3424-4f4f-84ff-be51516568b3 tempest-VolumesListAdminTestJSON-323842265 None] Volume bd7c1127-a7c2-4ebc-8d37-e07d5d080eb5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd7c1127-a7c2-4ebc-8d37-e07d5d080eb5', 'volume_size': 1} Sep 16 20:27:18 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-adfb5b2d-3424-4f4f-84ff-be51516568b3 tempest-VolumesListAdminTestJSON-323842265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:27:18 devstack sudo[97955]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:18 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e17f4e8f-71ac-48ed-865b-c60956707ff5 tempest-VolumesTransfersV357Test-1371718851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e26a8401-71fd-4c60-84a3-d2fc6be1f061 1073741824" returned: 0 in 0.590s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:18 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-1d823ebd-185e-4eed-9d84-3b012846768a tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:27:18 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-1d823ebd-185e-4eed-9d84-3b012846768a tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:27:18 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-1d823ebd-185e-4eed-9d84-3b012846768a tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:27:18 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-1d823ebd-185e-4eed-9d84-3b012846768a tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:27:18 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-1d823ebd-185e-4eed-9d84-3b012846768a tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:27:18 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-1d823ebd-185e-4eed-9d84-3b012846768a tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:18 devstack sudo[97964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:27:18 devstack sudo[97964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:18 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e17f4e8f-71ac-48ed-865b-c60956707ff5 tempest-VolumesTransfersV357Test-1371718851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e26a8401-71fd-4c60-84a3-d2fc6be1f061 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:18 devstack sudo[97966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e26a8401-71fd-4c60-84a3-d2fc6be1f061 Sep 16 20:27:18 devstack sudo[97966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:19 devstack sudo[97964]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:19 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-1d823ebd-185e-4eed-9d84-3b012846768a tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.264s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:19 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-1d823ebd-185e-4eed-9d84-3b012846768a tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:27:19 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-1d823ebd-185e-4eed-9d84-3b012846768a tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Deleted volume successfully. Sep 16 20:27:19 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-1d823ebd-185e-4eed-9d84-3b012846768a tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Lock "cinder-d0c88952-3fc7-4c7e-a7f0-9608de9345a3-delete_volume" released by "delete_volume" :: held 1.512s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:27:19 devstack sudo[97966]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:19 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e17f4e8f-71ac-48ed-865b-c60956707ff5 tempest-VolumesTransfersV357Test-1371718851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e26a8401-71fd-4c60-84a3-d2fc6be1f061" returned: 0 in 0.292s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:19 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-e17f4e8f-71ac-48ed-865b-c60956707ff5 tempest-VolumesTransfersV357Test-1371718851 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:27:19 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-e17f4e8f-71ac-48ed-865b-c60956707ff5 tempest-VolumesTransfersV357Test-1371718851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:27:19 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-adfb5b2d-3424-4f4f-84ff-be51516568b3 tempest-VolumesListAdminTestJSON-323842265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.380s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:27:19 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-adfb5b2d-3424-4f4f-84ff-be51516568b3 tempest-VolumesListAdminTestJSON-323842265 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:27:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-773694924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd7c1127-a7c2-4ebc-8d37-e07d5d080eb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ff5a009eb004b84a96d26f2acab6b03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:27:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:27:19Z,use_quota=True,user_id='fc3f90db027849be8b99dfa3f9d80edf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:27:19 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-adfb5b2d-3424-4f4f-84ff-be51516568b3 tempest-VolumesListAdminTestJSON-323842265 None] Creating volume bd7c1127-a7c2-4ebc-8d37-e07d5d080eb5 {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:27:19 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-adfb5b2d-3424-4f4f-84ff-be51516568b3 tempest-VolumesListAdminTestJSON-323842265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:27:19 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-adfb5b2d-3424-4f4f-84ff-be51516568b3 tempest-VolumesListAdminTestJSON-323842265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:27:19 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-adfb5b2d-3424-4f4f-84ff-be51516568b3 tempest-VolumesListAdminTestJSON-323842265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:27:19 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-adfb5b2d-3424-4f4f-84ff-be51516568b3 tempest-VolumesListAdminTestJSON-323842265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:27:19 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-adfb5b2d-3424-4f4f-84ff-be51516568b3 tempest-VolumesListAdminTestJSON-323842265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:27:19 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-adfb5b2d-3424-4f4f-84ff-be51516568b3 tempest-VolumesListAdminTestJSON-323842265 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:27:19 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-adfb5b2d-3424-4f4f-84ff-be51516568b3 tempest-VolumesListAdminTestJSON-323842265 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:27:19 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-adfb5b2d-3424-4f4f-84ff-be51516568b3 tempest-VolumesListAdminTestJSON-323842265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-bd7c1127-a7c2-4ebc-8d37-e07d5d080eb5 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:19 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e17f4e8f-71ac-48ed-865b-c60956707ff5 tempest-VolumesTransfersV357Test-1371718851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18670765-9b66-4750-a89a-8bde8f7de3d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e26a8401-71fd-4c60-84a3-d2fc6be1f061', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:19 devstack sudo[97971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-bd7c1127-a7c2-4ebc-8d37-e07d5d080eb5 1073741824 Sep 16 20:27:19 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e17f4e8f-71ac-48ed-865b-c60956707ff5 tempest-VolumesTransfersV357Test-1371718851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b36e2cde-7b7f-418c-a63a-4656e58fbdb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:19 devstack sudo[97971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:19 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-e17f4e8f-71ac-48ed-865b-c60956707ff5 tempest-VolumesTransfersV357Test-1371718851 None] Volume volume-e26a8401-71fd-4c60-84a3-d2fc6be1f061 (e26a8401-71fd-4c60-84a3-d2fc6be1f061): created successfully Sep 16 20:27:19 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e17f4e8f-71ac-48ed-865b-c60956707ff5 tempest-VolumesTransfersV357Test-1371718851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b36e2cde-7b7f-418c-a63a-4656e58fbdb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:19 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e17f4e8f-71ac-48ed-865b-c60956707ff5 tempest-VolumesTransfersV357Test-1371718851 None] Flow 'volume_create_manager' (a8b3dac2-3aa1-4dc1-a278-0c6f365f04cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:27:19 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-e17f4e8f-71ac-48ed-865b-c60956707ff5 tempest-VolumesTransfersV357Test-1371718851 None] Created volume successfully. Sep 16 20:27:19 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-dd43f57e-2cbf-4b4f-957b-247c9dc7a3ee tempest-VolumesMetadataTest-890480603 None] Acquiring lock "cinder-3cdaa4f2-0a62-4e22-9e13-cc8caf6b4c44-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:27:19 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-dd43f57e-2cbf-4b4f-957b-247c9dc7a3ee tempest-VolumesMetadataTest-890480603 None] Lock "cinder-3cdaa4f2-0a62-4e22-9e13-cc8caf6b4c44-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:27:19 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-dd43f57e-2cbf-4b4f-957b-247c9dc7a3ee tempest-VolumesMetadataTest-890480603 None] Acquiring lock "cinder-quobyte-3cdaa4f2-0a62-4e22-9e13-cc8caf6b4c44" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:27:19 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-dd43f57e-2cbf-4b4f-957b-247c9dc7a3ee tempest-VolumesMetadataTest-890480603 None] Lock "cinder-quobyte-3cdaa4f2-0a62-4e22-9e13-cc8caf6b4c44" acquired by "delete_volume" :: waited 0.018s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:27:19 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[514f093a-616b-4480-bb9c-5ad214697c75]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:27:19 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-dd43f57e-2cbf-4b4f-957b-247c9dc7a3ee tempest-VolumesMetadataTest-890480603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-3cdaa4f2-0a62-4e22-9e13-cc8caf6b4c44 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:19 devstack sudo[97976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-3cdaa4f2-0a62-4e22-9e13-cc8caf6b4c44 Sep 16 20:27:19 devstack sudo[97976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:19 devstack sudo[97971]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:19 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-adfb5b2d-3424-4f4f-84ff-be51516568b3 tempest-VolumesListAdminTestJSON-323842265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-bd7c1127-a7c2-4ebc-8d37-e07d5d080eb5 1073741824" returned: 0 in 0.496s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:19 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-adfb5b2d-3424-4f4f-84ff-be51516568b3 tempest-VolumesListAdminTestJSON-323842265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-bd7c1127-a7c2-4ebc-8d37-e07d5d080eb5 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:19 devstack sudo[97979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-bd7c1127-a7c2-4ebc-8d37-e07d5d080eb5 Sep 16 20:27:19 devstack sudo[97979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:19 devstack sudo[97976]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:19 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-dd43f57e-2cbf-4b4f-957b-247c9dc7a3ee tempest-VolumesMetadataTest-890480603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-3cdaa4f2-0a62-4e22-9e13-cc8caf6b4c44" returned: 0 in 0.410s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:19 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-dd43f57e-2cbf-4b4f-957b-247c9dc7a3ee tempest-VolumesMetadataTest-890480603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-3cdaa4f2-0a62-4e22-9e13-cc8caf6b4c44 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:19 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-f07b3cff-57a4-49e6-a648-92b82a1278ed tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Acquiring lock "cinder-fbc4ebb2-0859-41a8-8e67-995881a2cb35-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:27:19 devstack sudo[97984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-3cdaa4f2-0a62-4e22-9e13-cc8caf6b4c44 Sep 16 20:27:19 devstack sudo[97984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:19 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-f07b3cff-57a4-49e6-a648-92b82a1278ed tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Lock "cinder-fbc4ebb2-0859-41a8-8e67-995881a2cb35-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:27:19 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-f07b3cff-57a4-49e6-a648-92b82a1278ed tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Acquiring lock "cinder-quobyte-fbc4ebb2-0859-41a8-8e67-995881a2cb35" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:27:19 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-f07b3cff-57a4-49e6-a648-92b82a1278ed tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Lock "cinder-quobyte-fbc4ebb2-0859-41a8-8e67-995881a2cb35" acquired by "delete_volume" :: waited 0.025s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:27:20 devstack sudo[97979]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:20 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-adfb5b2d-3424-4f4f-84ff-be51516568b3 tempest-VolumesListAdminTestJSON-323842265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-bd7c1127-a7c2-4ebc-8d37-e07d5d080eb5" returned: 0 in 0.293s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:20 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-adfb5b2d-3424-4f4f-84ff-be51516568b3 tempest-VolumesListAdminTestJSON-323842265 None] <== create_volume: return (834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:27:20 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-adfb5b2d-3424-4f4f-84ff-be51516568b3 tempest-VolumesListAdminTestJSON-323842265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.837s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:27:20 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-adfb5b2d-3424-4f4f-84ff-be51516568b3 tempest-VolumesListAdminTestJSON-323842265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc7a6681-967f-43ef-a647-887580054c06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd7c1127-a7c2-4ebc-8d37-e07d5d080eb5', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:20 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-adfb5b2d-3424-4f4f-84ff-be51516568b3 tempest-VolumesListAdminTestJSON-323842265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b21dd684-6880-4bbb-8d84-af73dbe28c38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:20 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ee43c1b-aa22-43e8-b5fb-ddbb9181e4ff]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:27:20 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f07b3cff-57a4-49e6-a648-92b82a1278ed tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-fbc4ebb2-0859-41a8-8e67-995881a2cb35 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:20 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-adfb5b2d-3424-4f4f-84ff-be51516568b3 tempest-VolumesListAdminTestJSON-323842265 None] Volume volume-bd7c1127-a7c2-4ebc-8d37-e07d5d080eb5 (bd7c1127-a7c2-4ebc-8d37-e07d5d080eb5): created successfully Sep 16 20:27:20 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-adfb5b2d-3424-4f4f-84ff-be51516568b3 tempest-VolumesListAdminTestJSON-323842265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b21dd684-6880-4bbb-8d84-af73dbe28c38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:20 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-adfb5b2d-3424-4f4f-84ff-be51516568b3 tempest-VolumesListAdminTestJSON-323842265 None] Flow 'volume_create_manager' (21743cfe-2f79-4786-9556-569553b58413) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:27:20 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-adfb5b2d-3424-4f4f-84ff-be51516568b3 tempest-VolumesListAdminTestJSON-323842265 None] Created volume successfully. Sep 16 20:27:20 devstack sudo[97987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-fbc4ebb2-0859-41a8-8e67-995881a2cb35 Sep 16 20:27:20 devstack sudo[97987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:20 devstack sudo[97984]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:20 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-dd43f57e-2cbf-4b4f-957b-247c9dc7a3ee tempest-VolumesMetadataTest-890480603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-3cdaa4f2-0a62-4e22-9e13-cc8caf6b4c44" returned: 0 in 0.297s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:20 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-dd43f57e-2cbf-4b4f-957b-247c9dc7a3ee tempest-VolumesMetadataTest-890480603 None] Lock "cinder-quobyte-3cdaa4f2-0a62-4e22-9e13-cc8caf6b4c44" released by "delete_volume" :: held 0.758s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:27:20 devstack cinder-volume[86188]: DEBUG dbcounter [-] [86188] Writing DB stats cinder:UPDATE=301,cinder:SELECT=222,cinder:INSERT=70,cinder:DELETE=23 {{(pid=86188) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 20:27:20 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-dd43f57e-2cbf-4b4f-957b-247c9dc7a3ee tempest-VolumesMetadataTest-890480603 None] Created reservations ['8aca56ac-d11f-4756-9f43-bb6c0800ccea', '4d7ad3b4-dd66-435f-a19c-833d6e2197d3', 'bb10fb9d-548b-4ea3-a7f9-8834acd91e1c', '33790944-db16-4b84-9991-83a0789c8fe9'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:27:20 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-dd43f57e-2cbf-4b4f-957b-247c9dc7a3ee tempest-VolumesMetadataTest-890480603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:27:20 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-dd43f57e-2cbf-4b4f-957b-247c9dc7a3ee tempest-VolumesMetadataTest-890480603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:27:20 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-dd43f57e-2cbf-4b4f-957b-247c9dc7a3ee tempest-VolumesMetadataTest-890480603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:27:20 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-dd43f57e-2cbf-4b4f-957b-247c9dc7a3ee tempest-VolumesMetadataTest-890480603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:27:20 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-dd43f57e-2cbf-4b4f-957b-247c9dc7a3ee tempest-VolumesMetadataTest-890480603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:27:20 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-dd43f57e-2cbf-4b4f-957b-247c9dc7a3ee tempest-VolumesMetadataTest-890480603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:20 devstack sudo[97990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:27:20 devstack sudo[97990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:20 devstack sudo[97987]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:20 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f07b3cff-57a4-49e6-a648-92b82a1278ed tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-fbc4ebb2-0859-41a8-8e67-995881a2cb35" returned: 0 in 0.405s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:20 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f07b3cff-57a4-49e6-a648-92b82a1278ed tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-fbc4ebb2-0859-41a8-8e67-995881a2cb35 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:20 devstack sudo[97995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-fbc4ebb2-0859-41a8-8e67-995881a2cb35 Sep 16 20:27:20 devstack sudo[97995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:20 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-673c4a79-54ff-4c40-97a2-d8565cbe0258 tempest-VolumesTransfersV357Test-2119510101 None] Acquiring lock "cinder-e26a8401-71fd-4c60-84a3-d2fc6be1f061-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:27:20 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-673c4a79-54ff-4c40-97a2-d8565cbe0258 tempest-VolumesTransfersV357Test-2119510101 None] Lock "cinder-e26a8401-71fd-4c60-84a3-d2fc6be1f061-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:27:20 devstack cinder-volume[86188]: DEBUG dbcounter [-] [86188] Writing DB stats cinder:UPDATE=318,cinder:SELECT=221,cinder:DELETE=29,cinder:INSERT=73 {{(pid=86188) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 20:27:20 devstack sudo[97990]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:20 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-673c4a79-54ff-4c40-97a2-d8565cbe0258 tempest-VolumesTransfersV357Test-2119510101 None] Acquiring lock "cinder-quobyte-e26a8401-71fd-4c60-84a3-d2fc6be1f061" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:27:20 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-dd43f57e-2cbf-4b4f-957b-247c9dc7a3ee tempest-VolumesMetadataTest-890480603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.351s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:20 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-dd43f57e-2cbf-4b4f-957b-247c9dc7a3ee tempest-VolumesMetadataTest-890480603 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:27:20 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-dd43f57e-2cbf-4b4f-957b-247c9dc7a3ee tempest-VolumesMetadataTest-890480603 None] Deleted volume successfully. Sep 16 20:27:20 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-673c4a79-54ff-4c40-97a2-d8565cbe0258 tempest-VolumesTransfersV357Test-2119510101 None] Lock "cinder-quobyte-e26a8401-71fd-4c60-84a3-d2fc6be1f061" acquired by "delete_volume" :: waited 0.028s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:27:20 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-dd43f57e-2cbf-4b4f-957b-247c9dc7a3ee tempest-VolumesMetadataTest-890480603 None] Lock "cinder-3cdaa4f2-0a62-4e22-9e13-cc8caf6b4c44-delete_volume" released by "delete_volume" :: held 1.359s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:27:20 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf4ab5ec-a833-4438-84ee-9bce9063930c]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:27:20 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-673c4a79-54ff-4c40-97a2-d8565cbe0258 tempest-VolumesTransfersV357Test-2119510101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e26a8401-71fd-4c60-84a3-d2fc6be1f061 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:20 devstack sudo[97995]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:20 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f07b3cff-57a4-49e6-a648-92b82a1278ed tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-fbc4ebb2-0859-41a8-8e67-995881a2cb35" returned: 0 in 0.403s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:20 devstack sudo[97998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e26a8401-71fd-4c60-84a3-d2fc6be1f061 Sep 16 20:27:20 devstack sudo[97998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:20 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-f07b3cff-57a4-49e6-a648-92b82a1278ed tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Lock "cinder-quobyte-fbc4ebb2-0859-41a8-8e67-995881a2cb35" released by "delete_volume" :: held 0.874s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:27:20 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-f07b3cff-57a4-49e6-a648-92b82a1278ed tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Created reservations ['756bafef-5900-47c6-b043-c9b8661f0065', '096f2893-48f5-4332-8dec-51ebdf7afa30', '86fb1869-8088-4075-ae2f-5d2e00c9df00', 'caf9a36e-956d-4963-a518-76bd18ce0486'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:27:21 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-f07b3cff-57a4-49e6-a648-92b82a1278ed tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:27:21 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-f07b3cff-57a4-49e6-a648-92b82a1278ed tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:27:21 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-f07b3cff-57a4-49e6-a648-92b82a1278ed tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:27:21 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-f07b3cff-57a4-49e6-a648-92b82a1278ed tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:27:21 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-f07b3cff-57a4-49e6-a648-92b82a1278ed tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:27:21 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f07b3cff-57a4-49e6-a648-92b82a1278ed tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:21 devstack sudo[98001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:27:21 devstack sudo[98001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:21 devstack sudo[97998]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:21 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-673c4a79-54ff-4c40-97a2-d8565cbe0258 tempest-VolumesTransfersV357Test-2119510101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e26a8401-71fd-4c60-84a3-d2fc6be1f061" returned: 0 in 0.466s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:21 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-673c4a79-54ff-4c40-97a2-d8565cbe0258 tempest-VolumesTransfersV357Test-2119510101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e26a8401-71fd-4c60-84a3-d2fc6be1f061 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:21 devstack sudo[98006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e26a8401-71fd-4c60-84a3-d2fc6be1f061 Sep 16 20:27:21 devstack sudo[98006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:21 devstack sudo[98001]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:21 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f07b3cff-57a4-49e6-a648-92b82a1278ed tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.327s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:21 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-f07b3cff-57a4-49e6-a648-92b82a1278ed tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:27:21 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-f07b3cff-57a4-49e6-a648-92b82a1278ed tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Deleted volume successfully. Sep 16 20:27:21 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-f07b3cff-57a4-49e6-a648-92b82a1278ed tempest-CreateVolumesFromSourceVolumeTest-1094229736 None] Lock "cinder-fbc4ebb2-0859-41a8-8e67-995881a2cb35-delete_volume" released by "delete_volume" :: held 1.481s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:27:21 devstack sudo[98006]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:21 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-673c4a79-54ff-4c40-97a2-d8565cbe0258 tempest-VolumesTransfersV357Test-2119510101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e26a8401-71fd-4c60-84a3-d2fc6be1f061" returned: 0 in 0.416s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:21 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-673c4a79-54ff-4c40-97a2-d8565cbe0258 tempest-VolumesTransfersV357Test-2119510101 None] Lock "cinder-quobyte-e26a8401-71fd-4c60-84a3-d2fc6be1f061" released by "delete_volume" :: held 0.958s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:27:21 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-673c4a79-54ff-4c40-97a2-d8565cbe0258 tempest-VolumesTransfersV357Test-2119510101 None] Created reservations ['2d050d54-6b77-4e19-8cfb-df4c4233bae0', '7254e42f-44be-4af6-9cbf-c9a66825f052', '15394ecc-2a86-4090-bd78-6de0a00567fc', '2b9c0bbf-4e06-4171-8a76-f3777fe8d86e'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:27:21 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-673c4a79-54ff-4c40-97a2-d8565cbe0258 tempest-VolumesTransfersV357Test-2119510101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:27:21 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-673c4a79-54ff-4c40-97a2-d8565cbe0258 tempest-VolumesTransfersV357Test-2119510101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:27:21 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-673c4a79-54ff-4c40-97a2-d8565cbe0258 tempest-VolumesTransfersV357Test-2119510101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:27:21 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-673c4a79-54ff-4c40-97a2-d8565cbe0258 tempest-VolumesTransfersV357Test-2119510101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:27:21 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-673c4a79-54ff-4c40-97a2-d8565cbe0258 tempest-VolumesTransfersV357Test-2119510101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:27:21 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-673c4a79-54ff-4c40-97a2-d8565cbe0258 tempest-VolumesTransfersV357Test-2119510101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:21 devstack sudo[98010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:27:21 devstack sudo[98010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:21 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1bd02e0-3837-4a31-855b-75f1a2da39a5 tempest-VolumesListAdminTestJSON-1678532964 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:27:21 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f1bd02e0-3837-4a31-855b-75f1a2da39a5 tempest-VolumesListAdminTestJSON-1678532964 None] Flow 'volume_create_manager' (eaca9410-a547-4c07-b509-aa805d19daca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:27:21 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f1bd02e0-3837-4a31-855b-75f1a2da39a5 tempest-VolumesListAdminTestJSON-1678532964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1bc3cf7-d0ab-463f-91ab-f3995cbafb6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:21 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f1bd02e0-3837-4a31-855b-75f1a2da39a5 tempest-VolumesListAdminTestJSON-1678532964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1bc3cf7-d0ab-463f-91ab-f3995cbafb6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:27:21Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ce2bc25-cba7-40ad-804b-cf9c83f28177,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a740d11ea85a426298907ef490bdcfe2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:27:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:27:22Z,use_quota=True,user_id='4d6f9389215042c3984d153450727f74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:21 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f1bd02e0-3837-4a31-855b-75f1a2da39a5 tempest-VolumesListAdminTestJSON-1678532964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6178895b-509c-4866-b5a1-8b9ef636f359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:21 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f1bd02e0-3837-4a31-855b-75f1a2da39a5 tempest-VolumesListAdminTestJSON-1678532964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6178895b-509c-4866-b5a1-8b9ef636f359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:21 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f1bd02e0-3837-4a31-855b-75f1a2da39a5 tempest-VolumesListAdminTestJSON-1678532964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56fdf4da-8e98-4176-9c84-3b31aed7b922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:21 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f1bd02e0-3837-4a31-855b-75f1a2da39a5 tempest-VolumesListAdminTestJSON-1678532964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56fdf4da-8e98-4176-9c84-3b31aed7b922) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ce2bc25-cba7-40ad-804b-cf9c83f28177', 'volume_name': 'volume-8ce2bc25-cba7-40ad-804b-cf9c83f28177', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:21 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f1bd02e0-3837-4a31-855b-75f1a2da39a5 tempest-VolumesListAdminTestJSON-1678532964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84f8132d-f4e1-4bd9-8c39-fe2db7b41334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:21 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f1bd02e0-3837-4a31-855b-75f1a2da39a5 tempest-VolumesListAdminTestJSON-1678532964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84f8132d-f4e1-4bd9-8c39-fe2db7b41334) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:21 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f1bd02e0-3837-4a31-855b-75f1a2da39a5 tempest-VolumesListAdminTestJSON-1678532964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22756529-3a1f-446f-87db-e446351c87f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:21 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-f1bd02e0-3837-4a31-855b-75f1a2da39a5 tempest-VolumesListAdminTestJSON-1678532964 None] Volume 8ce2bc25-cba7-40ad-804b-cf9c83f28177: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ce2bc25-cba7-40ad-804b-cf9c83f28177', 'volume_size': 1} Sep 16 20:27:21 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-f1bd02e0-3837-4a31-855b-75f1a2da39a5 tempest-VolumesListAdminTestJSON-1678532964 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:27:21 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-f1bd02e0-3837-4a31-855b-75f1a2da39a5 tempest-VolumesListAdminTestJSON-1678532964 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:27:21 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-f1bd02e0-3837-4a31-855b-75f1a2da39a5 tempest-VolumesListAdminTestJSON-1678532964 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:27:21Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ce2bc25-cba7-40ad-804b-cf9c83f28177,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a740d11ea85a426298907ef490bdcfe2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:27:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:27:22Z,use_quota=True,user_id='4d6f9389215042c3984d153450727f74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:27:21 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-f1bd02e0-3837-4a31-855b-75f1a2da39a5 tempest-VolumesListAdminTestJSON-1678532964 None] Creating volume 8ce2bc25-cba7-40ad-804b-cf9c83f28177 {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:27:21 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-f1bd02e0-3837-4a31-855b-75f1a2da39a5 tempest-VolumesListAdminTestJSON-1678532964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:27:21 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-f1bd02e0-3837-4a31-855b-75f1a2da39a5 tempest-VolumesListAdminTestJSON-1678532964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:27:21 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-f1bd02e0-3837-4a31-855b-75f1a2da39a5 tempest-VolumesListAdminTestJSON-1678532964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:27:22 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-f1bd02e0-3837-4a31-855b-75f1a2da39a5 tempest-VolumesListAdminTestJSON-1678532964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:27:22 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-f1bd02e0-3837-4a31-855b-75f1a2da39a5 tempest-VolumesListAdminTestJSON-1678532964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:27:22 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-f1bd02e0-3837-4a31-855b-75f1a2da39a5 tempest-VolumesListAdminTestJSON-1678532964 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:27:22 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-f1bd02e0-3837-4a31-855b-75f1a2da39a5 tempest-VolumesListAdminTestJSON-1678532964 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:27:22 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f1bd02e0-3837-4a31-855b-75f1a2da39a5 tempest-VolumesListAdminTestJSON-1678532964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-8ce2bc25-cba7-40ad-804b-cf9c83f28177 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:22 devstack sudo[98012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-8ce2bc25-cba7-40ad-804b-cf9c83f28177 1073741824 Sep 16 20:27:22 devstack sudo[98012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:22 devstack sudo[98010]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:22 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-673c4a79-54ff-4c40-97a2-d8565cbe0258 tempest-VolumesTransfersV357Test-2119510101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.346s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:22 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-673c4a79-54ff-4c40-97a2-d8565cbe0258 tempest-VolumesTransfersV357Test-2119510101 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:27:22 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-673c4a79-54ff-4c40-97a2-d8565cbe0258 tempest-VolumesTransfersV357Test-2119510101 None] Deleted volume successfully. Sep 16 20:27:22 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-673c4a79-54ff-4c40-97a2-d8565cbe0258 tempest-VolumesTransfersV357Test-2119510101 None] Lock "cinder-e26a8401-71fd-4c60-84a3-d2fc6be1f061-delete_volume" released by "delete_volume" :: held 1.619s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:27:22 devstack sudo[98012]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:22 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f1bd02e0-3837-4a31-855b-75f1a2da39a5 tempest-VolumesListAdminTestJSON-1678532964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-8ce2bc25-cba7-40ad-804b-cf9c83f28177 1073741824" returned: 0 in 0.531s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:22 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f1bd02e0-3837-4a31-855b-75f1a2da39a5 tempest-VolumesListAdminTestJSON-1678532964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-8ce2bc25-cba7-40ad-804b-cf9c83f28177 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:22 devstack sudo[98019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-8ce2bc25-cba7-40ad-804b-cf9c83f28177 Sep 16 20:27:22 devstack sudo[98019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:22 devstack sudo[98019]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:22 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f1bd02e0-3837-4a31-855b-75f1a2da39a5 tempest-VolumesListAdminTestJSON-1678532964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-8ce2bc25-cba7-40ad-804b-cf9c83f28177" returned: 0 in 0.298s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:22 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-f1bd02e0-3837-4a31-855b-75f1a2da39a5 tempest-VolumesListAdminTestJSON-1678532964 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:27:22 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-f1bd02e0-3837-4a31-855b-75f1a2da39a5 tempest-VolumesListAdminTestJSON-1678532964 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.899s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:27:22 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f1bd02e0-3837-4a31-855b-75f1a2da39a5 tempest-VolumesListAdminTestJSON-1678532964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22756529-3a1f-446f-87db-e446351c87f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ce2bc25-cba7-40ad-804b-cf9c83f28177', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:22 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f1bd02e0-3837-4a31-855b-75f1a2da39a5 tempest-VolumesListAdminTestJSON-1678532964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4e61c90-3eb1-48ef-9f67-9dc52a0637de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:22 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-f1bd02e0-3837-4a31-855b-75f1a2da39a5 tempest-VolumesListAdminTestJSON-1678532964 None] Volume volume-8ce2bc25-cba7-40ad-804b-cf9c83f28177 (8ce2bc25-cba7-40ad-804b-cf9c83f28177): created successfully Sep 16 20:27:22 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f1bd02e0-3837-4a31-855b-75f1a2da39a5 tempest-VolumesListAdminTestJSON-1678532964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4e61c90-3eb1-48ef-9f67-9dc52a0637de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:22 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f1bd02e0-3837-4a31-855b-75f1a2da39a5 tempest-VolumesListAdminTestJSON-1678532964 None] Flow 'volume_create_manager' (eaca9410-a547-4c07-b509-aa805d19daca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:27:22 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-f1bd02e0-3837-4a31-855b-75f1a2da39a5 tempest-VolumesListAdminTestJSON-1678532964 None] Created volume successfully. Sep 16 20:27:24 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-6ff145b5-2a2b-40f6-83fa-bf5a047b25d2 tempest-VolumesListAdminTestJSON-1678532964 None] Acquiring lock "cinder-8ce2bc25-cba7-40ad-804b-cf9c83f28177-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:27:24 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-6ff145b5-2a2b-40f6-83fa-bf5a047b25d2 tempest-VolumesListAdminTestJSON-1678532964 None] Lock "cinder-8ce2bc25-cba7-40ad-804b-cf9c83f28177-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:27:24 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-6ff145b5-2a2b-40f6-83fa-bf5a047b25d2 tempest-VolumesListAdminTestJSON-1678532964 None] Acquiring lock "cinder-quobyte-8ce2bc25-cba7-40ad-804b-cf9c83f28177" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:27:24 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-6ff145b5-2a2b-40f6-83fa-bf5a047b25d2 tempest-VolumesListAdminTestJSON-1678532964 None] Lock "cinder-quobyte-8ce2bc25-cba7-40ad-804b-cf9c83f28177" acquired by "delete_volume" :: waited 0.027s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:27:24 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8b37f7a-446c-4b12-a440-a161628fceab]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:27:24 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-6ff145b5-2a2b-40f6-83fa-bf5a047b25d2 tempest-VolumesListAdminTestJSON-1678532964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-8ce2bc25-cba7-40ad-804b-cf9c83f28177 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:24 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-fac016e9-4bc7-4a88-b717-884418be7494 tempest-VolumesListAdminTestJSON-323842265 None] Acquiring lock "cinder-bd7c1127-a7c2-4ebc-8d37-e07d5d080eb5-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:27:24 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-fac016e9-4bc7-4a88-b717-884418be7494 tempest-VolumesListAdminTestJSON-323842265 None] Lock "cinder-bd7c1127-a7c2-4ebc-8d37-e07d5d080eb5-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:27:24 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-fac016e9-4bc7-4a88-b717-884418be7494 tempest-VolumesListAdminTestJSON-323842265 None] Acquiring lock "cinder-quobyte-bd7c1127-a7c2-4ebc-8d37-e07d5d080eb5" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:27:24 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-fac016e9-4bc7-4a88-b717-884418be7494 tempest-VolumesListAdminTestJSON-323842265 None] Lock "cinder-quobyte-bd7c1127-a7c2-4ebc-8d37-e07d5d080eb5" acquired by "delete_volume" :: waited 0.018s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:27:24 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[341e9b77-2397-43cd-abe3-b811e45b4e0b]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:27:24 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-fac016e9-4bc7-4a88-b717-884418be7494 tempest-VolumesListAdminTestJSON-323842265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-bd7c1127-a7c2-4ebc-8d37-e07d5d080eb5 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:24 devstack sudo[98022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-8ce2bc25-cba7-40ad-804b-cf9c83f28177 Sep 16 20:27:24 devstack sudo[98022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:24 devstack sudo[98023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-bd7c1127-a7c2-4ebc-8d37-e07d5d080eb5 Sep 16 20:27:24 devstack sudo[98023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:24 devstack sudo[98022]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:24 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-6ff145b5-2a2b-40f6-83fa-bf5a047b25d2 tempest-VolumesListAdminTestJSON-1678532964 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-8ce2bc25-cba7-40ad-804b-cf9c83f28177" returned: 0 in 0.504s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:24 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-6ff145b5-2a2b-40f6-83fa-bf5a047b25d2 tempest-VolumesListAdminTestJSON-1678532964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-8ce2bc25-cba7-40ad-804b-cf9c83f28177 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:24 devstack sudo[98030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-8ce2bc25-cba7-40ad-804b-cf9c83f28177 Sep 16 20:27:24 devstack sudo[98030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:24 devstack sudo[98023]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:24 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-fac016e9-4bc7-4a88-b717-884418be7494 tempest-VolumesListAdminTestJSON-323842265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-bd7c1127-a7c2-4ebc-8d37-e07d5d080eb5" returned: 0 in 0.461s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:24 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-fac016e9-4bc7-4a88-b717-884418be7494 tempest-VolumesListAdminTestJSON-323842265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-bd7c1127-a7c2-4ebc-8d37-e07d5d080eb5 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:24 devstack sudo[98035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-bd7c1127-a7c2-4ebc-8d37-e07d5d080eb5 Sep 16 20:27:24 devstack sudo[98035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:24 devstack sudo[98030]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:24 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-6ff145b5-2a2b-40f6-83fa-bf5a047b25d2 tempest-VolumesListAdminTestJSON-1678532964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-8ce2bc25-cba7-40ad-804b-cf9c83f28177" returned: 0 in 0.332s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:25 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-6ff145b5-2a2b-40f6-83fa-bf5a047b25d2 tempest-VolumesListAdminTestJSON-1678532964 None] Lock "cinder-quobyte-8ce2bc25-cba7-40ad-804b-cf9c83f28177" released by "delete_volume" :: held 0.894s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:27:25 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-6ff145b5-2a2b-40f6-83fa-bf5a047b25d2 tempest-VolumesListAdminTestJSON-1678532964 None] Created reservations ['101866bf-dcbc-4ee9-aa66-23bd0242ec9c', 'e67240f1-f2ce-49b4-a620-8123af7db701', '56455110-e8a5-4b4c-a2e8-c5f31521b580', 'd1cc7093-029c-4550-8ae4-113efd389b4f'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:27:25 devstack sudo[98035]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:25 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-fac016e9-4bc7-4a88-b717-884418be7494 tempest-VolumesListAdminTestJSON-323842265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-bd7c1127-a7c2-4ebc-8d37-e07d5d080eb5" returned: 0 in 0.384s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:25 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-fac016e9-4bc7-4a88-b717-884418be7494 tempest-VolumesListAdminTestJSON-323842265 None] Lock "cinder-quobyte-bd7c1127-a7c2-4ebc-8d37-e07d5d080eb5" released by "delete_volume" :: held 0.924s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:27:25 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-6ff145b5-2a2b-40f6-83fa-bf5a047b25d2 tempest-VolumesListAdminTestJSON-1678532964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:27:25 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-6ff145b5-2a2b-40f6-83fa-bf5a047b25d2 tempest-VolumesListAdminTestJSON-1678532964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:27:25 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-6ff145b5-2a2b-40f6-83fa-bf5a047b25d2 tempest-VolumesListAdminTestJSON-1678532964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:27:25 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-6ff145b5-2a2b-40f6-83fa-bf5a047b25d2 tempest-VolumesListAdminTestJSON-1678532964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:27:25 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-6ff145b5-2a2b-40f6-83fa-bf5a047b25d2 tempest-VolumesListAdminTestJSON-1678532964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:27:25 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-6ff145b5-2a2b-40f6-83fa-bf5a047b25d2 tempest-VolumesListAdminTestJSON-1678532964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:25 devstack sudo[98039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:27:25 devstack sudo[98039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:25 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-fac016e9-4bc7-4a88-b717-884418be7494 tempest-VolumesListAdminTestJSON-323842265 None] Created reservations ['99600586-9e20-4c4d-b01c-cb2cd5f38c37', '665d4a2a-dd4e-4e63-92f4-aa89ccc4d144', '5c268060-8e8a-45e9-a4c8-93980157e014', 'acc6cfdd-4152-4d58-a385-71c609375667'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:27:25 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-fac016e9-4bc7-4a88-b717-884418be7494 tempest-VolumesListAdminTestJSON-323842265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:27:25 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-fac016e9-4bc7-4a88-b717-884418be7494 tempest-VolumesListAdminTestJSON-323842265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:27:25 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-fac016e9-4bc7-4a88-b717-884418be7494 tempest-VolumesListAdminTestJSON-323842265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:27:25 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-fac016e9-4bc7-4a88-b717-884418be7494 tempest-VolumesListAdminTestJSON-323842265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:27:25 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-fac016e9-4bc7-4a88-b717-884418be7494 tempest-VolumesListAdminTestJSON-323842265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:27:25 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-fac016e9-4bc7-4a88-b717-884418be7494 tempest-VolumesListAdminTestJSON-323842265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:25 devstack sudo[98041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:27:25 devstack sudo[98041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:25 devstack sudo[98039]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:25 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-6ff145b5-2a2b-40f6-83fa-bf5a047b25d2 tempest-VolumesListAdminTestJSON-1678532964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.399s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:25 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-6ff145b5-2a2b-40f6-83fa-bf5a047b25d2 tempest-VolumesListAdminTestJSON-1678532964 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:27:25 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-6ff145b5-2a2b-40f6-83fa-bf5a047b25d2 tempest-VolumesListAdminTestJSON-1678532964 None] Deleted volume successfully. Sep 16 20:27:25 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-6ff145b5-2a2b-40f6-83fa-bf5a047b25d2 tempest-VolumesListAdminTestJSON-1678532964 None] Lock "cinder-8ce2bc25-cba7-40ad-804b-cf9c83f28177-delete_volume" released by "delete_volume" :: held 1.718s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:27:25 devstack sudo[98041]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:25 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-fac016e9-4bc7-4a88-b717-884418be7494 tempest-VolumesListAdminTestJSON-323842265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.321s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:25 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-fac016e9-4bc7-4a88-b717-884418be7494 tempest-VolumesListAdminTestJSON-323842265 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:27:25 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-fac016e9-4bc7-4a88-b717-884418be7494 tempest-VolumesListAdminTestJSON-323842265 None] Deleted volume successfully. Sep 16 20:27:25 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-fac016e9-4bc7-4a88-b717-884418be7494 tempest-VolumesListAdminTestJSON-323842265 None] Lock "cinder-bd7c1127-a7c2-4ebc-8d37-e07d5d080eb5-delete_volume" released by "delete_volume" :: held 1.640s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:27:26 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-6bf9660d-e419-4da5-a622-f824223d988d tempest-VolumesListAdminTestJSON-323842265 None] Acquiring lock "cinder-e1eafafe-bcae-4a08-9d0f-b395877fcb7c-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:27:26 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-6bf9660d-e419-4da5-a622-f824223d988d tempest-VolumesListAdminTestJSON-323842265 None] Lock "cinder-e1eafafe-bcae-4a08-9d0f-b395877fcb7c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:27:26 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-6bf9660d-e419-4da5-a622-f824223d988d tempest-VolumesListAdminTestJSON-323842265 None] Acquiring lock "cinder-quobyte-e1eafafe-bcae-4a08-9d0f-b395877fcb7c" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:27:26 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-6bf9660d-e419-4da5-a622-f824223d988d tempest-VolumesListAdminTestJSON-323842265 None] Lock "cinder-quobyte-e1eafafe-bcae-4a08-9d0f-b395877fcb7c" acquired by "delete_volume" :: waited 0.024s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:27:26 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b787802-3c71-489c-ac48-e7f3f2b8274d]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:27:26 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-6bf9660d-e419-4da5-a622-f824223d988d tempest-VolumesListAdminTestJSON-323842265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e1eafafe-bcae-4a08-9d0f-b395877fcb7c {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:26 devstack sudo[98045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e1eafafe-bcae-4a08-9d0f-b395877fcb7c Sep 16 20:27:26 devstack sudo[98045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:27 devstack sudo[98045]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:27 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-6bf9660d-e419-4da5-a622-f824223d988d tempest-VolumesListAdminTestJSON-323842265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e1eafafe-bcae-4a08-9d0f-b395877fcb7c" returned: 0 in 0.590s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:27 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-6bf9660d-e419-4da5-a622-f824223d988d tempest-VolumesListAdminTestJSON-323842265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e1eafafe-bcae-4a08-9d0f-b395877fcb7c {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:27 devstack sudo[98051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e1eafafe-bcae-4a08-9d0f-b395877fcb7c Sep 16 20:27:27 devstack sudo[98051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:27 devstack sudo[98051]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:27 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-6bf9660d-e419-4da5-a622-f824223d988d tempest-VolumesListAdminTestJSON-323842265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e1eafafe-bcae-4a08-9d0f-b395877fcb7c" returned: 0 in 0.298s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:27 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-6bf9660d-e419-4da5-a622-f824223d988d tempest-VolumesListAdminTestJSON-323842265 None] Lock "cinder-quobyte-e1eafafe-bcae-4a08-9d0f-b395877fcb7c" released by "delete_volume" :: held 0.943s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:27:27 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-6bf9660d-e419-4da5-a622-f824223d988d tempest-VolumesListAdminTestJSON-323842265 None] Created reservations ['ea1568d5-1ebf-40d7-8ec0-def1a0f41203', 'f0e7fead-b18a-4844-850e-d662bde0901b', '98eceb11-d581-46a3-91d3-d63a8b428913', '3ab66cfd-c59a-444b-8a55-83eea98765af'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:27:27 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-6bf9660d-e419-4da5-a622-f824223d988d tempest-VolumesListAdminTestJSON-323842265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:27:27 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-6bf9660d-e419-4da5-a622-f824223d988d tempest-VolumesListAdminTestJSON-323842265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:27:27 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-6bf9660d-e419-4da5-a622-f824223d988d tempest-VolumesListAdminTestJSON-323842265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:27:27 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-6bf9660d-e419-4da5-a622-f824223d988d tempest-VolumesListAdminTestJSON-323842265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:27:27 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-6bf9660d-e419-4da5-a622-f824223d988d tempest-VolumesListAdminTestJSON-323842265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:27:27 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-6bf9660d-e419-4da5-a622-f824223d988d tempest-VolumesListAdminTestJSON-323842265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:27 devstack sudo[98054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:27:27 devstack sudo[98054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:28 devstack sudo[98054]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:28 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-6bf9660d-e419-4da5-a622-f824223d988d tempest-VolumesListAdminTestJSON-323842265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.305s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:28 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-6bf9660d-e419-4da5-a622-f824223d988d tempest-VolumesListAdminTestJSON-323842265 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:27:28 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-6bf9660d-e419-4da5-a622-f824223d988d tempest-VolumesListAdminTestJSON-323842265 None] Deleted volume successfully. Sep 16 20:27:28 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-6bf9660d-e419-4da5-a622-f824223d988d tempest-VolumesListAdminTestJSON-323842265 None] Lock "cinder-e1eafafe-bcae-4a08-9d0f-b395877fcb7c-delete_volume" released by "delete_volume" :: held 1.545s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:27:28 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-85b9b35a-4d71-4256-a1d0-0260077dfb5e tempest-VolumesTransfersTest-1220370370 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:27:28 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-85b9b35a-4d71-4256-a1d0-0260077dfb5e tempest-VolumesTransfersTest-1220370370 None] Flow 'volume_create_manager' (ef9d94ef-f98f-456b-99fb-e2a5a76d89e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:27:28 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-85b9b35a-4d71-4256-a1d0-0260077dfb5e tempest-VolumesTransfersTest-1220370370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95fed45d-bcd9-41e0-b338-fe2ae0998b05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:28 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-85b9b35a-4d71-4256-a1d0-0260077dfb5e tempest-VolumesTransfersTest-1220370370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95fed45d-bcd9-41e0-b338-fe2ae0998b05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:27:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-140062772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0937c497-2a8d-42e8-b596-f198e1454537,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd3158fc7f554d6db80f9326908ce0df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:27:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:27:28Z,use_quota=True,user_id='32f65c55db0244f0bbf92242b2e5d499',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:28 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-85b9b35a-4d71-4256-a1d0-0260077dfb5e tempest-VolumesTransfersTest-1220370370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54f846f4-0cb5-42f6-a132-29ce49985af8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:28 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-85b9b35a-4d71-4256-a1d0-0260077dfb5e tempest-VolumesTransfersTest-1220370370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54f846f4-0cb5-42f6-a132-29ce49985af8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:28 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-85b9b35a-4d71-4256-a1d0-0260077dfb5e tempest-VolumesTransfersTest-1220370370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9859b7d2-6d89-4a2f-95dc-83647ab8a983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:28 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-85b9b35a-4d71-4256-a1d0-0260077dfb5e tempest-VolumesTransfersTest-1220370370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9859b7d2-6d89-4a2f-95dc-83647ab8a983) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0937c497-2a8d-42e8-b596-f198e1454537', 'volume_name': 'volume-0937c497-2a8d-42e8-b596-f198e1454537', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:28 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-85b9b35a-4d71-4256-a1d0-0260077dfb5e tempest-VolumesTransfersTest-1220370370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ae342a2-88b0-4acf-a08f-2a1f86641e8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:28 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-85b9b35a-4d71-4256-a1d0-0260077dfb5e tempest-VolumesTransfersTest-1220370370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ae342a2-88b0-4acf-a08f-2a1f86641e8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:28 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-85b9b35a-4d71-4256-a1d0-0260077dfb5e tempest-VolumesTransfersTest-1220370370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (246504ff-1076-4594-b273-41486a1156bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:28 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-85b9b35a-4d71-4256-a1d0-0260077dfb5e tempest-VolumesTransfersTest-1220370370 None] Volume 0937c497-2a8d-42e8-b596-f198e1454537: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0937c497-2a8d-42e8-b596-f198e1454537', 'volume_size': 1} Sep 16 20:27:28 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-85b9b35a-4d71-4256-a1d0-0260077dfb5e tempest-VolumesTransfersTest-1220370370 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:27:28 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-85b9b35a-4d71-4256-a1d0-0260077dfb5e tempest-VolumesTransfersTest-1220370370 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:27:28 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-85b9b35a-4d71-4256-a1d0-0260077dfb5e tempest-VolumesTransfersTest-1220370370 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:27:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-140062772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0937c497-2a8d-42e8-b596-f198e1454537,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd3158fc7f554d6db80f9326908ce0df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:27:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:27:28Z,use_quota=True,user_id='32f65c55db0244f0bbf92242b2e5d499',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:27:28 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-85b9b35a-4d71-4256-a1d0-0260077dfb5e tempest-VolumesTransfersTest-1220370370 None] Creating volume 0937c497-2a8d-42e8-b596-f198e1454537 {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:27:28 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-85b9b35a-4d71-4256-a1d0-0260077dfb5e tempest-VolumesTransfersTest-1220370370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:27:28 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-85b9b35a-4d71-4256-a1d0-0260077dfb5e tempest-VolumesTransfersTest-1220370370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:27:28 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-85b9b35a-4d71-4256-a1d0-0260077dfb5e tempest-VolumesTransfersTest-1220370370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:27:28 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-85b9b35a-4d71-4256-a1d0-0260077dfb5e tempest-VolumesTransfersTest-1220370370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:27:28 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-85b9b35a-4d71-4256-a1d0-0260077dfb5e tempest-VolumesTransfersTest-1220370370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:27:28 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-85b9b35a-4d71-4256-a1d0-0260077dfb5e tempest-VolumesTransfersTest-1220370370 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:27:28 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-85b9b35a-4d71-4256-a1d0-0260077dfb5e tempest-VolumesTransfersTest-1220370370 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:27:28 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-85b9b35a-4d71-4256-a1d0-0260077dfb5e tempest-VolumesTransfersTest-1220370370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-0937c497-2a8d-42e8-b596-f198e1454537 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:28 devstack sudo[98057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-0937c497-2a8d-42e8-b596-f198e1454537 1073741824 Sep 16 20:27:28 devstack sudo[98057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:28 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-7e58104c-591c-49b0-8f28-c498e556896d tempest-VolumesListAdminTestJSON-323842265 None] Acquiring lock "cinder-9f8bbd1a-06dc-45cc-882a-8f967a95c38c-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:27:29 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-7e58104c-591c-49b0-8f28-c498e556896d tempest-VolumesListAdminTestJSON-323842265 None] Lock "cinder-9f8bbd1a-06dc-45cc-882a-8f967a95c38c-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:27:29 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-7e58104c-591c-49b0-8f28-c498e556896d tempest-VolumesListAdminTestJSON-323842265 None] Acquiring lock "cinder-quobyte-9f8bbd1a-06dc-45cc-882a-8f967a95c38c" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:27:29 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-7e58104c-591c-49b0-8f28-c498e556896d tempest-VolumesListAdminTestJSON-323842265 None] Lock "cinder-quobyte-9f8bbd1a-06dc-45cc-882a-8f967a95c38c" acquired by "delete_volume" :: waited 0.029s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:27:29 devstack sudo[98057]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:29 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-85b9b35a-4d71-4256-a1d0-0260077dfb5e tempest-VolumesTransfersTest-1220370370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-0937c497-2a8d-42e8-b596-f198e1454537 1073741824" returned: 0 in 0.600s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:29 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[a950ef91-8b0c-4093-855d-4fcecb2fd55b]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:27:29 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-7e58104c-591c-49b0-8f28-c498e556896d tempest-VolumesListAdminTestJSON-323842265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9f8bbd1a-06dc-45cc-882a-8f967a95c38c {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:29 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-85b9b35a-4d71-4256-a1d0-0260077dfb5e tempest-VolumesTransfersTest-1220370370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-0937c497-2a8d-42e8-b596-f198e1454537 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:29 devstack sudo[98065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-0937c497-2a8d-42e8-b596-f198e1454537 Sep 16 20:27:29 devstack sudo[98065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:29 devstack sudo[98064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9f8bbd1a-06dc-45cc-882a-8f967a95c38c Sep 16 20:27:29 devstack sudo[98064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:29 devstack sudo[98065]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:29 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-85b9b35a-4d71-4256-a1d0-0260077dfb5e tempest-VolumesTransfersTest-1220370370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-0937c497-2a8d-42e8-b596-f198e1454537" returned: 0 in 0.398s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:29 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-85b9b35a-4d71-4256-a1d0-0260077dfb5e tempest-VolumesTransfersTest-1220370370 None] <== create_volume: return (1067ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:27:29 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-85b9b35a-4d71-4256-a1d0-0260077dfb5e tempest-VolumesTransfersTest-1220370370 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.071s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:27:29 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-85b9b35a-4d71-4256-a1d0-0260077dfb5e tempest-VolumesTransfersTest-1220370370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (246504ff-1076-4594-b273-41486a1156bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0937c497-2a8d-42e8-b596-f198e1454537', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:29 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-85b9b35a-4d71-4256-a1d0-0260077dfb5e tempest-VolumesTransfersTest-1220370370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7402db58-6b25-4186-9abd-be964f7fd586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:29 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-85b9b35a-4d71-4256-a1d0-0260077dfb5e tempest-VolumesTransfersTest-1220370370 None] Volume volume-0937c497-2a8d-42e8-b596-f198e1454537 (0937c497-2a8d-42e8-b596-f198e1454537): created successfully Sep 16 20:27:29 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-85b9b35a-4d71-4256-a1d0-0260077dfb5e tempest-VolumesTransfersTest-1220370370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7402db58-6b25-4186-9abd-be964f7fd586) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:29 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-85b9b35a-4d71-4256-a1d0-0260077dfb5e tempest-VolumesTransfersTest-1220370370 None] Flow 'volume_create_manager' (ef9d94ef-f98f-456b-99fb-e2a5a76d89e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:27:29 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-85b9b35a-4d71-4256-a1d0-0260077dfb5e tempest-VolumesTransfersTest-1220370370 None] Created volume successfully. Sep 16 20:27:29 devstack sudo[98064]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:29 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-7e58104c-591c-49b0-8f28-c498e556896d tempest-VolumesListAdminTestJSON-323842265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9f8bbd1a-06dc-45cc-882a-8f967a95c38c" returned: 0 in 0.581s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:29 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-7e58104c-591c-49b0-8f28-c498e556896d tempest-VolumesListAdminTestJSON-323842265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9f8bbd1a-06dc-45cc-882a-8f967a95c38c {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:29 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-905a2043-1199-4120-a37c-ae7cda875e53 tempest-VolumeImageDependencyTests-1758208657 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:27:29 devstack sudo[98072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9f8bbd1a-06dc-45cc-882a-8f967a95c38c Sep 16 20:27:29 devstack sudo[98072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:29 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-905a2043-1199-4120-a37c-ae7cda875e53 tempest-VolumeImageDependencyTests-1758208657 None] Flow 'volume_create_manager' (170e1b25-1088-4c42-8630-fdae98cbcbb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:27:29 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-905a2043-1199-4120-a37c-ae7cda875e53 tempest-VolumeImageDependencyTests-1758208657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92ea6f96-ace8-4d91-b441-64a41087a65e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:29 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-905a2043-1199-4120-a37c-ae7cda875e53 tempest-VolumeImageDependencyTests-1758208657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92ea6f96-ace8-4d91-b441-64a41087a65e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:27:29Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9568186c-2e2f-43af-81af-1c2e47eb0308,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='695f6e7cd94845f3b482a3a94857b5d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:27:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:27:30Z,use_quota=True,user_id='539e19b17c9c4348be9e8bf5cfdba4cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:29 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-905a2043-1199-4120-a37c-ae7cda875e53 tempest-VolumeImageDependencyTests-1758208657 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1706330-205b-4103-9a80-bda768b65b61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:29 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-905a2043-1199-4120-a37c-ae7cda875e53 tempest-VolumeImageDependencyTests-1758208657 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1706330-205b-4103-9a80-bda768b65b61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:29 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-905a2043-1199-4120-a37c-ae7cda875e53 tempest-VolumeImageDependencyTests-1758208657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac1110a9-5019-42eb-9afe-fd391dc74103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:29 devstack cinder-volume[86188]: DEBUG cinder.image.glance [None req-905a2043-1199-4120-a37c-ae7cda875e53 tempest-VolumeImageDependencyTests-1758208657 None] Creating Keystone auth plugin from conf {{(pid=86188) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 16 20:27:29 devstack sudo[98072]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:29 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-7e58104c-591c-49b0-8f28-c498e556896d tempest-VolumesListAdminTestJSON-323842265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9f8bbd1a-06dc-45cc-882a-8f967a95c38c" returned: 0 in 0.262s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:30 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-7e58104c-591c-49b0-8f28-c498e556896d tempest-VolumesListAdminTestJSON-323842265 None] Lock "cinder-quobyte-9f8bbd1a-06dc-45cc-882a-8f967a95c38c" released by "delete_volume" :: held 0.909s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:27:30 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-7e58104c-591c-49b0-8f28-c498e556896d tempest-VolumesListAdminTestJSON-323842265 None] Created reservations ['00ef08af-db3b-4d0d-8e49-e6c2d0b74e40', '86d87979-2fcd-47ea-8e1a-d625d405dc1c', '8410cc8c-cf3b-4ad1-9da1-ab62bd9a9bb8', 'eea46f51-f46f-4196-99ae-2b2bb73059f1'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:27:30 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-7e58104c-591c-49b0-8f28-c498e556896d tempest-VolumesListAdminTestJSON-323842265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:27:30 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-7e58104c-591c-49b0-8f28-c498e556896d tempest-VolumesListAdminTestJSON-323842265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:27:30 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-7e58104c-591c-49b0-8f28-c498e556896d tempest-VolumesListAdminTestJSON-323842265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:27:30 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-7e58104c-591c-49b0-8f28-c498e556896d tempest-VolumesListAdminTestJSON-323842265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:27:30 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-7e58104c-591c-49b0-8f28-c498e556896d tempest-VolumesListAdminTestJSON-323842265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:27:30 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-7e58104c-591c-49b0-8f28-c498e556896d tempest-VolumesListAdminTestJSON-323842265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:30 devstack sudo[98075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:27:30 devstack sudo[98075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:30 devstack sudo[98075]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:30 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-7e58104c-591c-49b0-8f28-c498e556896d tempest-VolumesListAdminTestJSON-323842265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.272s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:30 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-7e58104c-591c-49b0-8f28-c498e556896d tempest-VolumesListAdminTestJSON-323842265 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:27:30 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-7e58104c-591c-49b0-8f28-c498e556896d tempest-VolumesListAdminTestJSON-323842265 None] Deleted volume successfully. Sep 16 20:27:30 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-7e58104c-591c-49b0-8f28-c498e556896d tempest-VolumesListAdminTestJSON-323842265 None] Lock "cinder-9f8bbd1a-06dc-45cc-882a-8f967a95c38c-delete_volume" released by "delete_volume" :: held 1.456s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:27:30 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-905a2043-1199-4120-a37c-ae7cda875e53 tempest-VolumeImageDependencyTests-1758208657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac1110a9-5019-42eb-9afe-fd391dc74103) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9568186c-2e2f-43af-81af-1c2e47eb0308', 'volume_name': 'volume-9568186c-2e2f-43af-81af-1c2e47eb0308', 'volume_size': 1, 'image_id': '16d5d1f4-d777-4ead-8dbe-dd99285e9af3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/16d5d1f4-d777-4ead-8dbe-dd99285e9af3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9a87e11cfa320bd587fbfc425712f67e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '695f6e7cd94845f3b482a3a94857b5d8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '172d6fc27e0580be5faed53ae2a63169d4819ef3fb4fa475e3eef50d88c6fb1fdf39c8135c82c9aec9ed9c1bf813fcc6e32b6ad900bb21b13e4624a1f0d400cc', 'id': '16d5d1f4-d777-4ead-8dbe-dd99285e9af3', 'created_at': datetime.datetime(2026, 9, 16, 18, 27, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 18, 27, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/16d5d1f4-d777-4ead-8dbe-dd99285e9af3/file', 'properties': {}}, 'image_service': }' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:30 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-905a2043-1199-4120-a37c-ae7cda875e53 tempest-VolumeImageDependencyTests-1758208657 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0ab1cf5-16d5-47cf-ba48-c2d6a97b7bb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:30 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-905a2043-1199-4120-a37c-ae7cda875e53 tempest-VolumeImageDependencyTests-1758208657 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0ab1cf5-16d5-47cf-ba48-c2d6a97b7bb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:30 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-905a2043-1199-4120-a37c-ae7cda875e53 tempest-VolumeImageDependencyTests-1758208657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dc3a43d-38cd-4306-bc83-5a8d78dd7f72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:30 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-905a2043-1199-4120-a37c-ae7cda875e53 tempest-VolumeImageDependencyTests-1758208657 None] Volume 9568186c-2e2f-43af-81af-1c2e47eb0308: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9568186c-2e2f-43af-81af-1c2e47eb0308', 'volume_size': 1, 'image_id': '16d5d1f4-d777-4ead-8dbe-dd99285e9af3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/16d5d1f4-d777-4ead-8dbe-dd99285e9af3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9a87e11cfa320bd587fbfc425712f67e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '695f6e7cd94845f3b482a3a94857b5d8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '172d6fc27e0580be5faed53ae2a63169d4819ef3fb4fa475e3eef50d88c6fb1fdf39c8135c82c9aec9ed9c1bf813fcc6e32b6ad900bb21b13e4624a1f0d400cc', 'id': '16d5d1f4-d777-4ead-8dbe-dd99285e9af3', 'created_at': datetime.datetime(2026, 9, 16, 18, 27, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 18, 27, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/16d5d1f4-d777-4ead-8dbe-dd99285e9af3/file', 'properties': {}}, 'image_service': } Sep 16 20:27:30 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-905a2043-1199-4120-a37c-ae7cda875e53 tempest-VolumeImageDependencyTests-1758208657 None] Trying to clone 9568186c-2e2f-43af-81af-1c2e47eb0308 from image 16d5d1f4-d777-4ead-8dbe-dd99285e9af3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/16d5d1f4-d777-4ead-8dbe-dd99285e9af3', 'metadata': {}}]). {{(pid=86188) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 16 20:27:30 devstack cinder-volume[86188]: DEBUG cinder.image.image_utils [None req-905a2043-1199-4120-a37c-ae7cda875e53 tempest-VolumeImageDependencyTests-1758208657 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_16d5d1f4-d777-4ead-8dbe-dd99285e9af3_ixs2gxcvdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86188) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 16 20:27:30 devstack cinder-volume[86188]: INFO cinder.image.image_utils [None req-905a2043-1199-4120-a37c-ae7cda875e53 tempest-VolumeImageDependencyTests-1758208657 None] Image download 0.00 MB at 0.00 MB/s Sep 16 20:27:30 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[44e20ec0-f296-4589-b27f-69cd12b4978e]: (4, 'raw') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:27:30 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-905a2043-1199-4120-a37c-ae7cda875e53 tempest-VolumeImageDependencyTests-1758208657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_16d5d1f4-d777-4ead-8dbe-dd99285e9af3_ixs2gxcvdevstack@QuobyteHD {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:30 devstack sudo[98079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_16d5d1f4-d777-4ead-8dbe-dd99285e9af3_ixs2gxcvdevstack@QuobyteHD Sep 16 20:27:30 devstack sudo[98079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:31 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-905a2043-1199-4120-a37c-ae7cda875e53 tempest-VolumeImageDependencyTests-1758208657 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_16d5d1f4-d777-4ead-8dbe-dd99285e9af3_ixs2gxcvdevstack@QuobyteHD" returned: 0 in 0.369s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:31 devstack sudo[98079]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:31 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-905a2043-1199-4120-a37c-ae7cda875e53 tempest-VolumeImageDependencyTests-1758208657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_16d5d1f4-d777-4ead-8dbe-dd99285e9af3_ixs2gxcvdevstack@QuobyteHD {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:31 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-3fb8147b-53df-45bb-939b-86317b9d332c tempest-VolumesCloneTest-1349547352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:27:31 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-3fb8147b-53df-45bb-939b-86317b9d332c tempest-VolumesCloneTest-1349547352 None] Flow 'volume_create_manager' (5eef3418-f742-450d-8c9b-12aad6d083ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:27:31 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-3fb8147b-53df-45bb-939b-86317b9d332c tempest-VolumesCloneTest-1349547352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58f5a172-24db-4624-9c3e-486b0c2210f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:31 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-3fb8147b-53df-45bb-939b-86317b9d332c tempest-VolumesCloneTest-1349547352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58f5a172-24db-4624-9c3e-486b0c2210f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:27:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1087976787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=094fcf71-d1a3-4197-81e4-600e7f665c3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdd01eb5d0614639b281814a9d07f1f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:27:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:27:31Z,use_quota=True,user_id='b33d6d47388641578df2207639d1f0e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:31 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-3fb8147b-53df-45bb-939b-86317b9d332c tempest-VolumesCloneTest-1349547352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac6dc70f-2f21-4596-b2d7-eaf999ba162a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:31 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-3fb8147b-53df-45bb-939b-86317b9d332c tempest-VolumesCloneTest-1349547352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac6dc70f-2f21-4596-b2d7-eaf999ba162a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:31 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-3fb8147b-53df-45bb-939b-86317b9d332c tempest-VolumesCloneTest-1349547352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d0b4587-6655-426e-a777-973b72b4a1ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:31 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-3fb8147b-53df-45bb-939b-86317b9d332c tempest-VolumesCloneTest-1349547352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d0b4587-6655-426e-a777-973b72b4a1ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '094fcf71-d1a3-4197-81e4-600e7f665c3c', 'volume_name': 'volume-094fcf71-d1a3-4197-81e4-600e7f665c3c', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:31 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-3fb8147b-53df-45bb-939b-86317b9d332c tempest-VolumesCloneTest-1349547352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9eb4ed9e-1664-4a29-ae24-1c23132c259d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:31 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-3fb8147b-53df-45bb-939b-86317b9d332c tempest-VolumesCloneTest-1349547352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9eb4ed9e-1664-4a29-ae24-1c23132c259d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:31 devstack sudo[98083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_16d5d1f4-d777-4ead-8dbe-dd99285e9af3_ixs2gxcvdevstack@QuobyteHD Sep 16 20:27:31 devstack sudo[98083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:31 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-3fb8147b-53df-45bb-939b-86317b9d332c tempest-VolumesCloneTest-1349547352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6a6c694-4284-44d6-a03d-cef5f767ffc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:31 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-3fb8147b-53df-45bb-939b-86317b9d332c tempest-VolumesCloneTest-1349547352 None] Volume 094fcf71-d1a3-4197-81e4-600e7f665c3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-094fcf71-d1a3-4197-81e4-600e7f665c3c', 'volume_size': 1} Sep 16 20:27:31 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-3fb8147b-53df-45bb-939b-86317b9d332c tempest-VolumesCloneTest-1349547352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:27:31 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-3fb8147b-53df-45bb-939b-86317b9d332c tempest-VolumesCloneTest-1349547352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:27:31 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-3fb8147b-53df-45bb-939b-86317b9d332c tempest-VolumesCloneTest-1349547352 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:27:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1087976787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=094fcf71-d1a3-4197-81e4-600e7f665c3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdd01eb5d0614639b281814a9d07f1f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:27:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:27:31Z,use_quota=True,user_id='b33d6d47388641578df2207639d1f0e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:27:31 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-3fb8147b-53df-45bb-939b-86317b9d332c tempest-VolumesCloneTest-1349547352 None] Creating volume 094fcf71-d1a3-4197-81e4-600e7f665c3c {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:27:31 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-3fb8147b-53df-45bb-939b-86317b9d332c tempest-VolumesCloneTest-1349547352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:27:31 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-3fb8147b-53df-45bb-939b-86317b9d332c tempest-VolumesCloneTest-1349547352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:27:31 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-3fb8147b-53df-45bb-939b-86317b9d332c tempest-VolumesCloneTest-1349547352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:27:31 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-3fb8147b-53df-45bb-939b-86317b9d332c tempest-VolumesCloneTest-1349547352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:27:31 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-3fb8147b-53df-45bb-939b-86317b9d332c tempest-VolumesCloneTest-1349547352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:27:31 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-3fb8147b-53df-45bb-939b-86317b9d332c tempest-VolumesCloneTest-1349547352 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:27:31 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-3fb8147b-53df-45bb-939b-86317b9d332c tempest-VolumesCloneTest-1349547352 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:27:31 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-3fb8147b-53df-45bb-939b-86317b9d332c tempest-VolumesCloneTest-1349547352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-094fcf71-d1a3-4197-81e4-600e7f665c3c 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:31 devstack sudo[98085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-094fcf71-d1a3-4197-81e4-600e7f665c3c 1073741824 Sep 16 20:27:31 devstack sudo[98085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:31 devstack sudo[98083]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:31 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-905a2043-1199-4120-a37c-ae7cda875e53 tempest-VolumeImageDependencyTests-1758208657 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_16d5d1f4-d777-4ead-8dbe-dd99285e9af3_ixs2gxcvdevstack@QuobyteHD" returned: 1 in 0.432s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:31 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-905a2043-1199-4120-a37c-ae7cda875e53 tempest-VolumeImageDependencyTests-1758208657 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_16d5d1f4-d777-4ead-8dbe-dd99285e9af3_ixs2gxcvdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 16 20:27:31 devstack cinder-volume[86188]: DEBUG cinder.image.image_utils [None req-905a2043-1199-4120-a37c-ae7cda875e53 tempest-VolumeImageDependencyTests-1758208657 None] Temporary image 16d5d1f4-d777-4ead-8dbe-dd99285e9af3 is fetched for user 539e19b17c9c4348be9e8bf5cfdba4cc. {{(pid=86188) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 16 20:27:31 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc9c33f7-67b8-4c40-adda-32e759ceb27b]: (4, 'raw') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:27:31 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-905a2043-1199-4120-a37c-ae7cda875e53 tempest-VolumeImageDependencyTests-1758208657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_16d5d1f4-d777-4ead-8dbe-dd99285e9af3_ixs2gxcvdevstack@QuobyteHD {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:31 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-d13dbc34-2dcb-4a52-ba59-ebd2cb04eae0 tempest-VolumesTransfersTest-1800225516 None] Transfer volume completed successfully. Sep 16 20:27:31 devstack sudo[98093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_16d5d1f4-d777-4ead-8dbe-dd99285e9af3_ixs2gxcvdevstack@QuobyteHD Sep 16 20:27:31 devstack sudo[98093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:31 devstack sudo[98085]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:31 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-3fb8147b-53df-45bb-939b-86317b9d332c tempest-VolumesCloneTest-1349547352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-094fcf71-d1a3-4197-81e4-600e7f665c3c 1073741824" returned: 0 in 0.591s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:31 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-3fb8147b-53df-45bb-939b-86317b9d332c tempest-VolumesCloneTest-1349547352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-094fcf71-d1a3-4197-81e4-600e7f665c3c {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:32 devstack sudo[98096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-094fcf71-d1a3-4197-81e4-600e7f665c3c Sep 16 20:27:32 devstack sudo[98096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:32 devstack sudo[98093]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:32 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-905a2043-1199-4120-a37c-ae7cda875e53 tempest-VolumeImageDependencyTests-1758208657 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_16d5d1f4-d777-4ead-8dbe-dd99285e9af3_ixs2gxcvdevstack@QuobyteHD" returned: 0 in 0.412s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:32 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-905a2043-1199-4120-a37c-ae7cda875e53 tempest-VolumeImageDependencyTests-1758208657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_16d5d1f4-d777-4ead-8dbe-dd99285e9af3_ixs2gxcvdevstack@QuobyteHD {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:32 devstack sudo[98100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_16d5d1f4-d777-4ead-8dbe-dd99285e9af3_ixs2gxcvdevstack@QuobyteHD Sep 16 20:27:32 devstack sudo[98100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:32 devstack sudo[98096]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:32 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-3fb8147b-53df-45bb-939b-86317b9d332c tempest-VolumesCloneTest-1349547352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-094fcf71-d1a3-4197-81e4-600e7f665c3c" returned: 0 in 0.348s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:32 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-3fb8147b-53df-45bb-939b-86317b9d332c tempest-VolumesCloneTest-1349547352 None] <== create_volume: return (1020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:27:32 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-3fb8147b-53df-45bb-939b-86317b9d332c tempest-VolumesCloneTest-1349547352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:27:32 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-3fb8147b-53df-45bb-939b-86317b9d332c tempest-VolumesCloneTest-1349547352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6a6c694-4284-44d6-a03d-cef5f767ffc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-094fcf71-d1a3-4197-81e4-600e7f665c3c', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:32 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-3fb8147b-53df-45bb-939b-86317b9d332c tempest-VolumesCloneTest-1349547352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ea28a20-5e99-46d8-b864-78cd067f578c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:32 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-3fb8147b-53df-45bb-939b-86317b9d332c tempest-VolumesCloneTest-1349547352 None] Volume volume-094fcf71-d1a3-4197-81e4-600e7f665c3c (094fcf71-d1a3-4197-81e4-600e7f665c3c): created successfully Sep 16 20:27:32 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-3fb8147b-53df-45bb-939b-86317b9d332c tempest-VolumesCloneTest-1349547352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ea28a20-5e99-46d8-b864-78cd067f578c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:32 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-3fb8147b-53df-45bb-939b-86317b9d332c tempest-VolumesCloneTest-1349547352 None] Flow 'volume_create_manager' (5eef3418-f742-450d-8c9b-12aad6d083ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:27:32 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-3fb8147b-53df-45bb-939b-86317b9d332c tempest-VolumesCloneTest-1349547352 None] Created volume successfully. Sep 16 20:27:32 devstack sudo[98100]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:32 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-905a2043-1199-4120-a37c-ae7cda875e53 tempest-VolumeImageDependencyTests-1758208657 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_16d5d1f4-d777-4ead-8dbe-dd99285e9af3_ixs2gxcvdevstack@QuobyteHD" returned: 1 in 0.401s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:32 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-905a2043-1199-4120-a37c-ae7cda875e53 tempest-VolumeImageDependencyTests-1758208657 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_16d5d1f4-d777-4ead-8dbe-dd99285e9af3_ixs2gxcvdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 16 20:27:32 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-905a2043-1199-4120-a37c-ae7cda875e53 tempest-VolumeImageDependencyTests-1758208657 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:27:32 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-905a2043-1199-4120-a37c-ae7cda875e53 tempest-VolumeImageDependencyTests-1758208657 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:27:32 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-905a2043-1199-4120-a37c-ae7cda875e53 tempest-VolumeImageDependencyTests-1758208657 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:27:29Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9568186c-2e2f-43af-81af-1c2e47eb0308,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='695f6e7cd94845f3b482a3a94857b5d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:27:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:27:30Z,use_quota=True,user_id='539e19b17c9c4348be9e8bf5cfdba4cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:27:32 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-905a2043-1199-4120-a37c-ae7cda875e53 tempest-VolumeImageDependencyTests-1758208657 None] Creating volume 9568186c-2e2f-43af-81af-1c2e47eb0308 {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:27:32 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-905a2043-1199-4120-a37c-ae7cda875e53 tempest-VolumeImageDependencyTests-1758208657 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:27:32 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-905a2043-1199-4120-a37c-ae7cda875e53 tempest-VolumeImageDependencyTests-1758208657 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:27:32 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-905a2043-1199-4120-a37c-ae7cda875e53 tempest-VolumeImageDependencyTests-1758208657 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:27:32 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-905a2043-1199-4120-a37c-ae7cda875e53 tempest-VolumeImageDependencyTests-1758208657 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:27:32 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-905a2043-1199-4120-a37c-ae7cda875e53 tempest-VolumeImageDependencyTests-1758208657 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:27:32 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-905a2043-1199-4120-a37c-ae7cda875e53 tempest-VolumeImageDependencyTests-1758208657 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:27:32 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-905a2043-1199-4120-a37c-ae7cda875e53 tempest-VolumeImageDependencyTests-1758208657 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:27:32 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-905a2043-1199-4120-a37c-ae7cda875e53 tempest-VolumeImageDependencyTests-1758208657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9568186c-2e2f-43af-81af-1c2e47eb0308 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:32 devstack sudo[98106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9568186c-2e2f-43af-81af-1c2e47eb0308 1073741824 Sep 16 20:27:32 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-3d0857fb-ce5a-4eb3-9ff9-fe9de3772bf2 tempest-VolumesTransfersTest-2007411223 None] Acquiring lock "cinder-0937c497-2a8d-42e8-b596-f198e1454537-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:27:32 devstack sudo[98106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:32 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-3d0857fb-ce5a-4eb3-9ff9-fe9de3772bf2 tempest-VolumesTransfersTest-2007411223 None] Lock "cinder-0937c497-2a8d-42e8-b596-f198e1454537-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:27:32 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-3d0857fb-ce5a-4eb3-9ff9-fe9de3772bf2 tempest-VolumesTransfersTest-2007411223 None] Acquiring lock "cinder-quobyte-0937c497-2a8d-42e8-b596-f198e1454537" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:27:32 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-3d0857fb-ce5a-4eb3-9ff9-fe9de3772bf2 tempest-VolumesTransfersTest-2007411223 None] Lock "cinder-quobyte-0937c497-2a8d-42e8-b596-f198e1454537" acquired by "delete_volume" :: waited 0.019s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:27:32 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[da3bed16-9ef8-4a3d-a9d9-2584d379c318]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:27:32 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-3d0857fb-ce5a-4eb3-9ff9-fe9de3772bf2 tempest-VolumesTransfersTest-2007411223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-0937c497-2a8d-42e8-b596-f198e1454537 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:32 devstack sudo[98108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-0937c497-2a8d-42e8-b596-f198e1454537 Sep 16 20:27:32 devstack sudo[98108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:32 devstack sudo[98106]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:32 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-905a2043-1199-4120-a37c-ae7cda875e53 tempest-VolumeImageDependencyTests-1758208657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9568186c-2e2f-43af-81af-1c2e47eb0308 1073741824" returned: 0 in 0.516s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:33 devstack sudo[98108]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:33 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-905a2043-1199-4120-a37c-ae7cda875e53 tempest-VolumeImageDependencyTests-1758208657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9568186c-2e2f-43af-81af-1c2e47eb0308 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:33 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-3d0857fb-ce5a-4eb3-9ff9-fe9de3772bf2 tempest-VolumesTransfersTest-2007411223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-0937c497-2a8d-42e8-b596-f198e1454537" returned: 0 in 0.413s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:33 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-3d0857fb-ce5a-4eb3-9ff9-fe9de3772bf2 tempest-VolumesTransfersTest-2007411223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-0937c497-2a8d-42e8-b596-f198e1454537 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:33 devstack sudo[98117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9568186c-2e2f-43af-81af-1c2e47eb0308 Sep 16 20:27:33 devstack sudo[98117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:33 devstack sudo[98118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-0937c497-2a8d-42e8-b596-f198e1454537 Sep 16 20:27:33 devstack sudo[98118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:33 devstack sudo[98118]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:33 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-3d0857fb-ce5a-4eb3-9ff9-fe9de3772bf2 tempest-VolumesTransfersTest-2007411223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-0937c497-2a8d-42e8-b596-f198e1454537" returned: 0 in 0.299s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:33 devstack sudo[98117]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:33 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-905a2043-1199-4120-a37c-ae7cda875e53 tempest-VolumeImageDependencyTests-1758208657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9568186c-2e2f-43af-81af-1c2e47eb0308" returned: 0 in 0.326s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:33 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-905a2043-1199-4120-a37c-ae7cda875e53 tempest-VolumeImageDependencyTests-1758208657 None] <== create_volume: return (889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:27:33 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-905a2043-1199-4120-a37c-ae7cda875e53 tempest-VolumeImageDependencyTests-1758208657 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:27:33 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-3d0857fb-ce5a-4eb3-9ff9-fe9de3772bf2 tempest-VolumesTransfersTest-2007411223 None] Lock "cinder-quobyte-0937c497-2a8d-42e8-b596-f198e1454537" released by "delete_volume" :: held 0.765s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:27:33 devstack cinder-volume[86188]: DEBUG cinder.volume.volume_utils [None req-905a2043-1199-4120-a37c-ae7cda875e53 tempest-VolumeImageDependencyTests-1758208657 None] Attempting download of 16d5d1f4-d777-4ead-8dbe-dd99285e9af3 ((None, [{'url': 'file:///opt/stack/data/glance/images/16d5d1f4-d777-4ead-8dbe-dd99285e9af3', 'metadata': {}}])) to volume 9568186c-2e2f-43af-81af-1c2e47eb0308. {{(pid=86188) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 16 20:27:33 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-3d0857fb-ce5a-4eb3-9ff9-fe9de3772bf2 tempest-VolumesTransfersTest-2007411223 None] Created reservations ['a7cbfacd-1d68-4cba-b769-d2757e643226', 'f591b56c-add7-48ef-9648-a40e74921200', '88ce3382-d6a4-4170-9aa0-22d3fa4b53da', 'a5dc50d0-e82c-4745-8ce4-98769b4a344e'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:27:33 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[e41c4b52-333b-4d37-9dcf-47ac94822a08]: (4, 'raw') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:27:33 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-905a2043-1199-4120-a37c-ae7cda875e53 tempest-VolumeImageDependencyTests-1758208657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_16d5d1f4-d777-4ead-8dbe-dd99285e9af3__zbxqo0l {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:33 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-3d0857fb-ce5a-4eb3-9ff9-fe9de3772bf2 tempest-VolumesTransfersTest-2007411223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:27:33 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-3d0857fb-ce5a-4eb3-9ff9-fe9de3772bf2 tempest-VolumesTransfersTest-2007411223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:27:33 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-3d0857fb-ce5a-4eb3-9ff9-fe9de3772bf2 tempest-VolumesTransfersTest-2007411223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:27:33 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-3d0857fb-ce5a-4eb3-9ff9-fe9de3772bf2 tempest-VolumesTransfersTest-2007411223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:27:33 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-3d0857fb-ce5a-4eb3-9ff9-fe9de3772bf2 tempest-VolumesTransfersTest-2007411223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:27:33 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-3d0857fb-ce5a-4eb3-9ff9-fe9de3772bf2 tempest-VolumesTransfersTest-2007411223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:33 devstack sudo[98124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:27:33 devstack sudo[98124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:33 devstack sudo[98123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_16d5d1f4-d777-4ead-8dbe-dd99285e9af3__zbxqo0l Sep 16 20:27:33 devstack sudo[98123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:33 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-a13b5f8e-a525-420e-b8d0-cadaf96d5c74 tempest-VolumesCloneTest-1349547352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:27:33 devstack sudo[98123]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:33 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-905a2043-1199-4120-a37c-ae7cda875e53 tempest-VolumeImageDependencyTests-1758208657 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_16d5d1f4-d777-4ead-8dbe-dd99285e9af3__zbxqo0l" returned: 0 in 0.461s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:33 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-905a2043-1199-4120-a37c-ae7cda875e53 tempest-VolumeImageDependencyTests-1758208657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_16d5d1f4-d777-4ead-8dbe-dd99285e9af3__zbxqo0l {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:33 devstack sudo[98124]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:34 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a13b5f8e-a525-420e-b8d0-cadaf96d5c74 tempest-VolumesCloneTest-1349547352 None] Flow 'volume_create_manager' (af0a9a40-0064-4a1e-9baa-1c723bfa00bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:27:34 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a13b5f8e-a525-420e-b8d0-cadaf96d5c74 tempest-VolumesCloneTest-1349547352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfeb8dc2-d109-46fc-8854-5ae0aea6765b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:34 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-3d0857fb-ce5a-4eb3-9ff9-fe9de3772bf2 tempest-VolumesTransfersTest-2007411223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.431s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:34 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-3d0857fb-ce5a-4eb3-9ff9-fe9de3772bf2 tempest-VolumesTransfersTest-2007411223 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:27:34 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a13b5f8e-a525-420e-b8d0-cadaf96d5c74 tempest-VolumesCloneTest-1349547352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfeb8dc2-d109-46fc-8854-5ae0aea6765b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:27:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-558288224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de787a7b-4e05-4bf5-9201-bff98d4366df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdd01eb5d0614639b281814a9d07f1f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:27:34Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=094fcf71-d1a3-4197-81e4-600e7f665c3c,status='creating',terminated_at=None,updated_at=2026-09-16T18:27:34Z,use_quota=True,user_id='b33d6d47388641578df2207639d1f0e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:34 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a13b5f8e-a525-420e-b8d0-cadaf96d5c74 tempest-VolumesCloneTest-1349547352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e43b75a2-c9da-49c0-ac44-1545fa584b1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:34 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a13b5f8e-a525-420e-b8d0-cadaf96d5c74 tempest-VolumesCloneTest-1349547352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e43b75a2-c9da-49c0-ac44-1545fa584b1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:34 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a13b5f8e-a525-420e-b8d0-cadaf96d5c74 tempest-VolumesCloneTest-1349547352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6bb9f5e-6bf8-4b04-aad9-68f28322f60b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:34 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-3d0857fb-ce5a-4eb3-9ff9-fe9de3772bf2 tempest-VolumesTransfersTest-2007411223 None] Deleted volume successfully. Sep 16 20:27:34 devstack sudo[98130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_16d5d1f4-d777-4ead-8dbe-dd99285e9af3__zbxqo0l Sep 16 20:27:34 devstack sudo[98130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:34 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a13b5f8e-a525-420e-b8d0-cadaf96d5c74 tempest-VolumesCloneTest-1349547352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6bb9f5e-6bf8-4b04-aad9-68f28322f60b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'de787a7b-4e05-4bf5-9201-bff98d4366df', 'volume_name': 'volume-de787a7b-4e05-4bf5-9201-bff98d4366df', 'volume_size': 2, 'source_volid': '094fcf71-d1a3-4197-81e4-600e7f665c3c', 'source_volstatus': 'available'}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:34 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a13b5f8e-a525-420e-b8d0-cadaf96d5c74 tempest-VolumesCloneTest-1349547352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63a0cd38-1191-41bc-b86d-569b2d310c89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:34 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a13b5f8e-a525-420e-b8d0-cadaf96d5c74 tempest-VolumesCloneTest-1349547352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63a0cd38-1191-41bc-b86d-569b2d310c89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:34 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a13b5f8e-a525-420e-b8d0-cadaf96d5c74 tempest-VolumesCloneTest-1349547352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b360b7a-a3a8-45ac-b8de-44fc821d66d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:34 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-a13b5f8e-a525-420e-b8d0-cadaf96d5c74 tempest-VolumesCloneTest-1349547352 None] Volume de787a7b-4e05-4bf5-9201-bff98d4366df: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-de787a7b-4e05-4bf5-9201-bff98d4366df', 'volume_size': 2, 'source_volid': '094fcf71-d1a3-4197-81e4-600e7f665c3c', 'source_volstatus': 'available'} Sep 16 20:27:34 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a13b5f8e-a525-420e-b8d0-cadaf96d5c74 tempest-VolumesCloneTest-1349547352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:27:34 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a13b5f8e-a525-420e-b8d0-cadaf96d5c74 tempest-VolumesCloneTest-1349547352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:27:34 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-a13b5f8e-a525-420e-b8d0-cadaf96d5c74 tempest-VolumesCloneTest-1349547352 None] Cloning volume 094fcf71-d1a3-4197-81e4-600e7f665c3c to volume de787a7b-4e05-4bf5-9201-bff98d4366df Sep 16 20:27:34 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-3d0857fb-ce5a-4eb3-9ff9-fe9de3772bf2 tempest-VolumesTransfersTest-2007411223 None] Lock "cinder-0937c497-2a8d-42e8-b596-f198e1454537-delete_volume" released by "delete_volume" :: held 1.639s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:27:34 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-a13b5f8e-a525-420e-b8d0-cadaf96d5c74 tempest-VolumesCloneTest-1349547352 None] Creating offline snapshot 69765ad2-9e30-49c6-9f15-a8b0c60b4657 of volume 094fcf71-d1a3-4197-81e4-600e7f665c3c {{(pid=86188) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 20:27:34 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d61bdee-205e-45be-a4f3-772ca9ef49a8]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:27:34 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a13b5f8e-a525-420e-b8d0-cadaf96d5c74 tempest-VolumesCloneTest-1349547352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-094fcf71-d1a3-4197-81e4-600e7f665c3c {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:34 devstack sudo[98132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-094fcf71-d1a3-4197-81e4-600e7f665c3c Sep 16 20:27:34 devstack sudo[98132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:34 devstack sudo[98130]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:34 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-36517921-f37c-4a48-af76-9258247c8c06 tempest-VolumesTransfersTest-1220370370 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:27:34 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-36517921-f37c-4a48-af76-9258247c8c06 tempest-VolumesTransfersTest-1220370370 None] Flow 'volume_create_manager' (67449755-3f23-4c2e-ac1b-d84755c14a45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:27:34 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-36517921-f37c-4a48-af76-9258247c8c06 tempest-VolumesTransfersTest-1220370370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f982292-d18a-4254-b262-5de0370c2bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:34 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-905a2043-1199-4120-a37c-ae7cda875e53 tempest-VolumeImageDependencyTests-1758208657 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_16d5d1f4-d777-4ead-8dbe-dd99285e9af3__zbxqo0l" returned: 1 in 0.477s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:34 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-905a2043-1199-4120-a37c-ae7cda875e53 tempest-VolumeImageDependencyTests-1758208657 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_16d5d1f4-d777-4ead-8dbe-dd99285e9af3__zbxqo0l' failed. Not Retrying. {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 16 20:27:34 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[1994d20e-5555-4b8e-999c-a98880e65db2]: (4, 'raw') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:27:34 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-905a2043-1199-4120-a37c-ae7cda875e53 tempest-VolumeImageDependencyTests-1758208657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_16d5d1f4-d777-4ead-8dbe-dd99285e9af3_ixs2gxcvdevstack@QuobyteHD {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:34 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-36517921-f37c-4a48-af76-9258247c8c06 tempest-VolumesTransfersTest-1220370370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f982292-d18a-4254-b262-5de0370c2bb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:27:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-679504801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e760aedf-0f40-481f-a024-c899767a0c4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd3158fc7f554d6db80f9326908ce0df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:27:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:27:34Z,use_quota=True,user_id='32f65c55db0244f0bbf92242b2e5d499',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:34 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-36517921-f37c-4a48-af76-9258247c8c06 tempest-VolumesTransfersTest-1220370370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (491ed79a-17b0-4a2b-8a88-dbaae80ddd79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:34 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-36517921-f37c-4a48-af76-9258247c8c06 tempest-VolumesTransfersTest-1220370370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (491ed79a-17b0-4a2b-8a88-dbaae80ddd79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:34 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-36517921-f37c-4a48-af76-9258247c8c06 tempest-VolumesTransfersTest-1220370370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af024853-a806-4f20-80f2-ac03c4274019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:34 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-36517921-f37c-4a48-af76-9258247c8c06 tempest-VolumesTransfersTest-1220370370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af024853-a806-4f20-80f2-ac03c4274019) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e760aedf-0f40-481f-a024-c899767a0c4c', 'volume_name': 'volume-e760aedf-0f40-481f-a024-c899767a0c4c', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:34 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-36517921-f37c-4a48-af76-9258247c8c06 tempest-VolumesTransfersTest-1220370370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2293496-bc03-4638-a4b3-2fa071ea35a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:34 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-36517921-f37c-4a48-af76-9258247c8c06 tempest-VolumesTransfersTest-1220370370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2293496-bc03-4638-a4b3-2fa071ea35a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:34 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-36517921-f37c-4a48-af76-9258247c8c06 tempest-VolumesTransfersTest-1220370370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a4fd8ba-962a-4718-8061-1e08c86ba20c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:34 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-36517921-f37c-4a48-af76-9258247c8c06 tempest-VolumesTransfersTest-1220370370 None] Volume e760aedf-0f40-481f-a024-c899767a0c4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e760aedf-0f40-481f-a024-c899767a0c4c', 'volume_size': 1} Sep 16 20:27:34 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-36517921-f37c-4a48-af76-9258247c8c06 tempest-VolumesTransfersTest-1220370370 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:27:34 devstack sudo[98136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_16d5d1f4-d777-4ead-8dbe-dd99285e9af3_ixs2gxcvdevstack@QuobyteHD Sep 16 20:27:34 devstack sudo[98136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:34 devstack sudo[98132]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:34 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a13b5f8e-a525-420e-b8d0-cadaf96d5c74 tempest-VolumesCloneTest-1349547352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-094fcf71-d1a3-4197-81e4-600e7f665c3c" returned: 0 in 0.447s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:34 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a13b5f8e-a525-420e-b8d0-cadaf96d5c74 tempest-VolumesCloneTest-1349547352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-094fcf71-d1a3-4197-81e4-600e7f665c3c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-094fcf71-d1a3-4197-81e4-600e7f665c3c.69765ad2-9e30-49c6-9f15-a8b0c60b4657 1G {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:34 devstack sudo[98141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-094fcf71-d1a3-4197-81e4-600e7f665c3c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-094fcf71-d1a3-4197-81e4-600e7f665c3c.69765ad2-9e30-49c6-9f15-a8b0c60b4657 1G Sep 16 20:27:34 devstack sudo[98141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:34 devstack sudo[98136]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:34 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-905a2043-1199-4120-a37c-ae7cda875e53 tempest-VolumeImageDependencyTests-1758208657 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_16d5d1f4-d777-4ead-8dbe-dd99285e9af3_ixs2gxcvdevstack@QuobyteHD" returned: 0 in 0.380s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:34 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-905a2043-1199-4120-a37c-ae7cda875e53 tempest-VolumeImageDependencyTests-1758208657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_16d5d1f4-d777-4ead-8dbe-dd99285e9af3_ixs2gxcvdevstack@QuobyteHD {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:34 devstack sudo[98145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_16d5d1f4-d777-4ead-8dbe-dd99285e9af3_ixs2gxcvdevstack@QuobyteHD Sep 16 20:27:34 devstack sudo[98145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:35 devstack sudo[98141]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:35 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a13b5f8e-a525-420e-b8d0-cadaf96d5c74 tempest-VolumesCloneTest-1349547352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-094fcf71-d1a3-4197-81e4-600e7f665c3c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-094fcf71-d1a3-4197-81e4-600e7f665c3c.69765ad2-9e30-49c6-9f15-a8b0c60b4657 1G" returned: 0 in 0.453s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:35 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a13b5f8e-a525-420e-b8d0-cadaf96d5c74 tempest-VolumesCloneTest-1349547352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-094fcf71-d1a3-4197-81e4-600e7f665c3c -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-094fcf71-d1a3-4197-81e4-600e7f665c3c.69765ad2-9e30-49c6-9f15-a8b0c60b4657 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:35 devstack sudo[98151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-094fcf71-d1a3-4197-81e4-600e7f665c3c -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-094fcf71-d1a3-4197-81e4-600e7f665c3c.69765ad2-9e30-49c6-9f15-a8b0c60b4657 Sep 16 20:27:35 devstack sudo[98151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:35 devstack sudo[98145]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:35 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-905a2043-1199-4120-a37c-ae7cda875e53 tempest-VolumeImageDependencyTests-1758208657 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_16d5d1f4-d777-4ead-8dbe-dd99285e9af3_ixs2gxcvdevstack@QuobyteHD" returned: 1 in 0.380s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:35 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-905a2043-1199-4120-a37c-ae7cda875e53 tempest-VolumeImageDependencyTests-1758208657 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_16d5d1f4-d777-4ead-8dbe-dd99285e9af3_ixs2gxcvdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 16 20:27:35 devstack cinder-volume[86188]: DEBUG cinder.image.image_utils [None req-905a2043-1199-4120-a37c-ae7cda875e53 tempest-VolumeImageDependencyTests-1758208657 None] 16d5d1f4-d777-4ead-8dbe-dd99285e9af3 was raw, converting to qcow2 {{(pid=86188) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 16 20:27:35 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-905a2043-1199-4120-a37c-ae7cda875e53 tempest-VolumeImageDependencyTests-1758208657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_16d5d1f4-d777-4ead-8dbe-dd99285e9af3_ixs2gxcvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9568186c-2e2f-43af-81af-1c2e47eb0308 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:35 devstack sudo[98156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_16d5d1f4-d777-4ead-8dbe-dd99285e9af3_ixs2gxcvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9568186c-2e2f-43af-81af-1c2e47eb0308 Sep 16 20:27:35 devstack sudo[98156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:35 devstack sudo[98151]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:35 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a13b5f8e-a525-420e-b8d0-cadaf96d5c74 tempest-VolumesCloneTest-1349547352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-094fcf71-d1a3-4197-81e4-600e7f665c3c -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-094fcf71-d1a3-4197-81e4-600e7f665c3c.69765ad2-9e30-49c6-9f15-a8b0c60b4657" returned: 0 in 0.306s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:35 devstack cinder-volume[86188]: WARNING cinder.volume.drivers.remotefs [None req-a13b5f8e-a525-420e-b8d0-cadaf96d5c74 tempest-VolumesCloneTest-1349547352 None] /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-094fcf71-d1a3-4197-81e4-600e7f665c3c.69765ad2-9e30-49c6-9f15-a8b0c60b4657 is being set with open permissions: ugo+rw Sep 16 20:27:35 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a13b5f8e-a525-420e-b8d0-cadaf96d5c74 tempest-VolumesCloneTest-1349547352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-094fcf71-d1a3-4197-81e4-600e7f665c3c.69765ad2-9e30-49c6-9f15-a8b0c60b4657 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:35 devstack sudo[98161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-094fcf71-d1a3-4197-81e4-600e7f665c3c.69765ad2-9e30-49c6-9f15-a8b0c60b4657 Sep 16 20:27:35 devstack sudo[98161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:35 devstack sudo[98161]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:35 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a13b5f8e-a525-420e-b8d0-cadaf96d5c74 tempest-VolumesCloneTest-1349547352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-094fcf71-d1a3-4197-81e4-600e7f665c3c.69765ad2-9e30-49c6-9f15-a8b0c60b4657" returned: 0 in 0.265s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:35 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a13b5f8e-a525-420e-b8d0-cadaf96d5c74 tempest-VolumesCloneTest-1349547352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-094fcf71-d1a3-4197-81e4-600e7f665c3c.info {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:35 devstack sudo[98156]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:35 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-905a2043-1199-4120-a37c-ae7cda875e53 tempest-VolumeImageDependencyTests-1758208657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_16d5d1f4-d777-4ead-8dbe-dd99285e9af3_ixs2gxcvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9568186c-2e2f-43af-81af-1c2e47eb0308" returned: 0 in 0.526s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:35 devstack cinder-volume[86188]: DEBUG cinder.image.image_utils [None req-905a2043-1199-4120-a37c-ae7cda875e53 tempest-VolumeImageDependencyTests-1758208657 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_16d5d1f4-d777-4ead-8dbe-dd99285e9af3_ixs2gxcvdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9568186c-2e2f-43af-81af-1c2e47eb0308 {{(pid=86188) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 16 20:27:35 devstack cinder-volume[86188]: INFO cinder.image.image_utils [None req-905a2043-1199-4120-a37c-ae7cda875e53 tempest-VolumeImageDependencyTests-1758208657 None] Converted 0.00 MB image at 0.00 MB/s Sep 16 20:27:35 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-905a2043-1199-4120-a37c-ae7cda875e53 tempest-VolumeImageDependencyTests-1758208657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9568186c-2e2f-43af-81af-1c2e47eb0308 1G {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:35 devstack sudo[98168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-094fcf71-d1a3-4197-81e4-600e7f665c3c.info Sep 16 20:27:35 devstack sudo[98168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:35 devstack sudo[98169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9568186c-2e2f-43af-81af-1c2e47eb0308 1G Sep 16 20:27:35 devstack sudo[98169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:35 devstack sudo[98168]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:36 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a13b5f8e-a525-420e-b8d0-cadaf96d5c74 tempest-VolumesCloneTest-1349547352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-094fcf71-d1a3-4197-81e4-600e7f665c3c.info" returned: 0 in 0.269s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:36 devstack cinder-volume[86188]: WARNING cinder.volume.drivers.remotefs [None req-a13b5f8e-a525-420e-b8d0-cadaf96d5c74 tempest-VolumesCloneTest-1349547352 None] /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-094fcf71-d1a3-4197-81e4-600e7f665c3c.info is being set with open permissions: ugo+rw Sep 16 20:27:36 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a13b5f8e-a525-420e-b8d0-cadaf96d5c74 tempest-VolumesCloneTest-1349547352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-094fcf71-d1a3-4197-81e4-600e7f665c3c.info {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:36 devstack sudo[98175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-094fcf71-d1a3-4197-81e4-600e7f665c3c.info Sep 16 20:27:36 devstack sudo[98175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:36 devstack sudo[98169]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:36 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-905a2043-1199-4120-a37c-ae7cda875e53 tempest-VolumeImageDependencyTests-1758208657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9568186c-2e2f-43af-81af-1c2e47eb0308 1G" returned: 0 in 0.375s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:36 devstack cinder-volume[86188]: DEBUG cinder.volume.volume_utils [None req-905a2043-1199-4120-a37c-ae7cda875e53 tempest-VolumeImageDependencyTests-1758208657 None] Downloaded image 16d5d1f4-d777-4ead-8dbe-dd99285e9af3 ((None, [{'url': 'file:///opt/stack/data/glance/images/16d5d1f4-d777-4ead-8dbe-dd99285e9af3', 'metadata': {}}])) to volume 9568186c-2e2f-43af-81af-1c2e47eb0308 successfully. {{(pid=86188) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 16 20:27:36 devstack cinder-volume[86188]: DEBUG cinder.image.image_utils [None req-905a2043-1199-4120-a37c-ae7cda875e53 tempest-VolumeImageDependencyTests-1758208657 None] Temporary image 16d5d1f4-d777-4ead-8dbe-dd99285e9af3 for user 539e19b17c9c4348be9e8bf5cfdba4cc is deleted. {{(pid=86188) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 16 20:27:36 devstack cinder-volume[86188]: DEBUG cinder.volume.volume_utils [None req-905a2043-1199-4120-a37c-ae7cda875e53 tempest-VolumeImageDependencyTests-1758208657 None] Marking volume 9568186c-2e2f-43af-81af-1c2e47eb0308 as bootable. {{(pid=86188) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 16 20:27:36 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-905a2043-1199-4120-a37c-ae7cda875e53 tempest-VolumeImageDependencyTests-1758208657 None] Copying metadata from image 16d5d1f4-d777-4ead-8dbe-dd99285e9af3 to 9568186c-2e2f-43af-81af-1c2e47eb0308. {{(pid=86188) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 16 20:27:36 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-905a2043-1199-4120-a37c-ae7cda875e53 tempest-VolumeImageDependencyTests-1758208657 None] Creating volume glance metadata for volume 9568186c-2e2f-43af-81af-1c2e47eb0308 backed by image 16d5d1f4-d777-4ead-8dbe-dd99285e9af3 with: {'image_id': '16d5d1f4-d777-4ead-8dbe-dd99285e9af3', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '9a87e11cfa320bd587fbfc425712f67e', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86188) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 16 20:27:36 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-905a2043-1199-4120-a37c-ae7cda875e53 tempest-VolumeImageDependencyTests-1758208657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dc3a43d-38cd-4306-bc83-5a8d78dd7f72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9568186c-2e2f-43af-81af-1c2e47eb0308', 'volume_size': 1, 'image_id': '16d5d1f4-d777-4ead-8dbe-dd99285e9af3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/16d5d1f4-d777-4ead-8dbe-dd99285e9af3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9a87e11cfa320bd587fbfc425712f67e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '695f6e7cd94845f3b482a3a94857b5d8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '172d6fc27e0580be5faed53ae2a63169d4819ef3fb4fa475e3eef50d88c6fb1fdf39c8135c82c9aec9ed9c1bf813fcc6e32b6ad900bb21b13e4624a1f0d400cc', 'id': '16d5d1f4-d777-4ead-8dbe-dd99285e9af3', 'created_at': datetime.datetime(2026, 9, 16, 18, 27, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 18, 27, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/16d5d1f4-d777-4ead-8dbe-dd99285e9af3/file', 'properties': {}}, 'image_service': }' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:36 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-905a2043-1199-4120-a37c-ae7cda875e53 tempest-VolumeImageDependencyTests-1758208657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d31e322-3da4-41f1-8c45-e24315064982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:36 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-905a2043-1199-4120-a37c-ae7cda875e53 tempest-VolumeImageDependencyTests-1758208657 None] Volume volume-9568186c-2e2f-43af-81af-1c2e47eb0308 (9568186c-2e2f-43af-81af-1c2e47eb0308): created successfully Sep 16 20:27:36 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-905a2043-1199-4120-a37c-ae7cda875e53 tempest-VolumeImageDependencyTests-1758208657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d31e322-3da4-41f1-8c45-e24315064982) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:36 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-905a2043-1199-4120-a37c-ae7cda875e53 tempest-VolumeImageDependencyTests-1758208657 None] Flow 'volume_create_manager' (170e1b25-1088-4c42-8630-fdae98cbcbb9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:27:36 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-905a2043-1199-4120-a37c-ae7cda875e53 tempest-VolumeImageDependencyTests-1758208657 None] Created volume successfully. Sep 16 20:27:36 devstack sudo[98175]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:36 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a13b5f8e-a525-420e-b8d0-cadaf96d5c74 tempest-VolumesCloneTest-1349547352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-094fcf71-d1a3-4197-81e4-600e7f665c3c.info" returned: 0 in 0.275s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:36 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-a13b5f8e-a525-420e-b8d0-cadaf96d5c74 tempest-VolumesCloneTest-1349547352 None] Acquiring lock "cinder-quobyte-de787a7b-4e05-4bf5-9201-bff98d4366df" by "_copy_volume_from_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:27:36 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-a13b5f8e-a525-420e-b8d0-cadaf96d5c74 tempest-VolumesCloneTest-1349547352 None] Lock "cinder-quobyte-de787a7b-4e05-4bf5-9201-bff98d4366df" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:27:36 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-a13b5f8e-a525-420e-b8d0-cadaf96d5c74 tempest-VolumesCloneTest-1349547352 None] snapshot: 69765ad2-9e30-49c6-9f15-a8b0c60b4657, volume: de787a7b-4e05-4bf5-9201-bff98d4366df, {{(pid=86188) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 16 20:27:36 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a13b5f8e-a525-420e-b8d0-cadaf96d5c74 tempest-VolumesCloneTest-1349547352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:27:36 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a13b5f8e-a525-420e-b8d0-cadaf96d5c74 tempest-VolumesCloneTest-1349547352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:27:36 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-a13b5f8e-a525-420e-b8d0-cadaf96d5c74 tempest-VolumesCloneTest-1349547352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:27:36 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-a13b5f8e-a525-420e-b8d0-cadaf96d5c74 tempest-VolumesCloneTest-1349547352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:27:36 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a13b5f8e-a525-420e-b8d0-cadaf96d5c74 tempest-VolumesCloneTest-1349547352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:27:36 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd665d2f-2e57-4fd3-a4a5-46eff90ded5e]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:27:36 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a13b5f8e-a525-420e-b8d0-cadaf96d5c74 tempest-VolumesCloneTest-1349547352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-094fcf71-d1a3-4197-81e4-600e7f665c3c.69765ad2-9e30-49c6-9f15-a8b0c60b4657 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:36 devstack sudo[98180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-094fcf71-d1a3-4197-81e4-600e7f665c3c.69765ad2-9e30-49c6-9f15-a8b0c60b4657 Sep 16 20:27:36 devstack sudo[98180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:36 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-0447b994-01ba-42f6-9e89-cf6292fc873e tempest-VolumeImageDependencyTests-1758208657 None] Acquiring lock "cinder-9568186c-2e2f-43af-81af-1c2e47eb0308-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:27:36 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-0447b994-01ba-42f6-9e89-cf6292fc873e tempest-VolumeImageDependencyTests-1758208657 None] Lock "cinder-9568186c-2e2f-43af-81af-1c2e47eb0308-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:27:36 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-b84f4386-67e7-4a28-b593-6de24096cb6e tempest-VolumesImageMetadata-887322385 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:27:36 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-b84f4386-67e7-4a28-b593-6de24096cb6e tempest-VolumesImageMetadata-887322385 None] Flow 'volume_create_manager' (e50dcf8e-420e-428f-a612-919fd53ebd1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:27:36 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-b84f4386-67e7-4a28-b593-6de24096cb6e tempest-VolumesImageMetadata-887322385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (586b934b-1564-4291-9a8d-98bc28fef290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:36 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-b84f4386-67e7-4a28-b593-6de24096cb6e tempest-VolumesImageMetadata-887322385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (586b934b-1564-4291-9a8d-98bc28fef290) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:27:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-338028806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4de48a00-bee9-486e-882a-a70e4d736e47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='754b27392ff845d7abbef201be253231',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:27:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:27:37Z,use_quota=True,user_id='5d55669a68314dd0b6ddae6ed1a932b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:36 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-b84f4386-67e7-4a28-b593-6de24096cb6e tempest-VolumesImageMetadata-887322385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (916913d1-204e-4703-9694-ab94e1cc2ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:36 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-b84f4386-67e7-4a28-b593-6de24096cb6e tempest-VolumesImageMetadata-887322385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (916913d1-204e-4703-9694-ab94e1cc2ec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:36 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-b84f4386-67e7-4a28-b593-6de24096cb6e tempest-VolumesImageMetadata-887322385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a8eda5b-dba3-4447-938b-665ebfed4e0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:36 devstack cinder-volume[86188]: DEBUG cinder.image.glance [None req-b84f4386-67e7-4a28-b593-6de24096cb6e tempest-VolumesImageMetadata-887322385 None] Creating Keystone auth plugin from conf {{(pid=86188) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 16 20:27:36 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-0447b994-01ba-42f6-9e89-cf6292fc873e tempest-VolumeImageDependencyTests-1758208657 None] Acquiring lock "cinder-quobyte-9568186c-2e2f-43af-81af-1c2e47eb0308" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:27:36 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-0447b994-01ba-42f6-9e89-cf6292fc873e tempest-VolumeImageDependencyTests-1758208657 None] Lock "cinder-quobyte-9568186c-2e2f-43af-81af-1c2e47eb0308" acquired by "delete_volume" :: waited 0.019s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:27:36 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1c6b6f2-f7d3-48d2-8445-c1f14e37da55]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:27:36 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-0447b994-01ba-42f6-9e89-cf6292fc873e tempest-VolumeImageDependencyTests-1758208657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9568186c-2e2f-43af-81af-1c2e47eb0308 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:36 devstack sudo[98180]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:36 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a13b5f8e-a525-420e-b8d0-cadaf96d5c74 tempest-VolumesCloneTest-1349547352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-094fcf71-d1a3-4197-81e4-600e7f665c3c.69765ad2-9e30-49c6-9f15-a8b0c60b4657" returned: 0 in 0.429s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:36 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-a13b5f8e-a525-420e-b8d0-cadaf96d5c74 tempest-VolumesCloneTest-1349547352 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-094fcf71-d1a3-4197-81e4-600e7f665c3c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86188) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 20:27:36 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[f465e4f1-db2a-44ad-a0ce-f2c21614d04e]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:27:36 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a13b5f8e-a525-420e-b8d0-cadaf96d5c74 tempest-VolumesCloneTest-1349547352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-094fcf71-d1a3-4197-81e4-600e7f665c3c {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:36 devstack sudo[98185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9568186c-2e2f-43af-81af-1c2e47eb0308 Sep 16 20:27:36 devstack sudo[98185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:36 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-b84f4386-67e7-4a28-b593-6de24096cb6e tempest-VolumesImageMetadata-887322385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a8eda5b-dba3-4447-938b-665ebfed4e0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4de48a00-bee9-486e-882a-a70e4d736e47', 'volume_name': 'volume-4de48a00-bee9-486e-882a-a70e4d736e47', 'volume_size': 1, 'image_id': 'b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5c9c8eab814247029b6d508a74a1d19e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e', 'created_at': datetime.datetime(2026, 9, 16, 18, 12, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 18, 12, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:36 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-b84f4386-67e7-4a28-b593-6de24096cb6e tempest-VolumesImageMetadata-887322385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67a2c670-ffd7-4a82-9cb8-e82fe52ac6e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:36 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-b84f4386-67e7-4a28-b593-6de24096cb6e tempest-VolumesImageMetadata-887322385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67a2c670-ffd7-4a82-9cb8-e82fe52ac6e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:36 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-b84f4386-67e7-4a28-b593-6de24096cb6e tempest-VolumesImageMetadata-887322385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0608a771-129d-4520-8597-b48b273687ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:36 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-b84f4386-67e7-4a28-b593-6de24096cb6e tempest-VolumesImageMetadata-887322385 None] Volume 4de48a00-bee9-486e-882a-a70e4d736e47: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4de48a00-bee9-486e-882a-a70e4d736e47', 'volume_size': 1, 'image_id': 'b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5c9c8eab814247029b6d508a74a1d19e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e', 'created_at': datetime.datetime(2026, 9, 16, 18, 12, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 18, 12, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 16 20:27:36 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-b84f4386-67e7-4a28-b593-6de24096cb6e tempest-VolumesImageMetadata-887322385 None] Trying to clone 4de48a00-bee9-486e-882a-a70e4d736e47 from image b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e at location (None, [{'url': 'file:///opt/stack/data/glance/images/b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e', 'metadata': {}}]). {{(pid=86188) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 16 20:27:36 devstack sudo[98186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-094fcf71-d1a3-4197-81e4-600e7f665c3c Sep 16 20:27:36 devstack sudo[98186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:37 devstack sudo[98185]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:37 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-0447b994-01ba-42f6-9e89-cf6292fc873e tempest-VolumeImageDependencyTests-1758208657 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9568186c-2e2f-43af-81af-1c2e47eb0308" returned: 0 in 0.445s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:37 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-0447b994-01ba-42f6-9e89-cf6292fc873e tempest-VolumeImageDependencyTests-1758208657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9568186c-2e2f-43af-81af-1c2e47eb0308 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:37 devstack sudo[98186]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:37 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a13b5f8e-a525-420e-b8d0-cadaf96d5c74 tempest-VolumesCloneTest-1349547352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-094fcf71-d1a3-4197-81e4-600e7f665c3c" returned: 0 in 0.393s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:37 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-a13b5f8e-a525-420e-b8d0-cadaf96d5c74 tempest-VolumesCloneTest-1349547352 None] will copy from snapshot at /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-094fcf71-d1a3-4197-81e4-600e7f665c3c {{(pid=86188) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 16 20:27:37 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-a13b5f8e-a525-420e-b8d0-cadaf96d5c74 tempest-VolumesCloneTest-1349547352 None] Creating direct copy from snapshot {{(pid=86188) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 16 20:27:37 devstack sudo[98196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9568186c-2e2f-43af-81af-1c2e47eb0308 Sep 16 20:27:37 devstack sudo[98196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:37 devstack cinder-volume[86188]: DEBUG cinder.utils [None req-a13b5f8e-a525-420e-b8d0-cadaf96d5c74 tempest-VolumesCloneTest-1349547352 None] Path /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-de787a7b-4e05-4bf5-9201-bff98d4366df not found in is_blk_device check {{(pid=86188) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 16 20:27:37 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a13b5f8e-a525-420e-b8d0-cadaf96d5c74 tempest-VolumesCloneTest-1349547352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-094fcf71-d1a3-4197-81e4-600e7f665c3c /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-de787a7b-4e05-4bf5-9201-bff98d4366df {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:37 devstack sudo[98198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-094fcf71-d1a3-4197-81e4-600e7f665c3c /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-de787a7b-4e05-4bf5-9201-bff98d4366df Sep 16 20:27:37 devstack sudo[98198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:37 devstack cinder-volume[86188]: DEBUG cinder.image.image_utils [None req-b84f4386-67e7-4a28-b593-6de24096cb6e tempest-VolumesImageMetadata-887322385 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e_tlku_qdpdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86188) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 16 20:27:37 devstack cinder-volume[86188]: INFO cinder.image.image_utils [None req-b84f4386-67e7-4a28-b593-6de24096cb6e tempest-VolumesImageMetadata-887322385 None] Image download 20.69 MB at 20.69 MB/s Sep 16 20:27:37 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c035ab5-5b62-4d5a-8c7c-8b4ff436b7f8]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:27:37 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b84f4386-67e7-4a28-b593-6de24096cb6e tempest-VolumesImageMetadata-887322385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e_tlku_qdpdevstack@QuobyteHD {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:37 devstack sudo[98196]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:37 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-0447b994-01ba-42f6-9e89-cf6292fc873e tempest-VolumeImageDependencyTests-1758208657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9568186c-2e2f-43af-81af-1c2e47eb0308" returned: 0 in 0.257s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:37 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-0447b994-01ba-42f6-9e89-cf6292fc873e tempest-VolumeImageDependencyTests-1758208657 None] Lock "cinder-quobyte-9568186c-2e2f-43af-81af-1c2e47eb0308" released by "delete_volume" :: held 0.748s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:27:37 devstack sudo[98202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e_tlku_qdpdevstack@QuobyteHD Sep 16 20:27:37 devstack sudo[98202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:37 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-0447b994-01ba-42f6-9e89-cf6292fc873e tempest-VolumeImageDependencyTests-1758208657 None] Created reservations ['72686a10-5f65-40d8-988f-b94fc49b88ec', 'ebce8b30-e75d-4218-b1b0-bab499703d58', '7aa3cd05-5dd2-406d-92c3-3ac4950484d5', 'e44ad9a3-e4b2-485c-b0bc-c7f6c897c22f'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:27:37 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-0447b994-01ba-42f6-9e89-cf6292fc873e tempest-VolumeImageDependencyTests-1758208657 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:27:37 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-0447b994-01ba-42f6-9e89-cf6292fc873e tempest-VolumeImageDependencyTests-1758208657 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:27:37 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-0447b994-01ba-42f6-9e89-cf6292fc873e tempest-VolumeImageDependencyTests-1758208657 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:27:37 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-0447b994-01ba-42f6-9e89-cf6292fc873e tempest-VolumeImageDependencyTests-1758208657 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:27:37 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-0447b994-01ba-42f6-9e89-cf6292fc873e tempest-VolumeImageDependencyTests-1758208657 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:27:37 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-0447b994-01ba-42f6-9e89-cf6292fc873e tempest-VolumeImageDependencyTests-1758208657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:37 devstack sudo[98207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:27:37 devstack sudo[98207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:37 devstack sudo[98202]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:37 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b84f4386-67e7-4a28-b593-6de24096cb6e tempest-VolumesImageMetadata-887322385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e_tlku_qdpdevstack@QuobyteHD" returned: 0 in 0.411s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:37 devstack cinder-volume[86188]: DEBUG cinder.image.image_utils [None req-b84f4386-67e7-4a28-b593-6de24096cb6e tempest-VolumesImageMetadata-887322385 None] Temporary image b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e is fetched for user 5d55669a68314dd0b6ddae6ed1a932b8. {{(pid=86188) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 16 20:27:37 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb4e7b7a-ad3d-4553-b18f-a535215a2ae1]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:27:37 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b84f4386-67e7-4a28-b593-6de24096cb6e tempest-VolumesImageMetadata-887322385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e_tlku_qdpdevstack@QuobyteHD {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:37 devstack sudo[98207]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:38 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-0447b994-01ba-42f6-9e89-cf6292fc873e tempest-VolumeImageDependencyTests-1758208657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.391s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:38 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-0447b994-01ba-42f6-9e89-cf6292fc873e tempest-VolumeImageDependencyTests-1758208657 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:27:38 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-0447b994-01ba-42f6-9e89-cf6292fc873e tempest-VolumeImageDependencyTests-1758208657 None] Deleted volume successfully. Sep 16 20:27:38 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-0447b994-01ba-42f6-9e89-cf6292fc873e tempest-VolumeImageDependencyTests-1758208657 None] Lock "cinder-9568186c-2e2f-43af-81af-1c2e47eb0308-delete_volume" released by "delete_volume" :: held 1.477s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:27:38 devstack sudo[98220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e_tlku_qdpdevstack@QuobyteHD Sep 16 20:27:38 devstack sudo[98220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:38 devstack sudo[98220]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:38 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b84f4386-67e7-4a28-b593-6de24096cb6e tempest-VolumesImageMetadata-887322385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e_tlku_qdpdevstack@QuobyteHD" returned: 0 in 0.564s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:38 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-b84f4386-67e7-4a28-b593-6de24096cb6e tempest-VolumesImageMetadata-887322385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:27:44 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3eeb966-28b5-48bc-9908-b55639a073e1 tempest-ProjectReaderTests-981771145 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:27:44 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-b3eeb966-28b5-48bc-9908-b55639a073e1 tempest-ProjectReaderTests-981771145 None] Flow 'volume_create_manager' (261ee4c0-dafc-46dd-b0fb-88da134044cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:27:44 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-b3eeb966-28b5-48bc-9908-b55639a073e1 tempest-ProjectReaderTests-981771145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9c304da-5c3e-46e7-bf98-3baf0bef5d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:44 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-b3eeb966-28b5-48bc-9908-b55639a073e1 tempest-ProjectReaderTests-981771145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9c304da-5c3e-46e7-bf98-3baf0bef5d97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:27:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1053862482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9736018a-0654-479a-af91-083cf288e1dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef83d387b0364554a95ff826564f3f6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:27:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:27:44Z,use_quota=True,user_id='23931fcd7d8c46e2837d5d814a16dc07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:44 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-b3eeb966-28b5-48bc-9908-b55639a073e1 tempest-ProjectReaderTests-981771145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (991bed96-e30e-4990-825b-e61c3e155b41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:44 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-b3eeb966-28b5-48bc-9908-b55639a073e1 tempest-ProjectReaderTests-981771145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (991bed96-e30e-4990-825b-e61c3e155b41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:44 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-b3eeb966-28b5-48bc-9908-b55639a073e1 tempest-ProjectReaderTests-981771145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e931bec8-cdfc-4c98-8acd-5a359a5a799a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:44 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-b3eeb966-28b5-48bc-9908-b55639a073e1 tempest-ProjectReaderTests-981771145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e931bec8-cdfc-4c98-8acd-5a359a5a799a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9736018a-0654-479a-af91-083cf288e1dc', 'volume_name': 'volume-9736018a-0654-479a-af91-083cf288e1dc', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:44 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-b3eeb966-28b5-48bc-9908-b55639a073e1 tempest-ProjectReaderTests-981771145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d20b4b1d-adf8-4b4d-a095-612fb0045203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:44 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-b3eeb966-28b5-48bc-9908-b55639a073e1 tempest-ProjectReaderTests-981771145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d20b4b1d-adf8-4b4d-a095-612fb0045203) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:44 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-b3eeb966-28b5-48bc-9908-b55639a073e1 tempest-ProjectReaderTests-981771145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ab011ba-abb7-4e5b-b4df-2fd017d74bd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:44 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-b3eeb966-28b5-48bc-9908-b55639a073e1 tempest-ProjectReaderTests-981771145 None] Volume 9736018a-0654-479a-af91-083cf288e1dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9736018a-0654-479a-af91-083cf288e1dc', 'volume_size': 1} Sep 16 20:27:44 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-b3eeb966-28b5-48bc-9908-b55639a073e1 tempest-ProjectReaderTests-981771145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:27:44 devstack sudo[98198]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:44 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a13b5f8e-a525-420e-b8d0-cadaf96d5c74 tempest-VolumesCloneTest-1349547352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-094fcf71-d1a3-4197-81e4-600e7f665c3c /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-de787a7b-4e05-4bf5-9201-bff98d4366df" returned: 0 in 7.178s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:44 devstack cinder-volume[86188]: DEBUG cinder.image.image_utils [None req-a13b5f8e-a525-420e-b8d0-cadaf96d5c74 tempest-VolumesCloneTest-1349547352 None] Image conversion details: src /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-094fcf71-d1a3-4197-81e4-600e7f665c3c, size 1024.00 MB, duration 7.18 sec, destination /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-de787a7b-4e05-4bf5-9201-bff98d4366df {{(pid=86188) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 16 20:27:44 devstack cinder-volume[86188]: INFO cinder.image.image_utils [None req-a13b5f8e-a525-420e-b8d0-cadaf96d5c74 tempest-VolumesCloneTest-1349547352 None] Converted 1024.00 MB image at 142.63 MB/s Sep 16 20:27:44 devstack cinder-volume[86188]: WARNING cinder.volume.drivers.remotefs [None req-a13b5f8e-a525-420e-b8d0-cadaf96d5c74 tempest-VolumesCloneTest-1349547352 None] /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-de787a7b-4e05-4bf5-9201-bff98d4366df is being set with open permissions: ugo+rw Sep 16 20:27:44 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a13b5f8e-a525-420e-b8d0-cadaf96d5c74 tempest-VolumesCloneTest-1349547352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-de787a7b-4e05-4bf5-9201-bff98d4366df {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:44 devstack sudo[98228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-de787a7b-4e05-4bf5-9201-bff98d4366df Sep 16 20:27:44 devstack sudo[98228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:44 devstack sudo[98228]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:44 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a13b5f8e-a525-420e-b8d0-cadaf96d5c74 tempest-VolumesCloneTest-1349547352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-de787a7b-4e05-4bf5-9201-bff98d4366df" returned: 0 in 0.235s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:44 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-a13b5f8e-a525-420e-b8d0-cadaf96d5c74 tempest-VolumesCloneTest-1349547352 None] Lock "cinder-quobyte-de787a7b-4e05-4bf5-9201-bff98d4366df" released by "_copy_volume_from_snapshot" :: held 8.331s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:27:44 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-a13b5f8e-a525-420e-b8d0-cadaf96d5c74 tempest-VolumesCloneTest-1349547352 None] Acquiring lock "cinder-quobyte-69765ad2-9e30-49c6-9f15-a8b0c60b4657" by "_delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:27:44 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-a13b5f8e-a525-420e-b8d0-cadaf96d5c74 tempest-VolumesCloneTest-1349547352 None] Lock "cinder-quobyte-69765ad2-9e30-49c6-9f15-a8b0c60b4657" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:27:44 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-a13b5f8e-a525-420e-b8d0-cadaf96d5c74 tempest-VolumesCloneTest-1349547352 None] Deleting offline snapshot 69765ad2-9e30-49c6-9f15-a8b0c60b4657 of volume 094fcf71-d1a3-4197-81e4-600e7f665c3c {{(pid=86188) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 20:27:44 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-a13b5f8e-a525-420e-b8d0-cadaf96d5c74 tempest-VolumesCloneTest-1349547352 None] snapshot_file for this snap is: volume-094fcf71-d1a3-4197-81e4-600e7f665c3c.69765ad2-9e30-49c6-9f15-a8b0c60b4657 {{(pid=86188) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 20:27:44 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[565a3aab-f72a-48b7-b594-89658c0d8a04]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:27:44 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a13b5f8e-a525-420e-b8d0-cadaf96d5c74 tempest-VolumesCloneTest-1349547352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-094fcf71-d1a3-4197-81e4-600e7f665c3c.69765ad2-9e30-49c6-9f15-a8b0c60b4657 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:44 devstack sudo[98231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-094fcf71-d1a3-4197-81e4-600e7f665c3c.69765ad2-9e30-49c6-9f15-a8b0c60b4657 Sep 16 20:27:44 devstack sudo[98231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:45 devstack sudo[98231]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:45 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a13b5f8e-a525-420e-b8d0-cadaf96d5c74 tempest-VolumesCloneTest-1349547352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-094fcf71-d1a3-4197-81e4-600e7f665c3c.69765ad2-9e30-49c6-9f15-a8b0c60b4657" returned: 0 in 0.355s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:45 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-a13b5f8e-a525-420e-b8d0-cadaf96d5c74 tempest-VolumesCloneTest-1349547352 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-094fcf71-d1a3-4197-81e4-600e7f665c3c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86188) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 20:27:45 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f3c702e-8f85-47e9-afbc-c185c25bc437]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:27:45 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a13b5f8e-a525-420e-b8d0-cadaf96d5c74 tempest-VolumesCloneTest-1349547352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-094fcf71-d1a3-4197-81e4-600e7f665c3c {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:45 devstack sudo[98236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-094fcf71-d1a3-4197-81e4-600e7f665c3c Sep 16 20:27:45 devstack sudo[98236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:45 devstack sudo[98236]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:45 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a13b5f8e-a525-420e-b8d0-cadaf96d5c74 tempest-VolumesCloneTest-1349547352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-094fcf71-d1a3-4197-81e4-600e7f665c3c" returned: 0 in 0.490s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:45 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a13b5f8e-a525-420e-b8d0-cadaf96d5c74 tempest-VolumesCloneTest-1349547352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-094fcf71-d1a3-4197-81e4-600e7f665c3c.69765ad2-9e30-49c6-9f15-a8b0c60b4657 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:45 devstack sudo[98241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-094fcf71-d1a3-4197-81e4-600e7f665c3c.69765ad2-9e30-49c6-9f15-a8b0c60b4657 Sep 16 20:27:45 devstack sudo[98241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:45 devstack sudo[98241]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:45 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a13b5f8e-a525-420e-b8d0-cadaf96d5c74 tempest-VolumesCloneTest-1349547352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-094fcf71-d1a3-4197-81e4-600e7f665c3c.69765ad2-9e30-49c6-9f15-a8b0c60b4657" returned: 0 in 0.325s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:45 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a13b5f8e-a525-420e-b8d0-cadaf96d5c74 tempest-VolumesCloneTest-1349547352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-094fcf71-d1a3-4197-81e4-600e7f665c3c.69765ad2-9e30-49c6-9f15-a8b0c60b4657 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:45 devstack sudo[98247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-094fcf71-d1a3-4197-81e4-600e7f665c3c.69765ad2-9e30-49c6-9f15-a8b0c60b4657 Sep 16 20:27:45 devstack sudo[98247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:46 devstack sudo[98247]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:46 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a13b5f8e-a525-420e-b8d0-cadaf96d5c74 tempest-VolumesCloneTest-1349547352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-094fcf71-d1a3-4197-81e4-600e7f665c3c.69765ad2-9e30-49c6-9f15-a8b0c60b4657" returned: 0 in 0.258s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:46 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-a13b5f8e-a525-420e-b8d0-cadaf96d5c74 tempest-VolumesCloneTest-1349547352 None] Lock "cinder-quobyte-69765ad2-9e30-49c6-9f15-a8b0c60b4657" released by "_delete_snapshot" :: held 1.515s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:27:46 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a13b5f8e-a525-420e-b8d0-cadaf96d5c74 tempest-VolumesCloneTest-1349547352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.073s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:27:46 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-36517921-f37c-4a48-af76-9258247c8c06 tempest-VolumesTransfersTest-1220370370 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.710s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:27:46 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-36517921-f37c-4a48-af76-9258247c8c06 tempest-VolumesTransfersTest-1220370370 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:27:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-679504801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e760aedf-0f40-481f-a024-c899767a0c4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd3158fc7f554d6db80f9326908ce0df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:27:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:27:34Z,use_quota=True,user_id='32f65c55db0244f0bbf92242b2e5d499',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:27:46 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-36517921-f37c-4a48-af76-9258247c8c06 tempest-VolumesTransfersTest-1220370370 None] Creating volume e760aedf-0f40-481f-a024-c899767a0c4c {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:27:46 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-36517921-f37c-4a48-af76-9258247c8c06 tempest-VolumesTransfersTest-1220370370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:27:46 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-36517921-f37c-4a48-af76-9258247c8c06 tempest-VolumesTransfersTest-1220370370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:27:46 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-36517921-f37c-4a48-af76-9258247c8c06 tempest-VolumesTransfersTest-1220370370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:27:46 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-36517921-f37c-4a48-af76-9258247c8c06 tempest-VolumesTransfersTest-1220370370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:27:46 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-36517921-f37c-4a48-af76-9258247c8c06 tempest-VolumesTransfersTest-1220370370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:27:46 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-36517921-f37c-4a48-af76-9258247c8c06 tempest-VolumesTransfersTest-1220370370 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:27:46 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-36517921-f37c-4a48-af76-9258247c8c06 tempest-VolumesTransfersTest-1220370370 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:27:46 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-36517921-f37c-4a48-af76-9258247c8c06 tempest-VolumesTransfersTest-1220370370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e760aedf-0f40-481f-a024-c899767a0c4c 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:46 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a13b5f8e-a525-420e-b8d0-cadaf96d5c74 tempest-VolumesCloneTest-1349547352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b360b7a-a3a8-45ac-b8de-44fc821d66d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de787a7b-4e05-4bf5-9201-bff98d4366df', 'volume_size': 2, 'source_volid': '094fcf71-d1a3-4197-81e4-600e7f665c3c', 'source_volstatus': 'available'}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:46 devstack sudo[98252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e760aedf-0f40-481f-a024-c899767a0c4c 1073741824 Sep 16 20:27:46 devstack sudo[98252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:46 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a13b5f8e-a525-420e-b8d0-cadaf96d5c74 tempest-VolumesCloneTest-1349547352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8112fa1d-6e80-483d-8ca5-7dda1f38fcea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:46 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-a13b5f8e-a525-420e-b8d0-cadaf96d5c74 tempest-VolumesCloneTest-1349547352 None] Volume volume-de787a7b-4e05-4bf5-9201-bff98d4366df (de787a7b-4e05-4bf5-9201-bff98d4366df): created successfully Sep 16 20:27:46 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a13b5f8e-a525-420e-b8d0-cadaf96d5c74 tempest-VolumesCloneTest-1349547352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8112fa1d-6e80-483d-8ca5-7dda1f38fcea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:46 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a13b5f8e-a525-420e-b8d0-cadaf96d5c74 tempest-VolumesCloneTest-1349547352 None] Flow 'volume_create_manager' (af0a9a40-0064-4a1e-9baa-1c723bfa00bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:27:46 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-a13b5f8e-a525-420e-b8d0-cadaf96d5c74 tempest-VolumesCloneTest-1349547352 None] Created volume successfully. Sep 16 20:27:46 devstack sudo[98252]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:46 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-36517921-f37c-4a48-af76-9258247c8c06 tempest-VolumesTransfersTest-1220370370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e760aedf-0f40-481f-a024-c899767a0c4c 1073741824" returned: 0 in 0.404s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:46 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-36517921-f37c-4a48-af76-9258247c8c06 tempest-VolumesTransfersTest-1220370370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e760aedf-0f40-481f-a024-c899767a0c4c {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:46 devstack sudo[98258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e760aedf-0f40-481f-a024-c899767a0c4c Sep 16 20:27:46 devstack sudo[98258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:46 devstack sudo[98258]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:46 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-36517921-f37c-4a48-af76-9258247c8c06 tempest-VolumesTransfersTest-1220370370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e760aedf-0f40-481f-a024-c899767a0c4c" returned: 0 in 0.242s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:46 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-36517921-f37c-4a48-af76-9258247c8c06 tempest-VolumesTransfersTest-1220370370 None] <== create_volume: return (686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:27:46 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-36517921-f37c-4a48-af76-9258247c8c06 tempest-VolumesTransfersTest-1220370370 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.688s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:27:46 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-b84f4386-67e7-4a28-b593-6de24096cb6e tempest-VolumesImageMetadata-887322385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.387s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:27:46 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-b84f4386-67e7-4a28-b593-6de24096cb6e tempest-VolumesImageMetadata-887322385 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:27:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-338028806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4de48a00-bee9-486e-882a-a70e4d736e47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='754b27392ff845d7abbef201be253231',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:27:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:27:37Z,use_quota=True,user_id='5d55669a68314dd0b6ddae6ed1a932b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:27:46 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-b84f4386-67e7-4a28-b593-6de24096cb6e tempest-VolumesImageMetadata-887322385 None] Creating volume 4de48a00-bee9-486e-882a-a70e4d736e47 {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:27:46 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-b84f4386-67e7-4a28-b593-6de24096cb6e tempest-VolumesImageMetadata-887322385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:27:46 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-b84f4386-67e7-4a28-b593-6de24096cb6e tempest-VolumesImageMetadata-887322385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:27:46 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-b84f4386-67e7-4a28-b593-6de24096cb6e tempest-VolumesImageMetadata-887322385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:27:46 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-b84f4386-67e7-4a28-b593-6de24096cb6e tempest-VolumesImageMetadata-887322385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:27:46 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-b84f4386-67e7-4a28-b593-6de24096cb6e tempest-VolumesImageMetadata-887322385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:27:46 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-b84f4386-67e7-4a28-b593-6de24096cb6e tempest-VolumesImageMetadata-887322385 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:27:46 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-b84f4386-67e7-4a28-b593-6de24096cb6e tempest-VolumesImageMetadata-887322385 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:27:46 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b84f4386-67e7-4a28-b593-6de24096cb6e tempest-VolumesImageMetadata-887322385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-4de48a00-bee9-486e-882a-a70e4d736e47 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:46 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-36517921-f37c-4a48-af76-9258247c8c06 tempest-VolumesTransfersTest-1220370370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a4fd8ba-962a-4718-8061-1e08c86ba20c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e760aedf-0f40-481f-a024-c899767a0c4c', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:46 devstack sudo[98261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-4de48a00-bee9-486e-882a-a70e4d736e47 1073741824 Sep 16 20:27:46 devstack sudo[98261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:46 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-36517921-f37c-4a48-af76-9258247c8c06 tempest-VolumesTransfersTest-1220370370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (893c76e4-15d9-422d-890e-5f392efb2033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:46 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-36517921-f37c-4a48-af76-9258247c8c06 tempest-VolumesTransfersTest-1220370370 None] Volume volume-e760aedf-0f40-481f-a024-c899767a0c4c (e760aedf-0f40-481f-a024-c899767a0c4c): created successfully Sep 16 20:27:46 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-36517921-f37c-4a48-af76-9258247c8c06 tempest-VolumesTransfersTest-1220370370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (893c76e4-15d9-422d-890e-5f392efb2033) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:46 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-36517921-f37c-4a48-af76-9258247c8c06 tempest-VolumesTransfersTest-1220370370 None] Flow 'volume_create_manager' (67449755-3f23-4c2e-ac1b-d84755c14a45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:27:47 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-36517921-f37c-4a48-af76-9258247c8c06 tempest-VolumesTransfersTest-1220370370 None] Created volume successfully. Sep 16 20:27:47 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-e144fb5c-c068-4c2d-957d-8c5d0217d9f4 tempest-VolumesCloneTest-1349547352 None] Acquiring lock "cinder-de787a7b-4e05-4bf5-9201-bff98d4366df-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:27:47 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-e144fb5c-c068-4c2d-957d-8c5d0217d9f4 tempest-VolumesCloneTest-1349547352 None] Lock "cinder-de787a7b-4e05-4bf5-9201-bff98d4366df-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:27:47 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-e144fb5c-c068-4c2d-957d-8c5d0217d9f4 tempest-VolumesCloneTest-1349547352 None] Acquiring lock "cinder-quobyte-de787a7b-4e05-4bf5-9201-bff98d4366df" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:27:47 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-e144fb5c-c068-4c2d-957d-8c5d0217d9f4 tempest-VolumesCloneTest-1349547352 None] Lock "cinder-quobyte-de787a7b-4e05-4bf5-9201-bff98d4366df" acquired by "delete_volume" :: waited 0.017s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:27:47 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9a8750a-51c8-4eba-9179-275dea82aa40]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:27:47 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e144fb5c-c068-4c2d-957d-8c5d0217d9f4 tempest-VolumesCloneTest-1349547352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-de787a7b-4e05-4bf5-9201-bff98d4366df {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:47 devstack sudo[98266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-de787a7b-4e05-4bf5-9201-bff98d4366df Sep 16 20:27:47 devstack sudo[98266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:47 devstack sudo[98261]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:47 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b84f4386-67e7-4a28-b593-6de24096cb6e tempest-VolumesImageMetadata-887322385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-4de48a00-bee9-486e-882a-a70e4d736e47 1073741824" returned: 0 in 0.584s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:47 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b84f4386-67e7-4a28-b593-6de24096cb6e tempest-VolumesImageMetadata-887322385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-4de48a00-bee9-486e-882a-a70e4d736e47 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:47 devstack sudo[98269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-4de48a00-bee9-486e-882a-a70e4d736e47 Sep 16 20:27:47 devstack sudo[98269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:47 devstack sudo[98266]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:47 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e144fb5c-c068-4c2d-957d-8c5d0217d9f4 tempest-VolumesCloneTest-1349547352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-de787a7b-4e05-4bf5-9201-bff98d4366df" returned: 0 in 0.403s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:47 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e144fb5c-c068-4c2d-957d-8c5d0217d9f4 tempest-VolumesCloneTest-1349547352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-de787a7b-4e05-4bf5-9201-bff98d4366df {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:47 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-94e6b047-d2f0-45d5-b41b-b2e1f4cde9dd tempest-VolumesTransfersTest-2007411223 None] Acquiring lock "cinder-e760aedf-0f40-481f-a024-c899767a0c4c-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:27:47 devstack sudo[98274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-de787a7b-4e05-4bf5-9201-bff98d4366df Sep 16 20:27:47 devstack sudo[98274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:47 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-94e6b047-d2f0-45d5-b41b-b2e1f4cde9dd tempest-VolumesTransfersTest-2007411223 None] Lock "cinder-e760aedf-0f40-481f-a024-c899767a0c4c-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:27:47 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-94e6b047-d2f0-45d5-b41b-b2e1f4cde9dd tempest-VolumesTransfersTest-2007411223 None] Acquiring lock "cinder-quobyte-e760aedf-0f40-481f-a024-c899767a0c4c" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:27:47 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-94e6b047-d2f0-45d5-b41b-b2e1f4cde9dd tempest-VolumesTransfersTest-2007411223 None] Lock "cinder-quobyte-e760aedf-0f40-481f-a024-c899767a0c4c" acquired by "delete_volume" :: waited 0.022s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:27:47 devstack sudo[98269]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:47 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b84f4386-67e7-4a28-b593-6de24096cb6e tempest-VolumesImageMetadata-887322385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-4de48a00-bee9-486e-882a-a70e4d736e47" returned: 0 in 0.282s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:47 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-b84f4386-67e7-4a28-b593-6de24096cb6e tempest-VolumesImageMetadata-887322385 None] <== create_volume: return (912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:27:47 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-b84f4386-67e7-4a28-b593-6de24096cb6e tempest-VolumesImageMetadata-887322385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:27:47 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-b3eeb966-28b5-48bc-9908-b55639a073e1 tempest-ProjectReaderTests-981771145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.527s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:27:47 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-b3eeb966-28b5-48bc-9908-b55639a073e1 tempest-ProjectReaderTests-981771145 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:27:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1053862482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9736018a-0654-479a-af91-083cf288e1dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef83d387b0364554a95ff826564f3f6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:27:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:27:44Z,use_quota=True,user_id='23931fcd7d8c46e2837d5d814a16dc07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:27:47 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-b3eeb966-28b5-48bc-9908-b55639a073e1 tempest-ProjectReaderTests-981771145 None] Creating volume 9736018a-0654-479a-af91-083cf288e1dc {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:27:47 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-b3eeb966-28b5-48bc-9908-b55639a073e1 tempest-ProjectReaderTests-981771145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:27:47 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-b3eeb966-28b5-48bc-9908-b55639a073e1 tempest-ProjectReaderTests-981771145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:27:47 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-b3eeb966-28b5-48bc-9908-b55639a073e1 tempest-ProjectReaderTests-981771145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:27:47 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-b3eeb966-28b5-48bc-9908-b55639a073e1 tempest-ProjectReaderTests-981771145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:27:47 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-b3eeb966-28b5-48bc-9908-b55639a073e1 tempest-ProjectReaderTests-981771145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:27:47 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-b3eeb966-28b5-48bc-9908-b55639a073e1 tempest-ProjectReaderTests-981771145 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:27:47 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-b3eeb966-28b5-48bc-9908-b55639a073e1 tempest-ProjectReaderTests-981771145 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:27:47 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b3eeb966-28b5-48bc-9908-b55639a073e1 tempest-ProjectReaderTests-981771145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9736018a-0654-479a-af91-083cf288e1dc 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:47 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6d4b6f9-acc3-4b30-b59b-9191e847dd68]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:27:47 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-94e6b047-d2f0-45d5-b41b-b2e1f4cde9dd tempest-VolumesTransfersTest-2007411223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e760aedf-0f40-481f-a024-c899767a0c4c {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:47 devstack sudo[98277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9736018a-0654-479a-af91-083cf288e1dc 1073741824 Sep 16 20:27:47 devstack sudo[98277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:47 devstack cinder-volume[86188]: DEBUG cinder.volume.volume_utils [None req-b84f4386-67e7-4a28-b593-6de24096cb6e tempest-VolumesImageMetadata-887322385 None] Attempting download of b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e ((None, [{'url': 'file:///opt/stack/data/glance/images/b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e', 'metadata': {}}])) to volume 4de48a00-bee9-486e-882a-a70e4d736e47. {{(pid=86188) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 16 20:27:47 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[7598b9c2-cf86-422b-9cbc-6e631ef34745]: (4, 'raw') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:27:47 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b84f4386-67e7-4a28-b593-6de24096cb6e tempest-VolumesImageMetadata-887322385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e_8pjdvqj2 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:47 devstack sudo[98274]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:47 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e144fb5c-c068-4c2d-957d-8c5d0217d9f4 tempest-VolumesCloneTest-1349547352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-de787a7b-4e05-4bf5-9201-bff98d4366df" returned: 0 in 0.306s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:48 devstack sudo[98278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e760aedf-0f40-481f-a024-c899767a0c4c Sep 16 20:27:48 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-e144fb5c-c068-4c2d-957d-8c5d0217d9f4 tempest-VolumesCloneTest-1349547352 None] Lock "cinder-quobyte-de787a7b-4e05-4bf5-9201-bff98d4366df" released by "delete_volume" :: held 0.764s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:27:48 devstack sudo[98278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:48 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-e144fb5c-c068-4c2d-957d-8c5d0217d9f4 tempest-VolumesCloneTest-1349547352 None] Created reservations ['f83f0561-f6d2-46c0-a45c-fdfede51708e', 'b69d1004-be10-4b34-a45c-f76afaa270a9', '9379efcf-3384-4358-944b-340c2c0b6f17', '0d1dc922-5afb-49a5-a0a4-3c422b4f9831'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:27:48 devstack sudo[98281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e_8pjdvqj2 Sep 16 20:27:48 devstack sudo[98281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:48 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-e144fb5c-c068-4c2d-957d-8c5d0217d9f4 tempest-VolumesCloneTest-1349547352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:27:48 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-e144fb5c-c068-4c2d-957d-8c5d0217d9f4 tempest-VolumesCloneTest-1349547352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:27:48 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-e144fb5c-c068-4c2d-957d-8c5d0217d9f4 tempest-VolumesCloneTest-1349547352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:27:48 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-e144fb5c-c068-4c2d-957d-8c5d0217d9f4 tempest-VolumesCloneTest-1349547352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:27:48 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-e144fb5c-c068-4c2d-957d-8c5d0217d9f4 tempest-VolumesCloneTest-1349547352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:27:48 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e144fb5c-c068-4c2d-957d-8c5d0217d9f4 tempest-VolumesCloneTest-1349547352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:48 devstack sudo[98287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:27:48 devstack sudo[98287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:48 devstack sudo[98281]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:48 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b84f4386-67e7-4a28-b593-6de24096cb6e tempest-VolumesImageMetadata-887322385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e_8pjdvqj2" returned: 0 in 0.384s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:48 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b84f4386-67e7-4a28-b593-6de24096cb6e tempest-VolumesImageMetadata-887322385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e_8pjdvqj2 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:48 devstack sudo[98278]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:48 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-94e6b047-d2f0-45d5-b41b-b2e1f4cde9dd tempest-VolumesTransfersTest-2007411223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e760aedf-0f40-481f-a024-c899767a0c4c" returned: 0 in 0.500s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:48 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-94e6b047-d2f0-45d5-b41b-b2e1f4cde9dd tempest-VolumesTransfersTest-2007411223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e760aedf-0f40-481f-a024-c899767a0c4c {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:48 devstack sudo[98296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e760aedf-0f40-481f-a024-c899767a0c4c Sep 16 20:27:48 devstack sudo[98296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:48 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-66c3c615-2a47-4b93-9d0c-b1e840fd624d tempest-VolumesCloneTest-1349547352 None] Acquiring lock "cinder-094fcf71-d1a3-4197-81e4-600e7f665c3c-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:27:48 devstack sudo[98277]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:48 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b3eeb966-28b5-48bc-9908-b55639a073e1 tempest-ProjectReaderTests-981771145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9736018a-0654-479a-af91-083cf288e1dc 1073741824" returned: 0 in 0.627s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:48 devstack sudo[98295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e_8pjdvqj2 Sep 16 20:27:48 devstack sudo[98295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:48 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-66c3c615-2a47-4b93-9d0c-b1e840fd624d tempest-VolumesCloneTest-1349547352 None] Lock "cinder-094fcf71-d1a3-4197-81e4-600e7f665c3c-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:27:48 devstack sudo[98287]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:48 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e144fb5c-c068-4c2d-957d-8c5d0217d9f4 tempest-VolumesCloneTest-1349547352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.379s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:48 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-e144fb5c-c068-4c2d-957d-8c5d0217d9f4 tempest-VolumesCloneTest-1349547352 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:27:48 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-e144fb5c-c068-4c2d-957d-8c5d0217d9f4 tempest-VolumesCloneTest-1349547352 None] Deleted volume successfully. Sep 16 20:27:48 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b3eeb966-28b5-48bc-9908-b55639a073e1 tempest-ProjectReaderTests-981771145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9736018a-0654-479a-af91-083cf288e1dc {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:48 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-66c3c615-2a47-4b93-9d0c-b1e840fd624d tempest-VolumesCloneTest-1349547352 None] Acquiring lock "cinder-quobyte-094fcf71-d1a3-4197-81e4-600e7f665c3c" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:27:48 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-e144fb5c-c068-4c2d-957d-8c5d0217d9f4 tempest-VolumesCloneTest-1349547352 None] Lock "cinder-de787a7b-4e05-4bf5-9201-bff98d4366df-delete_volume" released by "delete_volume" :: held 1.425s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:27:48 devstack sudo[98300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9736018a-0654-479a-af91-083cf288e1dc Sep 16 20:27:48 devstack sudo[98300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:48 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-66c3c615-2a47-4b93-9d0c-b1e840fd624d tempest-VolumesCloneTest-1349547352 None] Lock "cinder-quobyte-094fcf71-d1a3-4197-81e4-600e7f665c3c" acquired by "delete_volume" :: waited 0.017s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:27:48 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[87b3a5c6-301d-4951-91fc-472c264c2141]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:27:48 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-66c3c615-2a47-4b93-9d0c-b1e840fd624d tempest-VolumesCloneTest-1349547352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-094fcf71-d1a3-4197-81e4-600e7f665c3c {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:48 devstack sudo[98296]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:48 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-94e6b047-d2f0-45d5-b41b-b2e1f4cde9dd tempest-VolumesTransfersTest-2007411223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e760aedf-0f40-481f-a024-c899767a0c4c" returned: 0 in 0.356s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:48 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-94e6b047-d2f0-45d5-b41b-b2e1f4cde9dd tempest-VolumesTransfersTest-2007411223 None] Lock "cinder-quobyte-e760aedf-0f40-481f-a024-c899767a0c4c" released by "delete_volume" :: held 0.943s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:27:48 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-94e6b047-d2f0-45d5-b41b-b2e1f4cde9dd tempest-VolumesTransfersTest-2007411223 None] Created reservations ['d9bd57fe-7ca0-4f1f-829c-6d2924a2a58b', '98cc1d62-2a5f-4c0a-bac9-88452c74b3f1', '6fe8c1e7-39f5-4d18-8f1e-842242ff1d54', '9acde43d-7313-4f13-8b9a-ef692dc447dc'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:27:48 devstack sudo[98303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-094fcf71-d1a3-4197-81e4-600e7f665c3c Sep 16 20:27:48 devstack sudo[98303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:48 devstack sudo[98295]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:48 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b84f4386-67e7-4a28-b593-6de24096cb6e tempest-VolumesImageMetadata-887322385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e_8pjdvqj2" returned: 1 in 0.490s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:48 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b84f4386-67e7-4a28-b593-6de24096cb6e tempest-VolumesImageMetadata-887322385 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e_8pjdvqj2' failed. Not Retrying. {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 16 20:27:48 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[a38afe68-1295-4fd2-ba1d-1a1dca889c0e]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:27:48 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b84f4386-67e7-4a28-b593-6de24096cb6e tempest-VolumesImageMetadata-887322385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e_tlku_qdpdevstack@QuobyteHD {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:48 devstack sudo[98300]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:48 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b3eeb966-28b5-48bc-9908-b55639a073e1 tempest-ProjectReaderTests-981771145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9736018a-0654-479a-af91-083cf288e1dc" returned: 0 in 0.279s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:48 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-b3eeb966-28b5-48bc-9908-b55639a073e1 tempest-ProjectReaderTests-981771145 None] <== create_volume: return (1032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:27:48 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-b3eeb966-28b5-48bc-9908-b55639a073e1 tempest-ProjectReaderTests-981771145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:27:48 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-b3eeb966-28b5-48bc-9908-b55639a073e1 tempest-ProjectReaderTests-981771145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ab011ba-abb7-4e5b-b4df-2fd017d74bd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9736018a-0654-479a-af91-083cf288e1dc', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:48 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-b3eeb966-28b5-48bc-9908-b55639a073e1 tempest-ProjectReaderTests-981771145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71e06f58-7f81-4726-ad0f-bc65e76de0c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:48 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-b3eeb966-28b5-48bc-9908-b55639a073e1 tempest-ProjectReaderTests-981771145 None] Volume volume-9736018a-0654-479a-af91-083cf288e1dc (9736018a-0654-479a-af91-083cf288e1dc): created successfully Sep 16 20:27:48 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-b3eeb966-28b5-48bc-9908-b55639a073e1 tempest-ProjectReaderTests-981771145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71e06f58-7f81-4726-ad0f-bc65e76de0c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:48 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-b3eeb966-28b5-48bc-9908-b55639a073e1 tempest-ProjectReaderTests-981771145 None] Flow 'volume_create_manager' (261ee4c0-dafc-46dd-b0fb-88da134044cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:27:48 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-b3eeb966-28b5-48bc-9908-b55639a073e1 tempest-ProjectReaderTests-981771145 None] Created volume successfully. Sep 16 20:27:48 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-94e6b047-d2f0-45d5-b41b-b2e1f4cde9dd tempest-VolumesTransfersTest-2007411223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:27:48 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-94e6b047-d2f0-45d5-b41b-b2e1f4cde9dd tempest-VolumesTransfersTest-2007411223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:27:48 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-94e6b047-d2f0-45d5-b41b-b2e1f4cde9dd tempest-VolumesTransfersTest-2007411223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:27:48 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-94e6b047-d2f0-45d5-b41b-b2e1f4cde9dd tempest-VolumesTransfersTest-2007411223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:27:48 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-94e6b047-d2f0-45d5-b41b-b2e1f4cde9dd tempest-VolumesTransfersTest-2007411223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:27:48 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-94e6b047-d2f0-45d5-b41b-b2e1f4cde9dd tempest-VolumesTransfersTest-2007411223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:48 devstack sudo[98308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e_tlku_qdpdevstack@QuobyteHD Sep 16 20:27:48 devstack sudo[98308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:48 devstack sudo[98310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:27:48 devstack sudo[98310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:49 devstack sudo[98303]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:49 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-66c3c615-2a47-4b93-9d0c-b1e840fd624d tempest-VolumesCloneTest-1349547352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-094fcf71-d1a3-4197-81e4-600e7f665c3c" returned: 0 in 0.448s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:49 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-66c3c615-2a47-4b93-9d0c-b1e840fd624d tempest-VolumesCloneTest-1349547352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-094fcf71-d1a3-4197-81e4-600e7f665c3c {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:49 devstack sudo[98316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-094fcf71-d1a3-4197-81e4-600e7f665c3c Sep 16 20:27:49 devstack sudo[98316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:49 devstack sudo[98308]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:49 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b84f4386-67e7-4a28-b593-6de24096cb6e tempest-VolumesImageMetadata-887322385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e_tlku_qdpdevstack@QuobyteHD" returned: 0 in 0.383s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:49 devstack cinder-volume[86188]: DEBUG cinder.image.image_utils [None req-b84f4386-67e7-4a28-b593-6de24096cb6e tempest-VolumesImageMetadata-887322385 None] b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e was qcow2, converting to qcow2 {{(pid=86188) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 16 20:27:49 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b84f4386-67e7-4a28-b593-6de24096cb6e tempest-VolumesImageMetadata-887322385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e_tlku_qdpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-4de48a00-bee9-486e-882a-a70e4d736e47 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:49 devstack sudo[98310]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:49 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-94e6b047-d2f0-45d5-b41b-b2e1f4cde9dd tempest-VolumesTransfersTest-2007411223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.327s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:49 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-94e6b047-d2f0-45d5-b41b-b2e1f4cde9dd tempest-VolumesTransfersTest-2007411223 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:27:49 devstack sudo[98323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e_tlku_qdpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-4de48a00-bee9-486e-882a-a70e4d736e47 Sep 16 20:27:49 devstack sudo[98323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:49 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-94e6b047-d2f0-45d5-b41b-b2e1f4cde9dd tempest-VolumesTransfersTest-2007411223 None] Deleted volume successfully. Sep 16 20:27:49 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-94e6b047-d2f0-45d5-b41b-b2e1f4cde9dd tempest-VolumesTransfersTest-2007411223 None] Lock "cinder-e760aedf-0f40-481f-a024-c899767a0c4c-delete_volume" released by "delete_volume" :: held 1.613s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:27:49 devstack sudo[98316]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:49 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-66c3c615-2a47-4b93-9d0c-b1e840fd624d tempest-VolumesCloneTest-1349547352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-094fcf71-d1a3-4197-81e4-600e7f665c3c" returned: 0 in 0.319s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:49 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-66c3c615-2a47-4b93-9d0c-b1e840fd624d tempest-VolumesCloneTest-1349547352 None] Lock "cinder-quobyte-094fcf71-d1a3-4197-81e4-600e7f665c3c" released by "delete_volume" :: held 0.854s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:27:49 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-66c3c615-2a47-4b93-9d0c-b1e840fd624d tempest-VolumesCloneTest-1349547352 None] Created reservations ['4cf9c765-a52f-481e-a34c-50a9a4675d8e', 'e4cf8dae-b183-4e5b-a995-b1a75bdf6f78', '71973337-0638-4145-b73f-f152bbca3846', '6aaef335-a9ab-424c-b7f8-06a0f78add46'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:27:49 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-66c3c615-2a47-4b93-9d0c-b1e840fd624d tempest-VolumesCloneTest-1349547352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:27:49 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-66c3c615-2a47-4b93-9d0c-b1e840fd624d tempest-VolumesCloneTest-1349547352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:27:49 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-66c3c615-2a47-4b93-9d0c-b1e840fd624d tempest-VolumesCloneTest-1349547352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:27:49 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-66c3c615-2a47-4b93-9d0c-b1e840fd624d tempest-VolumesCloneTest-1349547352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:27:49 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-66c3c615-2a47-4b93-9d0c-b1e840fd624d tempest-VolumesCloneTest-1349547352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:27:49 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-66c3c615-2a47-4b93-9d0c-b1e840fd624d tempest-VolumesCloneTest-1349547352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:49 devstack sudo[98329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:27:49 devstack sudo[98329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:49 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-0e56d5cf-e982-4cee-9d92-8cdc413c6365 tempest-ProjectReaderTests-981771145 None] Acquiring lock "cinder-9736018a-0654-479a-af91-083cf288e1dc-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:27:49 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-0e56d5cf-e982-4cee-9d92-8cdc413c6365 tempest-ProjectReaderTests-981771145 None] Lock "cinder-9736018a-0654-479a-af91-083cf288e1dc-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:27:49 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-0e56d5cf-e982-4cee-9d92-8cdc413c6365 tempest-ProjectReaderTests-981771145 None] Acquiring lock "cinder-quobyte-9736018a-0654-479a-af91-083cf288e1dc" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:27:49 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-0e56d5cf-e982-4cee-9d92-8cdc413c6365 tempest-ProjectReaderTests-981771145 None] Lock "cinder-quobyte-9736018a-0654-479a-af91-083cf288e1dc" acquired by "delete_volume" :: waited 0.024s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:27:49 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a7499d9-beba-4768-8746-f647023f7801]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:27:49 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-0e56d5cf-e982-4cee-9d92-8cdc413c6365 tempest-ProjectReaderTests-981771145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9736018a-0654-479a-af91-083cf288e1dc {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:49 devstack sudo[98329]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:49 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-66c3c615-2a47-4b93-9d0c-b1e840fd624d tempest-VolumesCloneTest-1349547352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.345s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:49 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-66c3c615-2a47-4b93-9d0c-b1e840fd624d tempest-VolumesCloneTest-1349547352 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:27:50 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-66c3c615-2a47-4b93-9d0c-b1e840fd624d tempest-VolumesCloneTest-1349547352 None] Deleted volume successfully. Sep 16 20:27:50 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-66c3c615-2a47-4b93-9d0c-b1e840fd624d tempest-VolumesCloneTest-1349547352 None] Lock "cinder-094fcf71-d1a3-4197-81e4-600e7f665c3c-delete_volume" released by "delete_volume" :: held 1.529s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:27:50 devstack sudo[98335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9736018a-0654-479a-af91-083cf288e1dc Sep 16 20:27:50 devstack sudo[98335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:50 devstack sudo[98335]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:50 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-0e56d5cf-e982-4cee-9d92-8cdc413c6365 tempest-ProjectReaderTests-981771145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9736018a-0654-479a-af91-083cf288e1dc" returned: 0 in 0.611s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:50 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-0e56d5cf-e982-4cee-9d92-8cdc413c6365 tempest-ProjectReaderTests-981771145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9736018a-0654-479a-af91-083cf288e1dc {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:50 devstack sudo[98341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9736018a-0654-479a-af91-083cf288e1dc Sep 16 20:27:50 devstack sudo[98341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:50 devstack sudo[98341]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:50 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-0e56d5cf-e982-4cee-9d92-8cdc413c6365 tempest-ProjectReaderTests-981771145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9736018a-0654-479a-af91-083cf288e1dc" returned: 0 in 0.352s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:50 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-0e56d5cf-e982-4cee-9d92-8cdc413c6365 tempest-ProjectReaderTests-981771145 None] Lock "cinder-quobyte-9736018a-0654-479a-af91-083cf288e1dc" released by "delete_volume" :: held 1.026s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:27:50 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-0e56d5cf-e982-4cee-9d92-8cdc413c6365 tempest-ProjectReaderTests-981771145 None] Created reservations ['39ccbf90-e62a-4247-8a25-f83c4b3e4022', 'fef68af8-cda5-4894-9de9-94c446ac78f0', 'd6157282-0113-4c94-9d91-3409af808096', '16cec41b-778a-4ef2-bd7a-dcfdd37858e0'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:27:51 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-0e56d5cf-e982-4cee-9d92-8cdc413c6365 tempest-ProjectReaderTests-981771145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:27:51 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-0e56d5cf-e982-4cee-9d92-8cdc413c6365 tempest-ProjectReaderTests-981771145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:27:51 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-0e56d5cf-e982-4cee-9d92-8cdc413c6365 tempest-ProjectReaderTests-981771145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:27:51 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-0e56d5cf-e982-4cee-9d92-8cdc413c6365 tempest-ProjectReaderTests-981771145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:27:51 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-0e56d5cf-e982-4cee-9d92-8cdc413c6365 tempest-ProjectReaderTests-981771145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:27:51 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-0e56d5cf-e982-4cee-9d92-8cdc413c6365 tempest-ProjectReaderTests-981771145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:51 devstack sudo[98344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:27:51 devstack sudo[98344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:51 devstack sudo[98344]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:51 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-0e56d5cf-e982-4cee-9d92-8cdc413c6365 tempest-ProjectReaderTests-981771145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.304s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:51 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-0e56d5cf-e982-4cee-9d92-8cdc413c6365 tempest-ProjectReaderTests-981771145 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:27:51 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-0e56d5cf-e982-4cee-9d92-8cdc413c6365 tempest-ProjectReaderTests-981771145 None] Deleted volume successfully. Sep 16 20:27:51 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-0e56d5cf-e982-4cee-9d92-8cdc413c6365 tempest-ProjectReaderTests-981771145 None] Lock "cinder-9736018a-0654-479a-af91-083cf288e1dc-delete_volume" released by "delete_volume" :: held 1.681s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:27:51 devstack sudo[98323]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:51 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b84f4386-67e7-4a28-b593-6de24096cb6e tempest-VolumesImageMetadata-887322385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e_tlku_qdpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-4de48a00-bee9-486e-882a-a70e4d736e47" returned: 0 in 2.452s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:51 devstack cinder-volume[86188]: DEBUG cinder.image.image_utils [None req-b84f4386-67e7-4a28-b593-6de24096cb6e tempest-VolumesImageMetadata-887322385 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e_tlku_qdpdevstack@QuobyteHD, size 112.00 MB, duration 2.45 sec, destination /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-4de48a00-bee9-486e-882a-a70e4d736e47 {{(pid=86188) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 16 20:27:51 devstack cinder-volume[86188]: INFO cinder.image.image_utils [None req-b84f4386-67e7-4a28-b593-6de24096cb6e tempest-VolumesImageMetadata-887322385 None] Converted 112.00 MB image at 45.66 MB/s Sep 16 20:27:51 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b84f4386-67e7-4a28-b593-6de24096cb6e tempest-VolumesImageMetadata-887322385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-4de48a00-bee9-486e-882a-a70e4d736e47 1G {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:51 devstack sudo[98347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-4de48a00-bee9-486e-882a-a70e4d736e47 1G Sep 16 20:27:51 devstack sudo[98347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:52 devstack sudo[98347]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:52 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b84f4386-67e7-4a28-b593-6de24096cb6e tempest-VolumesImageMetadata-887322385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-4de48a00-bee9-486e-882a-a70e4d736e47 1G" returned: 0 in 0.444s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:52 devstack cinder-volume[86188]: DEBUG cinder.volume.volume_utils [None req-b84f4386-67e7-4a28-b593-6de24096cb6e tempest-VolumesImageMetadata-887322385 None] Downloaded image b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e ((None, [{'url': 'file:///opt/stack/data/glance/images/b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e', 'metadata': {}}])) to volume 4de48a00-bee9-486e-882a-a70e4d736e47 successfully. {{(pid=86188) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 16 20:27:52 devstack cinder-volume[86188]: DEBUG cinder.image.image_utils [None req-b84f4386-67e7-4a28-b593-6de24096cb6e tempest-VolumesImageMetadata-887322385 None] Temporary image b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e for user 5d55669a68314dd0b6ddae6ed1a932b8 is deleted. {{(pid=86188) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 16 20:27:52 devstack cinder-volume[86188]: DEBUG cinder.volume.volume_utils [None req-b84f4386-67e7-4a28-b593-6de24096cb6e tempest-VolumesImageMetadata-887322385 None] Marking volume 4de48a00-bee9-486e-882a-a70e4d736e47 as bootable. {{(pid=86188) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 16 20:27:52 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-b84f4386-67e7-4a28-b593-6de24096cb6e tempest-VolumesImageMetadata-887322385 None] Copying metadata from image b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e to 4de48a00-bee9-486e-882a-a70e4d736e47. {{(pid=86188) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 16 20:27:52 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-b84f4386-67e7-4a28-b593-6de24096cb6e tempest-VolumesImageMetadata-887322385 None] Creating volume glance metadata for volume 4de48a00-bee9-486e-882a-a70e4d736e47 backed by image b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86188) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 16 20:27:52 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-b84f4386-67e7-4a28-b593-6de24096cb6e tempest-VolumesImageMetadata-887322385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0608a771-129d-4520-8597-b48b273687ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4de48a00-bee9-486e-882a-a70e4d736e47', 'volume_size': 1, 'image_id': 'b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5c9c8eab814247029b6d508a74a1d19e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e', 'created_at': datetime.datetime(2026, 9, 16, 18, 12, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 18, 12, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:52 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-b84f4386-67e7-4a28-b593-6de24096cb6e tempest-VolumesImageMetadata-887322385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8505a441-c1ff-49ff-b0c2-070b6eb3fd5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:52 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-b84f4386-67e7-4a28-b593-6de24096cb6e tempest-VolumesImageMetadata-887322385 None] Volume volume-4de48a00-bee9-486e-882a-a70e4d736e47 (4de48a00-bee9-486e-882a-a70e4d736e47): created successfully Sep 16 20:27:52 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-b84f4386-67e7-4a28-b593-6de24096cb6e tempest-VolumesImageMetadata-887322385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8505a441-c1ff-49ff-b0c2-070b6eb3fd5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:52 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-b84f4386-67e7-4a28-b593-6de24096cb6e tempest-VolumesImageMetadata-887322385 None] Flow 'volume_create_manager' (e50dcf8e-420e-428f-a612-919fd53ebd1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:27:52 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-b84f4386-67e7-4a28-b593-6de24096cb6e tempest-VolumesImageMetadata-887322385 None] Created volume successfully. Sep 16 20:27:52 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0e12979-02ab-4a37-8a3c-7621acff1834 tempest-ProjectReaderTests-981771145 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:27:52 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-c0e12979-02ab-4a37-8a3c-7621acff1834 tempest-ProjectReaderTests-981771145 None] Flow 'volume_create_manager' (68c5177c-74f4-4be9-8378-b0f814832982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:27:52 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-c0e12979-02ab-4a37-8a3c-7621acff1834 tempest-ProjectReaderTests-981771145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8a5ede1-e84b-41c6-8046-5d6f910125f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:52 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-c0e12979-02ab-4a37-8a3c-7621acff1834 tempest-ProjectReaderTests-981771145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8a5ede1-e84b-41c6-8046-5d6f910125f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:27:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1768320909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6679e7b8-2beb-44d2-9581-92017af909eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef83d387b0364554a95ff826564f3f6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:27:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:27:53Z,use_quota=True,user_id='23931fcd7d8c46e2837d5d814a16dc07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:52 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-c0e12979-02ab-4a37-8a3c-7621acff1834 tempest-ProjectReaderTests-981771145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76b1ca4d-2a4a-4b37-b947-c37d24588c36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:52 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-c0e12979-02ab-4a37-8a3c-7621acff1834 tempest-ProjectReaderTests-981771145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76b1ca4d-2a4a-4b37-b947-c37d24588c36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:52 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-c0e12979-02ab-4a37-8a3c-7621acff1834 tempest-ProjectReaderTests-981771145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1985c53d-d7e5-46c7-a1e1-75ea03a4b0b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:52 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-c0e12979-02ab-4a37-8a3c-7621acff1834 tempest-ProjectReaderTests-981771145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1985c53d-d7e5-46c7-a1e1-75ea03a4b0b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6679e7b8-2beb-44d2-9581-92017af909eb', 'volume_name': 'volume-6679e7b8-2beb-44d2-9581-92017af909eb', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:52 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-c0e12979-02ab-4a37-8a3c-7621acff1834 tempest-ProjectReaderTests-981771145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (644d52e1-3987-440b-b837-818fc3769f28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:52 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-c0e12979-02ab-4a37-8a3c-7621acff1834 tempest-ProjectReaderTests-981771145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (644d52e1-3987-440b-b837-818fc3769f28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:52 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-c0e12979-02ab-4a37-8a3c-7621acff1834 tempest-ProjectReaderTests-981771145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7611fa61-b5b5-446b-b011-f5101e4c006a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:52 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-c0e12979-02ab-4a37-8a3c-7621acff1834 tempest-ProjectReaderTests-981771145 None] Volume 6679e7b8-2beb-44d2-9581-92017af909eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6679e7b8-2beb-44d2-9581-92017af909eb', 'volume_size': 1} Sep 16 20:27:52 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-c0e12979-02ab-4a37-8a3c-7621acff1834 tempest-ProjectReaderTests-981771145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:27:52 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-c0e12979-02ab-4a37-8a3c-7621acff1834 tempest-ProjectReaderTests-981771145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:27:52 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-c0e12979-02ab-4a37-8a3c-7621acff1834 tempest-ProjectReaderTests-981771145 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:27:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1768320909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6679e7b8-2beb-44d2-9581-92017af909eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef83d387b0364554a95ff826564f3f6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:27:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:27:53Z,use_quota=True,user_id='23931fcd7d8c46e2837d5d814a16dc07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:27:52 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-c0e12979-02ab-4a37-8a3c-7621acff1834 tempest-ProjectReaderTests-981771145 None] Creating volume 6679e7b8-2beb-44d2-9581-92017af909eb {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:27:52 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-c0e12979-02ab-4a37-8a3c-7621acff1834 tempest-ProjectReaderTests-981771145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:27:52 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-c0e12979-02ab-4a37-8a3c-7621acff1834 tempest-ProjectReaderTests-981771145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:27:52 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-c0e12979-02ab-4a37-8a3c-7621acff1834 tempest-ProjectReaderTests-981771145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:27:52 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-c0e12979-02ab-4a37-8a3c-7621acff1834 tempest-ProjectReaderTests-981771145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:27:52 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-c0e12979-02ab-4a37-8a3c-7621acff1834 tempest-ProjectReaderTests-981771145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:27:52 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-c0e12979-02ab-4a37-8a3c-7621acff1834 tempest-ProjectReaderTests-981771145 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:27:52 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-c0e12979-02ab-4a37-8a3c-7621acff1834 tempest-ProjectReaderTests-981771145 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:27:52 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-c0e12979-02ab-4a37-8a3c-7621acff1834 tempest-ProjectReaderTests-981771145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-6679e7b8-2beb-44d2-9581-92017af909eb 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:52 devstack sudo[98353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-6679e7b8-2beb-44d2-9581-92017af909eb 1073741824 Sep 16 20:27:52 devstack sudo[98353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:53 devstack cinder-volume[86188]: DEBUG oslo_service.periodic_task [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86188) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 20:27:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:27:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:27:53 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:27:53 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:27:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:27:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:53 devstack sudo[98358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:27:53 devstack sudo[98358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:53 devstack sudo[98353]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-c0e12979-02ab-4a37-8a3c-7621acff1834 tempest-ProjectReaderTests-981771145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-6679e7b8-2beb-44d2-9581-92017af909eb 1073741824" returned: 0 in 0.556s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-c0e12979-02ab-4a37-8a3c-7621acff1834 tempest-ProjectReaderTests-981771145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-6679e7b8-2beb-44d2-9581-92017af909eb {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:53 devstack sudo[98361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-6679e7b8-2beb-44d2-9581-92017af909eb Sep 16 20:27:53 devstack sudo[98361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:53 devstack sudo[98358]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.411s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:53 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:27:53 devstack cinder-volume[86188]: DEBUG oslo_service.periodic_task [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Running periodic task VolumeManager._thread_info {{(pid=86188) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 20:27:53 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] thread count: 28 {{(pid=86188) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 16 20:27:53 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] thread info: [<_MainThread(MainThread, started 139858124406912)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86188) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 16 20:27:53 devstack sudo[98361]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-c0e12979-02ab-4a37-8a3c-7621acff1834 tempest-ProjectReaderTests-981771145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-6679e7b8-2beb-44d2-9581-92017af909eb" returned: 0 in 0.317s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:53 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-c0e12979-02ab-4a37-8a3c-7621acff1834 tempest-ProjectReaderTests-981771145 None] <== create_volume: return (923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:27:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-c0e12979-02ab-4a37-8a3c-7621acff1834 tempest-ProjectReaderTests-981771145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.926s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:27:53 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-c0e12979-02ab-4a37-8a3c-7621acff1834 tempest-ProjectReaderTests-981771145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7611fa61-b5b5-446b-b011-f5101e4c006a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6679e7b8-2beb-44d2-9581-92017af909eb', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:53 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-c0e12979-02ab-4a37-8a3c-7621acff1834 tempest-ProjectReaderTests-981771145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (057380ba-659e-4fd3-abec-cf244376fc15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:53 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-c0e12979-02ab-4a37-8a3c-7621acff1834 tempest-ProjectReaderTests-981771145 None] Volume volume-6679e7b8-2beb-44d2-9581-92017af909eb (6679e7b8-2beb-44d2-9581-92017af909eb): created successfully Sep 16 20:27:53 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-c0e12979-02ab-4a37-8a3c-7621acff1834 tempest-ProjectReaderTests-981771145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (057380ba-659e-4fd3-abec-cf244376fc15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:53 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-c0e12979-02ab-4a37-8a3c-7621acff1834 tempest-ProjectReaderTests-981771145 None] Flow 'volume_create_manager' (68c5177c-74f4-4be9-8378-b0f814832982) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:27:53 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-c0e12979-02ab-4a37-8a3c-7621acff1834 tempest-ProjectReaderTests-981771145 None] Created volume successfully. Sep 16 20:27:53 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-8807006a-66c8-4761-8d59-fec05e399e35 tempest-VolumesImageMetadata-887322385 None] Acquiring lock "cinder-4de48a00-bee9-486e-882a-a70e4d736e47-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:27:53 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-8807006a-66c8-4761-8d59-fec05e399e35 tempest-VolumesImageMetadata-887322385 None] Lock "cinder-4de48a00-bee9-486e-882a-a70e4d736e47-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:27:53 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-8807006a-66c8-4761-8d59-fec05e399e35 tempest-VolumesImageMetadata-887322385 None] Acquiring lock "cinder-quobyte-4de48a00-bee9-486e-882a-a70e4d736e47" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:27:53 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-8807006a-66c8-4761-8d59-fec05e399e35 tempest-VolumesImageMetadata-887322385 None] Lock "cinder-quobyte-4de48a00-bee9-486e-882a-a70e4d736e47" acquired by "delete_volume" :: waited 0.016s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:27:53 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[049c65f5-27b8-4034-8bc8-d5d2af955655]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:27:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-8807006a-66c8-4761-8d59-fec05e399e35 tempest-VolumesImageMetadata-887322385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-4de48a00-bee9-486e-882a-a70e4d736e47 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:54 devstack sudo[98365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-4de48a00-bee9-486e-882a-a70e4d736e47 Sep 16 20:27:54 devstack sudo[98365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:54 devstack sudo[98365]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:54 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-8807006a-66c8-4761-8d59-fec05e399e35 tempest-VolumesImageMetadata-887322385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-4de48a00-bee9-486e-882a-a70e4d736e47" returned: 0 in 0.417s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:54 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-8807006a-66c8-4761-8d59-fec05e399e35 tempest-VolumesImageMetadata-887322385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-4de48a00-bee9-486e-882a-a70e4d736e47 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:54 devstack sudo[98370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-4de48a00-bee9-486e-882a-a70e4d736e47 Sep 16 20:27:54 devstack sudo[98370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:54 devstack sudo[98370]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:54 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-8807006a-66c8-4761-8d59-fec05e399e35 tempest-VolumesImageMetadata-887322385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-4de48a00-bee9-486e-882a-a70e4d736e47" returned: 0 in 0.293s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:54 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-8807006a-66c8-4761-8d59-fec05e399e35 tempest-VolumesImageMetadata-887322385 None] Lock "cinder-quobyte-4de48a00-bee9-486e-882a-a70e4d736e47" released by "delete_volume" :: held 0.772s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:27:54 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-8807006a-66c8-4761-8d59-fec05e399e35 tempest-VolumesImageMetadata-887322385 None] Created reservations ['dbdc191e-5d3e-4ffa-b470-a036bbe9b485', 'c31121a1-3eb0-4df6-b53e-610c2f537dae', '0279a7ca-3cf9-4f23-aaa2-6f98dada758a', '10b3e364-b836-447e-8737-566609b6f230'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:27:54 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-e88f3374-5182-4218-b19b-89b4e317865b tempest-ProjectReaderTests-981771145 None] Acquiring lock "cinder-6679e7b8-2beb-44d2-9581-92017af909eb-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:27:54 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-e88f3374-5182-4218-b19b-89b4e317865b tempest-ProjectReaderTests-981771145 None] Lock "cinder-6679e7b8-2beb-44d2-9581-92017af909eb-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:27:54 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-e88f3374-5182-4218-b19b-89b4e317865b tempest-ProjectReaderTests-981771145 None] Acquiring lock "cinder-quobyte-6679e7b8-2beb-44d2-9581-92017af909eb" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:27:54 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-e88f3374-5182-4218-b19b-89b4e317865b tempest-ProjectReaderTests-981771145 None] Lock "cinder-quobyte-6679e7b8-2beb-44d2-9581-92017af909eb" acquired by "delete_volume" :: waited 0.044s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:27:54 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-8807006a-66c8-4761-8d59-fec05e399e35 tempest-VolumesImageMetadata-887322385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:27:54 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-8807006a-66c8-4761-8d59-fec05e399e35 tempest-VolumesImageMetadata-887322385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:27:54 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-8807006a-66c8-4761-8d59-fec05e399e35 tempest-VolumesImageMetadata-887322385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:27:54 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-8807006a-66c8-4761-8d59-fec05e399e35 tempest-VolumesImageMetadata-887322385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:27:54 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-8807006a-66c8-4761-8d59-fec05e399e35 tempest-VolumesImageMetadata-887322385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:27:54 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-8807006a-66c8-4761-8d59-fec05e399e35 tempest-VolumesImageMetadata-887322385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:54 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e41da12-3838-468e-b440-187629fc49f3]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:27:54 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e88f3374-5182-4218-b19b-89b4e317865b tempest-ProjectReaderTests-981771145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-6679e7b8-2beb-44d2-9581-92017af909eb {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:54 devstack sudo[98373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:27:54 devstack sudo[98373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:55 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1b7b94b-2e51-418d-87a6-08dde694b8ea tempest-VolumesCloneNegativeTest-716420998 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:27:55 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-c1b7b94b-2e51-418d-87a6-08dde694b8ea tempest-VolumesCloneNegativeTest-716420998 None] Flow 'volume_create_manager' (c774d18d-c602-4d43-9227-3971b32ff633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:27:55 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-c1b7b94b-2e51-418d-87a6-08dde694b8ea tempest-VolumesCloneNegativeTest-716420998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddf001b4-7c69-453b-8ace-faa83a966c90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:55 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-c1b7b94b-2e51-418d-87a6-08dde694b8ea tempest-VolumesCloneNegativeTest-716420998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddf001b4-7c69-453b-8ace-faa83a966c90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:27:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1335945387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6ab34b3-7aec-4f2d-a785-136ef2cd3c3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adf528710d7a49a9a35799ebfa273540',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:27:55Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:27:55Z,use_quota=True,user_id='33738db48cbb4bca802864da04afe40e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:55 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-c1b7b94b-2e51-418d-87a6-08dde694b8ea tempest-VolumesCloneNegativeTest-716420998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a5c4a41-5cd7-46d0-b746-5759d846b0f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:55 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-c1b7b94b-2e51-418d-87a6-08dde694b8ea tempest-VolumesCloneNegativeTest-716420998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a5c4a41-5cd7-46d0-b746-5759d846b0f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:55 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-c1b7b94b-2e51-418d-87a6-08dde694b8ea tempest-VolumesCloneNegativeTest-716420998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aea9b45f-1fbf-4aec-a3b6-76be6cdc79e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:55 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-c1b7b94b-2e51-418d-87a6-08dde694b8ea tempest-VolumesCloneNegativeTest-716420998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aea9b45f-1fbf-4aec-a3b6-76be6cdc79e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6ab34b3-7aec-4f2d-a785-136ef2cd3c3a', 'volume_name': 'volume-d6ab34b3-7aec-4f2d-a785-136ef2cd3c3a', 'volume_size': 2}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:55 devstack sudo[98374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-6679e7b8-2beb-44d2-9581-92017af909eb Sep 16 20:27:55 devstack sudo[98374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:55 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-c1b7b94b-2e51-418d-87a6-08dde694b8ea tempest-VolumesCloneNegativeTest-716420998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d25a528-b33c-4f9b-85ef-ac50a19eb439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:55 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-c1b7b94b-2e51-418d-87a6-08dde694b8ea tempest-VolumesCloneNegativeTest-716420998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d25a528-b33c-4f9b-85ef-ac50a19eb439) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:55 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-c1b7b94b-2e51-418d-87a6-08dde694b8ea tempest-VolumesCloneNegativeTest-716420998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc904dfc-68d6-42ba-92c0-5d6ba1847345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:55 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-c1b7b94b-2e51-418d-87a6-08dde694b8ea tempest-VolumesCloneNegativeTest-716420998 None] Volume d6ab34b3-7aec-4f2d-a785-136ef2cd3c3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6ab34b3-7aec-4f2d-a785-136ef2cd3c3a', 'volume_size': 2} Sep 16 20:27:55 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-c1b7b94b-2e51-418d-87a6-08dde694b8ea tempest-VolumesCloneNegativeTest-716420998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:27:55 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-c1b7b94b-2e51-418d-87a6-08dde694b8ea tempest-VolumesCloneNegativeTest-716420998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:27:55 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-c1b7b94b-2e51-418d-87a6-08dde694b8ea tempest-VolumesCloneNegativeTest-716420998 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:27:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1335945387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6ab34b3-7aec-4f2d-a785-136ef2cd3c3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adf528710d7a49a9a35799ebfa273540',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:27:55Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:27:55Z,use_quota=True,user_id='33738db48cbb4bca802864da04afe40e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:27:55 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-c1b7b94b-2e51-418d-87a6-08dde694b8ea tempest-VolumesCloneNegativeTest-716420998 None] Creating volume d6ab34b3-7aec-4f2d-a785-136ef2cd3c3a {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:27:55 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-c1b7b94b-2e51-418d-87a6-08dde694b8ea tempest-VolumesCloneNegativeTest-716420998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:27:55 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-c1b7b94b-2e51-418d-87a6-08dde694b8ea tempest-VolumesCloneNegativeTest-716420998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:27:55 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-c1b7b94b-2e51-418d-87a6-08dde694b8ea tempest-VolumesCloneNegativeTest-716420998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:27:55 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-c1b7b94b-2e51-418d-87a6-08dde694b8ea tempest-VolumesCloneNegativeTest-716420998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:27:55 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-c1b7b94b-2e51-418d-87a6-08dde694b8ea tempest-VolumesCloneNegativeTest-716420998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:27:55 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-c1b7b94b-2e51-418d-87a6-08dde694b8ea tempest-VolumesCloneNegativeTest-716420998 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:27:55 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-c1b7b94b-2e51-418d-87a6-08dde694b8ea tempest-VolumesCloneNegativeTest-716420998 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:27:55 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-c1b7b94b-2e51-418d-87a6-08dde694b8ea tempest-VolumesCloneNegativeTest-716420998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d6ab34b3-7aec-4f2d-a785-136ef2cd3c3a 2147483648 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:55 devstack sudo[98378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d6ab34b3-7aec-4f2d-a785-136ef2cd3c3a 2147483648 Sep 16 20:27:55 devstack sudo[98378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:55 devstack sudo[98373]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:55 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-8807006a-66c8-4761-8d59-fec05e399e35 tempest-VolumesImageMetadata-887322385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.338s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:55 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-8807006a-66c8-4761-8d59-fec05e399e35 tempest-VolumesImageMetadata-887322385 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:27:55 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-8807006a-66c8-4761-8d59-fec05e399e35 tempest-VolumesImageMetadata-887322385 None] Deleted volume successfully. Sep 16 20:27:55 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-8807006a-66c8-4761-8d59-fec05e399e35 tempest-VolumesImageMetadata-887322385 None] Lock "cinder-4de48a00-bee9-486e-882a-a70e4d736e47-delete_volume" released by "delete_volume" :: held 1.462s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:27:55 devstack sudo[98374]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:55 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e88f3374-5182-4218-b19b-89b4e317865b tempest-ProjectReaderTests-981771145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-6679e7b8-2beb-44d2-9581-92017af909eb" returned: 0 in 0.657s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:55 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e88f3374-5182-4218-b19b-89b4e317865b tempest-ProjectReaderTests-981771145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-6679e7b8-2beb-44d2-9581-92017af909eb {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:55 devstack sudo[98417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-6679e7b8-2beb-44d2-9581-92017af909eb Sep 16 20:27:55 devstack sudo[98417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:55 devstack sudo[98417]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:55 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e88f3374-5182-4218-b19b-89b4e317865b tempest-ProjectReaderTests-981771145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-6679e7b8-2beb-44d2-9581-92017af909eb" returned: 0 in 0.367s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:55 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-e88f3374-5182-4218-b19b-89b4e317865b tempest-ProjectReaderTests-981771145 None] Lock "cinder-quobyte-6679e7b8-2beb-44d2-9581-92017af909eb" released by "delete_volume" :: held 1.095s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:27:56 devstack sudo[98378]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:56 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-c1b7b94b-2e51-418d-87a6-08dde694b8ea tempest-VolumesCloneNegativeTest-716420998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d6ab34b3-7aec-4f2d-a785-136ef2cd3c3a 2147483648" returned: 0 in 0.844s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:56 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-e88f3374-5182-4218-b19b-89b4e317865b tempest-ProjectReaderTests-981771145 None] Created reservations ['394325d7-0155-436d-958c-c3ee5c5174ba', '602bc244-8a61-4c8b-98e2-3bd7e7798a9f', '58885f56-8b8e-40f2-bbbb-e8dd8141f523', '04ec103b-3e8c-49c0-9b23-40c9fd09a838'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:27:56 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-c1b7b94b-2e51-418d-87a6-08dde694b8ea tempest-VolumesCloneNegativeTest-716420998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d6ab34b3-7aec-4f2d-a785-136ef2cd3c3a {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:56 devstack sudo[98426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d6ab34b3-7aec-4f2d-a785-136ef2cd3c3a Sep 16 20:27:56 devstack sudo[98426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:56 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-e88f3374-5182-4218-b19b-89b4e317865b tempest-ProjectReaderTests-981771145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:27:56 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-e88f3374-5182-4218-b19b-89b4e317865b tempest-ProjectReaderTests-981771145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:27:56 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-e88f3374-5182-4218-b19b-89b4e317865b tempest-ProjectReaderTests-981771145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:27:56 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-e88f3374-5182-4218-b19b-89b4e317865b tempest-ProjectReaderTests-981771145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:27:56 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-e88f3374-5182-4218-b19b-89b4e317865b tempest-ProjectReaderTests-981771145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:27:56 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e88f3374-5182-4218-b19b-89b4e317865b tempest-ProjectReaderTests-981771145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:56 devstack sudo[98428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:27:56 devstack sudo[98428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:56 devstack sudo[98426]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:56 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-c1b7b94b-2e51-418d-87a6-08dde694b8ea tempest-VolumesCloneNegativeTest-716420998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d6ab34b3-7aec-4f2d-a785-136ef2cd3c3a" returned: 0 in 0.323s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:56 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-c1b7b94b-2e51-418d-87a6-08dde694b8ea tempest-VolumesCloneNegativeTest-716420998 None] <== create_volume: return (1231ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:27:56 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-c1b7b94b-2e51-418d-87a6-08dde694b8ea tempest-VolumesCloneNegativeTest-716420998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.233s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:27:56 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-c1b7b94b-2e51-418d-87a6-08dde694b8ea tempest-VolumesCloneNegativeTest-716420998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc904dfc-68d6-42ba-92c0-5d6ba1847345) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6ab34b3-7aec-4f2d-a785-136ef2cd3c3a', 'volume_size': 2}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:56 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-c1b7b94b-2e51-418d-87a6-08dde694b8ea tempest-VolumesCloneNegativeTest-716420998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9acf48ba-c3b5-4716-a506-65182433e8c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:27:56 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-c1b7b94b-2e51-418d-87a6-08dde694b8ea tempest-VolumesCloneNegativeTest-716420998 None] Volume volume-d6ab34b3-7aec-4f2d-a785-136ef2cd3c3a (d6ab34b3-7aec-4f2d-a785-136ef2cd3c3a): created successfully Sep 16 20:27:56 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-c1b7b94b-2e51-418d-87a6-08dde694b8ea tempest-VolumesCloneNegativeTest-716420998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9acf48ba-c3b5-4716-a506-65182433e8c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:27:56 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-c1b7b94b-2e51-418d-87a6-08dde694b8ea tempest-VolumesCloneNegativeTest-716420998 None] Flow 'volume_create_manager' (c774d18d-c602-4d43-9227-3971b32ff633) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:27:56 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-c1b7b94b-2e51-418d-87a6-08dde694b8ea tempest-VolumesCloneNegativeTest-716420998 None] Created volume successfully. Sep 16 20:27:56 devstack sudo[98428]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:56 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e88f3374-5182-4218-b19b-89b4e317865b tempest-ProjectReaderTests-981771145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.310s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:56 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-e88f3374-5182-4218-b19b-89b4e317865b tempest-ProjectReaderTests-981771145 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:27:56 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-e88f3374-5182-4218-b19b-89b4e317865b tempest-ProjectReaderTests-981771145 None] Deleted volume successfully. Sep 16 20:27:56 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-e88f3374-5182-4218-b19b-89b4e317865b tempest-ProjectReaderTests-981771145 None] Lock "cinder-6679e7b8-2beb-44d2-9581-92017af909eb-delete_volume" released by "delete_volume" :: held 1.764s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:27:57 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-e3cca0f1-5c30-47cf-996f-7565535433c4 tempest-VolumesCloneNegativeTest-716420998 None] Acquiring lock "cinder-d6ab34b3-7aec-4f2d-a785-136ef2cd3c3a-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:27:57 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-e3cca0f1-5c30-47cf-996f-7565535433c4 tempest-VolumesCloneNegativeTest-716420998 None] Lock "cinder-d6ab34b3-7aec-4f2d-a785-136ef2cd3c3a-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:27:57 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-e3cca0f1-5c30-47cf-996f-7565535433c4 tempest-VolumesCloneNegativeTest-716420998 None] Acquiring lock "cinder-quobyte-d6ab34b3-7aec-4f2d-a785-136ef2cd3c3a" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:27:57 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-e3cca0f1-5c30-47cf-996f-7565535433c4 tempest-VolumesCloneNegativeTest-716420998 None] Lock "cinder-quobyte-d6ab34b3-7aec-4f2d-a785-136ef2cd3c3a" acquired by "delete_volume" :: waited 0.036s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:27:57 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[adca3e03-cbee-4b94-8bae-34ae1640cc10]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:27:57 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e3cca0f1-5c30-47cf-996f-7565535433c4 tempest-VolumesCloneNegativeTest-716420998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d6ab34b3-7aec-4f2d-a785-136ef2cd3c3a {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:57 devstack sudo[98432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d6ab34b3-7aec-4f2d-a785-136ef2cd3c3a Sep 16 20:27:57 devstack sudo[98432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:58 devstack sudo[98432]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:58 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e3cca0f1-5c30-47cf-996f-7565535433c4 tempest-VolumesCloneNegativeTest-716420998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d6ab34b3-7aec-4f2d-a785-136ef2cd3c3a" returned: 0 in 0.466s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:58 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e3cca0f1-5c30-47cf-996f-7565535433c4 tempest-VolumesCloneNegativeTest-716420998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d6ab34b3-7aec-4f2d-a785-136ef2cd3c3a {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:58 devstack sudo[98437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d6ab34b3-7aec-4f2d-a785-136ef2cd3c3a Sep 16 20:27:58 devstack sudo[98437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:58 devstack sudo[98437]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:58 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e3cca0f1-5c30-47cf-996f-7565535433c4 tempest-VolumesCloneNegativeTest-716420998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d6ab34b3-7aec-4f2d-a785-136ef2cd3c3a" returned: 0 in 0.321s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:58 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-e3cca0f1-5c30-47cf-996f-7565535433c4 tempest-VolumesCloneNegativeTest-716420998 None] Lock "cinder-quobyte-d6ab34b3-7aec-4f2d-a785-136ef2cd3c3a" released by "delete_volume" :: held 0.862s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:27:58 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-e3cca0f1-5c30-47cf-996f-7565535433c4 tempest-VolumesCloneNegativeTest-716420998 None] Created reservations ['d1636d2d-6272-40ef-9f1f-df4a8fed5ed5', 'cbb5a19b-d67f-472a-b6c6-5d55f2bb5eac', 'de97ca6e-78dc-4768-af05-3c032c8310c6', 'fef649c8-cbb5-4bc2-a778-4f4a43098720'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:27:58 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-e3cca0f1-5c30-47cf-996f-7565535433c4 tempest-VolumesCloneNegativeTest-716420998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:27:58 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-e3cca0f1-5c30-47cf-996f-7565535433c4 tempest-VolumesCloneNegativeTest-716420998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:27:58 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-e3cca0f1-5c30-47cf-996f-7565535433c4 tempest-VolumesCloneNegativeTest-716420998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:27:58 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-e3cca0f1-5c30-47cf-996f-7565535433c4 tempest-VolumesCloneNegativeTest-716420998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:27:58 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-e3cca0f1-5c30-47cf-996f-7565535433c4 tempest-VolumesCloneNegativeTest-716420998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:27:58 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e3cca0f1-5c30-47cf-996f-7565535433c4 tempest-VolumesCloneNegativeTest-716420998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:27:58 devstack sudo[98440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:27:58 devstack sudo[98440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:27:58 devstack sudo[98440]: pam_unix(sudo:session): session closed for user root Sep 16 20:27:58 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e3cca0f1-5c30-47cf-996f-7565535433c4 tempest-VolumesCloneNegativeTest-716420998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.398s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:27:58 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-e3cca0f1-5c30-47cf-996f-7565535433c4 tempest-VolumesCloneNegativeTest-716420998 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:27:59 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-e3cca0f1-5c30-47cf-996f-7565535433c4 tempest-VolumesCloneNegativeTest-716420998 None] Deleted volume successfully. Sep 16 20:27:59 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-e3cca0f1-5c30-47cf-996f-7565535433c4 tempest-VolumesCloneNegativeTest-716420998 None] Lock "cinder-d6ab34b3-7aec-4f2d-a785-136ef2cd3c3a-delete_volume" released by "delete_volume" :: held 1.639s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:28:04 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ad55c3d-8fb2-4af7-b8da-d3fa027b7e2f tempest-VolumesSnapshotNegativeTestJSON-1050560072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:28:04 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-1ad55c3d-8fb2-4af7-b8da-d3fa027b7e2f tempest-VolumesSnapshotNegativeTestJSON-1050560072 None] Flow 'volume_create_manager' (1e58a696-4963-4bef-8061-ca767c6399b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:28:04 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-1ad55c3d-8fb2-4af7-b8da-d3fa027b7e2f tempest-VolumesSnapshotNegativeTestJSON-1050560072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94958aa6-58b4-43de-876b-eb405c6c7254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:28:04 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-1ad55c3d-8fb2-4af7-b8da-d3fa027b7e2f tempest-VolumesSnapshotNegativeTestJSON-1050560072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94958aa6-58b4-43de-876b-eb405c6c7254) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:28:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-289613680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e1a2a70-a9ea-496b-9f49-c96231ce82f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3849962bb66441c93cf309d542aa063',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:28:04Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:28:04Z,use_quota=True,user_id='663bbd0798eb4e9486c426e37a40f3fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:28:04 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-1ad55c3d-8fb2-4af7-b8da-d3fa027b7e2f tempest-VolumesSnapshotNegativeTestJSON-1050560072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a97502ae-d053-4d67-b2da-17b6e8c5193f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:28:04 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-1ad55c3d-8fb2-4af7-b8da-d3fa027b7e2f tempest-VolumesSnapshotNegativeTestJSON-1050560072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a97502ae-d053-4d67-b2da-17b6e8c5193f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:28:04 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-1ad55c3d-8fb2-4af7-b8da-d3fa027b7e2f tempest-VolumesSnapshotNegativeTestJSON-1050560072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb15d0a4-bf44-4880-af5e-0e6441d1deae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:28:04 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-1ad55c3d-8fb2-4af7-b8da-d3fa027b7e2f tempest-VolumesSnapshotNegativeTestJSON-1050560072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb15d0a4-bf44-4880-af5e-0e6441d1deae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e1a2a70-a9ea-496b-9f49-c96231ce82f1', 'volume_name': 'volume-7e1a2a70-a9ea-496b-9f49-c96231ce82f1', 'volume_size': 2}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:28:04 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-1ad55c3d-8fb2-4af7-b8da-d3fa027b7e2f tempest-VolumesSnapshotNegativeTestJSON-1050560072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (971463aa-b4d0-40fb-bbd5-011f2689108a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:28:04 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-1ad55c3d-8fb2-4af7-b8da-d3fa027b7e2f tempest-VolumesSnapshotNegativeTestJSON-1050560072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (971463aa-b4d0-40fb-bbd5-011f2689108a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:28:04 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-1ad55c3d-8fb2-4af7-b8da-d3fa027b7e2f tempest-VolumesSnapshotNegativeTestJSON-1050560072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06e3f87f-c0d5-4635-bbbc-361fef2267e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:28:04 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-1ad55c3d-8fb2-4af7-b8da-d3fa027b7e2f tempest-VolumesSnapshotNegativeTestJSON-1050560072 None] Volume 7e1a2a70-a9ea-496b-9f49-c96231ce82f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e1a2a70-a9ea-496b-9f49-c96231ce82f1', 'volume_size': 2} Sep 16 20:28:04 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-1ad55c3d-8fb2-4af7-b8da-d3fa027b7e2f tempest-VolumesSnapshotNegativeTestJSON-1050560072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:28:04 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-1ad55c3d-8fb2-4af7-b8da-d3fa027b7e2f tempest-VolumesSnapshotNegativeTestJSON-1050560072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:28:04 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-1ad55c3d-8fb2-4af7-b8da-d3fa027b7e2f tempest-VolumesSnapshotNegativeTestJSON-1050560072 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:28:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-289613680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e1a2a70-a9ea-496b-9f49-c96231ce82f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3849962bb66441c93cf309d542aa063',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:28:04Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:28:04Z,use_quota=True,user_id='663bbd0798eb4e9486c426e37a40f3fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:28:04 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-1ad55c3d-8fb2-4af7-b8da-d3fa027b7e2f tempest-VolumesSnapshotNegativeTestJSON-1050560072 None] Creating volume 7e1a2a70-a9ea-496b-9f49-c96231ce82f1 {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:28:04 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-1ad55c3d-8fb2-4af7-b8da-d3fa027b7e2f tempest-VolumesSnapshotNegativeTestJSON-1050560072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:28:04 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-1ad55c3d-8fb2-4af7-b8da-d3fa027b7e2f tempest-VolumesSnapshotNegativeTestJSON-1050560072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:28:04 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-1ad55c3d-8fb2-4af7-b8da-d3fa027b7e2f tempest-VolumesSnapshotNegativeTestJSON-1050560072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:28:04 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-1ad55c3d-8fb2-4af7-b8da-d3fa027b7e2f tempest-VolumesSnapshotNegativeTestJSON-1050560072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:28:04 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-1ad55c3d-8fb2-4af7-b8da-d3fa027b7e2f tempest-VolumesSnapshotNegativeTestJSON-1050560072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:28:04 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-1ad55c3d-8fb2-4af7-b8da-d3fa027b7e2f tempest-VolumesSnapshotNegativeTestJSON-1050560072 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:28:04 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-1ad55c3d-8fb2-4af7-b8da-d3fa027b7e2f tempest-VolumesSnapshotNegativeTestJSON-1050560072 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:28:04 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-1ad55c3d-8fb2-4af7-b8da-d3fa027b7e2f tempest-VolumesSnapshotNegativeTestJSON-1050560072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-7e1a2a70-a9ea-496b-9f49-c96231ce82f1 2147483648 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:28:04 devstack sudo[98444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-7e1a2a70-a9ea-496b-9f49-c96231ce82f1 2147483648 Sep 16 20:28:04 devstack sudo[98444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:28:05 devstack sudo[98444]: pam_unix(sudo:session): session closed for user root Sep 16 20:28:05 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-1ad55c3d-8fb2-4af7-b8da-d3fa027b7e2f tempest-VolumesSnapshotNegativeTestJSON-1050560072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-7e1a2a70-a9ea-496b-9f49-c96231ce82f1 2147483648" returned: 0 in 0.694s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:28:05 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-1ad55c3d-8fb2-4af7-b8da-d3fa027b7e2f tempest-VolumesSnapshotNegativeTestJSON-1050560072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-7e1a2a70-a9ea-496b-9f49-c96231ce82f1 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:28:05 devstack sudo[98457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-7e1a2a70-a9ea-496b-9f49-c96231ce82f1 Sep 16 20:28:05 devstack sudo[98457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:28:05 devstack sudo[98457]: pam_unix(sudo:session): session closed for user root Sep 16 20:28:05 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-1ad55c3d-8fb2-4af7-b8da-d3fa027b7e2f tempest-VolumesSnapshotNegativeTestJSON-1050560072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-7e1a2a70-a9ea-496b-9f49-c96231ce82f1" returned: 0 in 0.317s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:28:05 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-1ad55c3d-8fb2-4af7-b8da-d3fa027b7e2f tempest-VolumesSnapshotNegativeTestJSON-1050560072 None] <== create_volume: return (1071ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:28:05 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-1ad55c3d-8fb2-4af7-b8da-d3fa027b7e2f tempest-VolumesSnapshotNegativeTestJSON-1050560072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.073s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:28:05 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-1ad55c3d-8fb2-4af7-b8da-d3fa027b7e2f tempest-VolumesSnapshotNegativeTestJSON-1050560072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06e3f87f-c0d5-4635-bbbc-361fef2267e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e1a2a70-a9ea-496b-9f49-c96231ce82f1', 'volume_size': 2}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:28:05 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-1ad55c3d-8fb2-4af7-b8da-d3fa027b7e2f tempest-VolumesSnapshotNegativeTestJSON-1050560072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (108c290a-8609-4901-9a98-d662755b89dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:28:05 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-1ad55c3d-8fb2-4af7-b8da-d3fa027b7e2f tempest-VolumesSnapshotNegativeTestJSON-1050560072 None] Volume volume-7e1a2a70-a9ea-496b-9f49-c96231ce82f1 (7e1a2a70-a9ea-496b-9f49-c96231ce82f1): created successfully Sep 16 20:28:05 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-1ad55c3d-8fb2-4af7-b8da-d3fa027b7e2f tempest-VolumesSnapshotNegativeTestJSON-1050560072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (108c290a-8609-4901-9a98-d662755b89dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:28:05 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-1ad55c3d-8fb2-4af7-b8da-d3fa027b7e2f tempest-VolumesSnapshotNegativeTestJSON-1050560072 None] Flow 'volume_create_manager' (1e58a696-4963-4bef-8061-ca767c6399b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:28:05 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-1ad55c3d-8fb2-4af7-b8da-d3fa027b7e2f tempest-VolumesSnapshotNegativeTestJSON-1050560072 None] Created volume successfully. Sep 16 20:28:06 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d1a94fb-c903-47e6-bbff-9fdee3afbda2 tempest-AbsoluteLimitsTests-419920122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:28:06 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-1d1a94fb-c903-47e6-bbff-9fdee3afbda2 tempest-AbsoluteLimitsTests-419920122 None] Flow 'volume_create_manager' (d2c43baa-88be-40c2-8928-4f725d6be515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:28:06 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-1d1a94fb-c903-47e6-bbff-9fdee3afbda2 tempest-AbsoluteLimitsTests-419920122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (105197f5-c95f-472d-803b-b102df636145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:28:06 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-1d1a94fb-c903-47e6-bbff-9fdee3afbda2 tempest-AbsoluteLimitsTests-419920122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (105197f5-c95f-472d-803b-b102df636145) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:28:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-428552012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed4e9167-efbc-49a6-9de0-c768b9761f46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b75c2280a82141e2ab0fab6ec22ee5c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:28:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:28:06Z,use_quota=True,user_id='48dfaa06159f403ab3802bed172cb942',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:28:06 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-1d1a94fb-c903-47e6-bbff-9fdee3afbda2 tempest-AbsoluteLimitsTests-419920122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2476d818-4b4f-4860-9d1b-6314b85f1fa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:28:06 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-1d1a94fb-c903-47e6-bbff-9fdee3afbda2 tempest-AbsoluteLimitsTests-419920122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2476d818-4b4f-4860-9d1b-6314b85f1fa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:28:06 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-1d1a94fb-c903-47e6-bbff-9fdee3afbda2 tempest-AbsoluteLimitsTests-419920122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50afaa48-0d39-48ba-a6e9-e53a134c4531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:28:06 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-1d1a94fb-c903-47e6-bbff-9fdee3afbda2 tempest-AbsoluteLimitsTests-419920122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50afaa48-0d39-48ba-a6e9-e53a134c4531) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed4e9167-efbc-49a6-9de0-c768b9761f46', 'volume_name': 'volume-ed4e9167-efbc-49a6-9de0-c768b9761f46', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:28:06 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-1d1a94fb-c903-47e6-bbff-9fdee3afbda2 tempest-AbsoluteLimitsTests-419920122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40c8899a-33e0-48a3-af93-3152ecd2cade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:28:06 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-1d1a94fb-c903-47e6-bbff-9fdee3afbda2 tempest-AbsoluteLimitsTests-419920122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40c8899a-33e0-48a3-af93-3152ecd2cade) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:28:06 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-1d1a94fb-c903-47e6-bbff-9fdee3afbda2 tempest-AbsoluteLimitsTests-419920122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (801662c2-5629-4a2b-9dda-5e6554439b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:28:06 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-1d1a94fb-c903-47e6-bbff-9fdee3afbda2 tempest-AbsoluteLimitsTests-419920122 None] Volume ed4e9167-efbc-49a6-9de0-c768b9761f46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed4e9167-efbc-49a6-9de0-c768b9761f46', 'volume_size': 1} Sep 16 20:28:06 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-1d1a94fb-c903-47e6-bbff-9fdee3afbda2 tempest-AbsoluteLimitsTests-419920122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:28:06 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-1d1a94fb-c903-47e6-bbff-9fdee3afbda2 tempest-AbsoluteLimitsTests-419920122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:28:06 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-1d1a94fb-c903-47e6-bbff-9fdee3afbda2 tempest-AbsoluteLimitsTests-419920122 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:28:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-428552012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed4e9167-efbc-49a6-9de0-c768b9761f46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b75c2280a82141e2ab0fab6ec22ee5c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:28:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:28:06Z,use_quota=True,user_id='48dfaa06159f403ab3802bed172cb942',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:28:06 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-1d1a94fb-c903-47e6-bbff-9fdee3afbda2 tempest-AbsoluteLimitsTests-419920122 None] Creating volume ed4e9167-efbc-49a6-9de0-c768b9761f46 {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:28:06 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-1d1a94fb-c903-47e6-bbff-9fdee3afbda2 tempest-AbsoluteLimitsTests-419920122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:28:06 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-1d1a94fb-c903-47e6-bbff-9fdee3afbda2 tempest-AbsoluteLimitsTests-419920122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:28:06 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-1d1a94fb-c903-47e6-bbff-9fdee3afbda2 tempest-AbsoluteLimitsTests-419920122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:28:06 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-1d1a94fb-c903-47e6-bbff-9fdee3afbda2 tempest-AbsoluteLimitsTests-419920122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:28:06 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-1d1a94fb-c903-47e6-bbff-9fdee3afbda2 tempest-AbsoluteLimitsTests-419920122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:28:06 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-1d1a94fb-c903-47e6-bbff-9fdee3afbda2 tempest-AbsoluteLimitsTests-419920122 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:28:06 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-1d1a94fb-c903-47e6-bbff-9fdee3afbda2 tempest-AbsoluteLimitsTests-419920122 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:28:06 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-1d1a94fb-c903-47e6-bbff-9fdee3afbda2 tempest-AbsoluteLimitsTests-419920122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ed4e9167-efbc-49a6-9de0-c768b9761f46 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:28:06 devstack sudo[98460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ed4e9167-efbc-49a6-9de0-c768b9761f46 1073741824 Sep 16 20:28:06 devstack sudo[98460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:28:06 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-11963290-87a4-40fb-bb4d-a0daef610235 tempest-VolumesSnapshotNegativeTestJSON-1050560072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:28:06 devstack sudo[98460]: pam_unix(sudo:session): session closed for user root Sep 16 20:28:06 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-1d1a94fb-c903-47e6-bbff-9fdee3afbda2 tempest-AbsoluteLimitsTests-419920122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ed4e9167-efbc-49a6-9de0-c768b9761f46 1073741824" returned: 0 in 0.485s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:28:06 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-1d1a94fb-c903-47e6-bbff-9fdee3afbda2 tempest-AbsoluteLimitsTests-419920122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ed4e9167-efbc-49a6-9de0-c768b9761f46 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:28:06 devstack sudo[98466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ed4e9167-efbc-49a6-9de0-c768b9761f46 Sep 16 20:28:06 devstack sudo[98466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:28:07 devstack sudo[98466]: pam_unix(sudo:session): session closed for user root Sep 16 20:28:07 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-1d1a94fb-c903-47e6-bbff-9fdee3afbda2 tempest-AbsoluteLimitsTests-419920122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ed4e9167-efbc-49a6-9de0-c768b9761f46" returned: 0 in 0.250s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:28:07 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-1d1a94fb-c903-47e6-bbff-9fdee3afbda2 tempest-AbsoluteLimitsTests-419920122 None] <== create_volume: return (773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:28:07 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-1d1a94fb-c903-47e6-bbff-9fdee3afbda2 tempest-AbsoluteLimitsTests-419920122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.776s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:28:07 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-11963290-87a4-40fb-bb4d-a0daef610235 tempest-VolumesSnapshotNegativeTestJSON-1050560072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.626s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:28:07 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-1d1a94fb-c903-47e6-bbff-9fdee3afbda2 tempest-AbsoluteLimitsTests-419920122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (801662c2-5629-4a2b-9dda-5e6554439b07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed4e9167-efbc-49a6-9de0-c768b9761f46', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:28:07 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-1d1a94fb-c903-47e6-bbff-9fdee3afbda2 tempest-AbsoluteLimitsTests-419920122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ef935bf-4026-4901-934e-bcfe51b5fe30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:28:07 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-11963290-87a4-40fb-bb4d-a0daef610235 tempest-VolumesSnapshotNegativeTestJSON-1050560072 None] Creating offline snapshot 2a746fc4-c23f-4fa1-b244-27fb4cfb04a1 of volume 7e1a2a70-a9ea-496b-9f49-c96231ce82f1 {{(pid=86188) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 20:28:07 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-1d1a94fb-c903-47e6-bbff-9fdee3afbda2 tempest-AbsoluteLimitsTests-419920122 None] Volume volume-ed4e9167-efbc-49a6-9de0-c768b9761f46 (ed4e9167-efbc-49a6-9de0-c768b9761f46): created successfully Sep 16 20:28:07 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-1d1a94fb-c903-47e6-bbff-9fdee3afbda2 tempest-AbsoluteLimitsTests-419920122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ef935bf-4026-4901-934e-bcfe51b5fe30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:28:07 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-1d1a94fb-c903-47e6-bbff-9fdee3afbda2 tempest-AbsoluteLimitsTests-419920122 None] Flow 'volume_create_manager' (d2c43baa-88be-40c2-8928-4f725d6be515) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:28:07 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[89e896f1-f76d-43ae-bd2d-d9fb00675fa2]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:28:07 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-11963290-87a4-40fb-bb4d-a0daef610235 tempest-VolumesSnapshotNegativeTestJSON-1050560072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-7e1a2a70-a9ea-496b-9f49-c96231ce82f1 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:28:07 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-1d1a94fb-c903-47e6-bbff-9fdee3afbda2 tempest-AbsoluteLimitsTests-419920122 None] Created volume successfully. Sep 16 20:28:07 devstack sudo[98471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-7e1a2a70-a9ea-496b-9f49-c96231ce82f1 Sep 16 20:28:07 devstack sudo[98471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:28:07 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f4b509b-7328-42fd-9766-5deb0b2c82bf tempest-VolumesActionsTest-1215772093 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:28:07 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-1f4b509b-7328-42fd-9766-5deb0b2c82bf tempest-VolumesActionsTest-1215772093 None] Flow 'volume_create_manager' (2ae69f9e-d79e-4f71-a6ce-afacd3b182f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:28:07 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-1f4b509b-7328-42fd-9766-5deb0b2c82bf tempest-VolumesActionsTest-1215772093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fd9b37a-eb3b-4703-a965-e3e73a71f89b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:28:07 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-1f4b509b-7328-42fd-9766-5deb0b2c82bf tempest-VolumesActionsTest-1215772093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fd9b37a-eb3b-4703-a965-e3e73a71f89b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:28:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-567944817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14e4b8a9-9dca-4bf6-a883-7eec30b66d00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d22cac5f83a54eb3b75a37ea77a0a608',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:28:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:28:07Z,use_quota=True,user_id='551bc4c87d2e4db4856f5fef139fe6d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:28:07 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-1f4b509b-7328-42fd-9766-5deb0b2c82bf tempest-VolumesActionsTest-1215772093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9817cf9-6e37-4ff0-9cdf-ce319593e376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:28:07 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-1f4b509b-7328-42fd-9766-5deb0b2c82bf tempest-VolumesActionsTest-1215772093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9817cf9-6e37-4ff0-9cdf-ce319593e376) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:28:07 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-1f4b509b-7328-42fd-9766-5deb0b2c82bf tempest-VolumesActionsTest-1215772093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24b74fd7-7f6f-415a-9153-a0f056146edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:28:07 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-1f4b509b-7328-42fd-9766-5deb0b2c82bf tempest-VolumesActionsTest-1215772093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24b74fd7-7f6f-415a-9153-a0f056146edc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14e4b8a9-9dca-4bf6-a883-7eec30b66d00', 'volume_name': 'volume-14e4b8a9-9dca-4bf6-a883-7eec30b66d00', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:28:07 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-1f4b509b-7328-42fd-9766-5deb0b2c82bf tempest-VolumesActionsTest-1215772093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92cdacc5-a751-48bb-bcac-a9b2112edd0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:28:07 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-1f4b509b-7328-42fd-9766-5deb0b2c82bf tempest-VolumesActionsTest-1215772093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92cdacc5-a751-48bb-bcac-a9b2112edd0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:28:07 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-1f4b509b-7328-42fd-9766-5deb0b2c82bf tempest-VolumesActionsTest-1215772093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25810d28-ee5c-4854-950b-00ff79f87d0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:28:07 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-1f4b509b-7328-42fd-9766-5deb0b2c82bf tempest-VolumesActionsTest-1215772093 None] Volume 14e4b8a9-9dca-4bf6-a883-7eec30b66d00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14e4b8a9-9dca-4bf6-a883-7eec30b66d00', 'volume_size': 1} Sep 16 20:28:07 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-1f4b509b-7328-42fd-9766-5deb0b2c82bf tempest-VolumesActionsTest-1215772093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:28:07 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-6c007195-a7e7-4984-91b6-709ec82bfee9 tempest-AbsoluteLimitsTests-419920122 None] Acquiring lock "cinder-ed4e9167-efbc-49a6-9de0-c768b9761f46-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:28:07 devstack sudo[98471]: pam_unix(sudo:session): session closed for user root Sep 16 20:28:07 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-11963290-87a4-40fb-bb4d-a0daef610235 tempest-VolumesSnapshotNegativeTestJSON-1050560072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-7e1a2a70-a9ea-496b-9f49-c96231ce82f1" returned: 0 in 0.419s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:28:07 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-11963290-87a4-40fb-bb4d-a0daef610235 tempest-VolumesSnapshotNegativeTestJSON-1050560072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-7e1a2a70-a9ea-496b-9f49-c96231ce82f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-7e1a2a70-a9ea-496b-9f49-c96231ce82f1.2a746fc4-c23f-4fa1-b244-27fb4cfb04a1 2G {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:28:07 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-6c007195-a7e7-4984-91b6-709ec82bfee9 tempest-AbsoluteLimitsTests-419920122 None] Lock "cinder-ed4e9167-efbc-49a6-9de0-c768b9761f46-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:28:07 devstack sudo[98476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-7e1a2a70-a9ea-496b-9f49-c96231ce82f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-7e1a2a70-a9ea-496b-9f49-c96231ce82f1.2a746fc4-c23f-4fa1-b244-27fb4cfb04a1 2G Sep 16 20:28:07 devstack sudo[98476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:28:07 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-6c007195-a7e7-4984-91b6-709ec82bfee9 tempest-AbsoluteLimitsTests-419920122 None] Acquiring lock "cinder-quobyte-ed4e9167-efbc-49a6-9de0-c768b9761f46" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:28:07 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-6c007195-a7e7-4984-91b6-709ec82bfee9 tempest-AbsoluteLimitsTests-419920122 None] Lock "cinder-quobyte-ed4e9167-efbc-49a6-9de0-c768b9761f46" acquired by "delete_volume" :: waited 0.015s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:28:07 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f5f30d7-73bf-451d-bb1a-d82eda98fc54]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:28:07 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-6c007195-a7e7-4984-91b6-709ec82bfee9 tempest-AbsoluteLimitsTests-419920122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ed4e9167-efbc-49a6-9de0-c768b9761f46 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:28:07 devstack sudo[98478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ed4e9167-efbc-49a6-9de0-c768b9761f46 Sep 16 20:28:07 devstack sudo[98478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:28:07 devstack sudo[98476]: pam_unix(sudo:session): session closed for user root Sep 16 20:28:07 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-11963290-87a4-40fb-bb4d-a0daef610235 tempest-VolumesSnapshotNegativeTestJSON-1050560072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-7e1a2a70-a9ea-496b-9f49-c96231ce82f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-7e1a2a70-a9ea-496b-9f49-c96231ce82f1.2a746fc4-c23f-4fa1-b244-27fb4cfb04a1 2G" returned: 0 in 0.395s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:28:07 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-11963290-87a4-40fb-bb4d-a0daef610235 tempest-VolumesSnapshotNegativeTestJSON-1050560072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e1a2a70-a9ea-496b-9f49-c96231ce82f1 -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-7e1a2a70-a9ea-496b-9f49-c96231ce82f1.2a746fc4-c23f-4fa1-b244-27fb4cfb04a1 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:28:07 devstack sudo[98485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e1a2a70-a9ea-496b-9f49-c96231ce82f1 -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-7e1a2a70-a9ea-496b-9f49-c96231ce82f1.2a746fc4-c23f-4fa1-b244-27fb4cfb04a1 Sep 16 20:28:07 devstack sudo[98485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:28:07 devstack sudo[98478]: pam_unix(sudo:session): session closed for user root Sep 16 20:28:07 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-6c007195-a7e7-4984-91b6-709ec82bfee9 tempest-AbsoluteLimitsTests-419920122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ed4e9167-efbc-49a6-9de0-c768b9761f46" returned: 0 in 0.377s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:28:07 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-6c007195-a7e7-4984-91b6-709ec82bfee9 tempest-AbsoluteLimitsTests-419920122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ed4e9167-efbc-49a6-9de0-c768b9761f46 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:28:08 devstack sudo[98488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ed4e9167-efbc-49a6-9de0-c768b9761f46 Sep 16 20:28:08 devstack sudo[98488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:28:08 devstack sudo[98485]: pam_unix(sudo:session): session closed for user root Sep 16 20:28:08 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-11963290-87a4-40fb-bb4d-a0daef610235 tempest-VolumesSnapshotNegativeTestJSON-1050560072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e1a2a70-a9ea-496b-9f49-c96231ce82f1 -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-7e1a2a70-a9ea-496b-9f49-c96231ce82f1.2a746fc4-c23f-4fa1-b244-27fb4cfb04a1" returned: 0 in 0.312s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:28:08 devstack cinder-volume[86188]: WARNING cinder.volume.drivers.remotefs [None req-11963290-87a4-40fb-bb4d-a0daef610235 tempest-VolumesSnapshotNegativeTestJSON-1050560072 None] /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-7e1a2a70-a9ea-496b-9f49-c96231ce82f1.2a746fc4-c23f-4fa1-b244-27fb4cfb04a1 is being set with open permissions: ugo+rw Sep 16 20:28:08 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-11963290-87a4-40fb-bb4d-a0daef610235 tempest-VolumesSnapshotNegativeTestJSON-1050560072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-7e1a2a70-a9ea-496b-9f49-c96231ce82f1.2a746fc4-c23f-4fa1-b244-27fb4cfb04a1 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:28:08 devstack sudo[98494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-7e1a2a70-a9ea-496b-9f49-c96231ce82f1.2a746fc4-c23f-4fa1-b244-27fb4cfb04a1 Sep 16 20:28:08 devstack sudo[98488]: pam_unix(sudo:session): session closed for user root Sep 16 20:28:08 devstack sudo[98494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:28:08 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-6c007195-a7e7-4984-91b6-709ec82bfee9 tempest-AbsoluteLimitsTests-419920122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ed4e9167-efbc-49a6-9de0-c768b9761f46" returned: 0 in 0.274s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:28:08 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-6c007195-a7e7-4984-91b6-709ec82bfee9 tempest-AbsoluteLimitsTests-419920122 None] Lock "cinder-quobyte-ed4e9167-efbc-49a6-9de0-c768b9761f46" released by "delete_volume" :: held 0.689s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:28:08 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-6c007195-a7e7-4984-91b6-709ec82bfee9 tempest-AbsoluteLimitsTests-419920122 None] Created reservations ['9eeac147-ee3f-43d4-b304-673a6286f88d', '57ac45f4-d4a7-4ae7-a9c9-d9dad87335a2', '9a63ab4a-b22a-42a9-8108-b55826680e6b', '12096e5e-eda0-406d-80de-3d40a0175460'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:28:08 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-6c007195-a7e7-4984-91b6-709ec82bfee9 tempest-AbsoluteLimitsTests-419920122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:28:08 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-6c007195-a7e7-4984-91b6-709ec82bfee9 tempest-AbsoluteLimitsTests-419920122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:28:08 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-6c007195-a7e7-4984-91b6-709ec82bfee9 tempest-AbsoluteLimitsTests-419920122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:28:08 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-6c007195-a7e7-4984-91b6-709ec82bfee9 tempest-AbsoluteLimitsTests-419920122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:28:08 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-6c007195-a7e7-4984-91b6-709ec82bfee9 tempest-AbsoluteLimitsTests-419920122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:28:08 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-6c007195-a7e7-4984-91b6-709ec82bfee9 tempest-AbsoluteLimitsTests-419920122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:28:08 devstack sudo[98496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:28:08 devstack sudo[98496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:28:08 devstack sudo[98494]: pam_unix(sudo:session): session closed for user root Sep 16 20:28:08 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-11963290-87a4-40fb-bb4d-a0daef610235 tempest-VolumesSnapshotNegativeTestJSON-1050560072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-7e1a2a70-a9ea-496b-9f49-c96231ce82f1.2a746fc4-c23f-4fa1-b244-27fb4cfb04a1" returned: 0 in 0.255s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:28:08 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-11963290-87a4-40fb-bb4d-a0daef610235 tempest-VolumesSnapshotNegativeTestJSON-1050560072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-7e1a2a70-a9ea-496b-9f49-c96231ce82f1.info {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:28:08 devstack sudo[98499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-7e1a2a70-a9ea-496b-9f49-c96231ce82f1.info Sep 16 20:28:08 devstack sudo[98499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:28:08 devstack sudo[98496]: pam_unix(sudo:session): session closed for user root Sep 16 20:28:08 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-6c007195-a7e7-4984-91b6-709ec82bfee9 tempest-AbsoluteLimitsTests-419920122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.260s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:28:08 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-6c007195-a7e7-4984-91b6-709ec82bfee9 tempest-AbsoluteLimitsTests-419920122 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:28:08 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-6c007195-a7e7-4984-91b6-709ec82bfee9 tempest-AbsoluteLimitsTests-419920122 None] Deleted volume successfully. Sep 16 20:28:08 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-6c007195-a7e7-4984-91b6-709ec82bfee9 tempest-AbsoluteLimitsTests-419920122 None] Lock "cinder-ed4e9167-efbc-49a6-9de0-c768b9761f46-delete_volume" released by "delete_volume" :: held 1.149s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:28:08 devstack sudo[98499]: pam_unix(sudo:session): session closed for user root Sep 16 20:28:08 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-11963290-87a4-40fb-bb4d-a0daef610235 tempest-VolumesSnapshotNegativeTestJSON-1050560072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-7e1a2a70-a9ea-496b-9f49-c96231ce82f1.info" returned: 0 in 0.271s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:28:08 devstack cinder-volume[86188]: WARNING cinder.volume.drivers.remotefs [None req-11963290-87a4-40fb-bb4d-a0daef610235 tempest-VolumesSnapshotNegativeTestJSON-1050560072 None] /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-7e1a2a70-a9ea-496b-9f49-c96231ce82f1.info is being set with open permissions: ugo+rw Sep 16 20:28:08 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-11963290-87a4-40fb-bb4d-a0daef610235 tempest-VolumesSnapshotNegativeTestJSON-1050560072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-7e1a2a70-a9ea-496b-9f49-c96231ce82f1.info {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:28:08 devstack sudo[98503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-7e1a2a70-a9ea-496b-9f49-c96231ce82f1.info Sep 16 20:28:08 devstack sudo[98503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:28:09 devstack sudo[98503]: pam_unix(sudo:session): session closed for user root Sep 16 20:28:09 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-11963290-87a4-40fb-bb4d-a0daef610235 tempest-VolumesSnapshotNegativeTestJSON-1050560072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-7e1a2a70-a9ea-496b-9f49-c96231ce82f1.info" returned: 0 in 0.264s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:28:09 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-11963290-87a4-40fb-bb4d-a0daef610235 tempest-VolumesSnapshotNegativeTestJSON-1050560072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.044s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:28:09 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-1f4b509b-7328-42fd-9766-5deb0b2c82bf tempest-VolumesActionsTest-1215772093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.691s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:28:09 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-1f4b509b-7328-42fd-9766-5deb0b2c82bf tempest-VolumesActionsTest-1215772093 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:28:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-567944817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14e4b8a9-9dca-4bf6-a883-7eec30b66d00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d22cac5f83a54eb3b75a37ea77a0a608',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:28:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:28:07Z,use_quota=True,user_id='551bc4c87d2e4db4856f5fef139fe6d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:28:09 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-1f4b509b-7328-42fd-9766-5deb0b2c82bf tempest-VolumesActionsTest-1215772093 None] Creating volume 14e4b8a9-9dca-4bf6-a883-7eec30b66d00 {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:28:09 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-1f4b509b-7328-42fd-9766-5deb0b2c82bf tempest-VolumesActionsTest-1215772093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:28:09 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-1f4b509b-7328-42fd-9766-5deb0b2c82bf tempest-VolumesActionsTest-1215772093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:28:09 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-1f4b509b-7328-42fd-9766-5deb0b2c82bf tempest-VolumesActionsTest-1215772093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:28:09 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-1f4b509b-7328-42fd-9766-5deb0b2c82bf tempest-VolumesActionsTest-1215772093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:28:09 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-1f4b509b-7328-42fd-9766-5deb0b2c82bf tempest-VolumesActionsTest-1215772093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:28:09 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-1f4b509b-7328-42fd-9766-5deb0b2c82bf tempest-VolumesActionsTest-1215772093 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:28:09 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-1f4b509b-7328-42fd-9766-5deb0b2c82bf tempest-VolumesActionsTest-1215772093 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:28:09 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-1f4b509b-7328-42fd-9766-5deb0b2c82bf tempest-VolumesActionsTest-1215772093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-14e4b8a9-9dca-4bf6-a883-7eec30b66d00 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:28:09 devstack sudo[98508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-14e4b8a9-9dca-4bf6-a883-7eec30b66d00 1073741824 Sep 16 20:28:09 devstack sudo[98508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:28:09 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-11963290-87a4-40fb-bb4d-a0daef610235 tempest-VolumesSnapshotNegativeTestJSON-1050560072 None] Create snapshot completed successfully Sep 16 20:28:09 devstack sudo[98508]: pam_unix(sudo:session): session closed for user root Sep 16 20:28:09 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-1f4b509b-7328-42fd-9766-5deb0b2c82bf tempest-VolumesActionsTest-1215772093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-14e4b8a9-9dca-4bf6-a883-7eec30b66d00 1073741824" returned: 0 in 0.492s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:28:09 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-1f4b509b-7328-42fd-9766-5deb0b2c82bf tempest-VolumesActionsTest-1215772093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-14e4b8a9-9dca-4bf6-a883-7eec30b66d00 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:28:09 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-f3b852da-c12e-4601-b851-67a366060775 tempest-VolumesSnapshotNegativeTestJSON-1050560072 None] Acquiring lock "cinder-2a746fc4-c23f-4fa1-b244-27fb4cfb04a1-delete_snapshot" by "delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:28:09 devstack sudo[98514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-14e4b8a9-9dca-4bf6-a883-7eec30b66d00 Sep 16 20:28:09 devstack sudo[98514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:28:09 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-f3b852da-c12e-4601-b851-67a366060775 tempest-VolumesSnapshotNegativeTestJSON-1050560072 None] Lock "cinder-2a746fc4-c23f-4fa1-b244-27fb4cfb04a1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:28:09 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-f3b852da-c12e-4601-b851-67a366060775 tempest-VolumesSnapshotNegativeTestJSON-1050560072 None] Acquiring lock "cinder-quobyte-7e1a2a70-a9ea-496b-9f49-c96231ce82f1" by "delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:28:09 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-f3b852da-c12e-4601-b851-67a366060775 tempest-VolumesSnapshotNegativeTestJSON-1050560072 None] Lock "cinder-quobyte-7e1a2a70-a9ea-496b-9f49-c96231ce82f1" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:28:09 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-f3b852da-c12e-4601-b851-67a366060775 tempest-VolumesSnapshotNegativeTestJSON-1050560072 None] Acquiring lock "cinder-quobyte-2a746fc4-c23f-4fa1-b244-27fb4cfb04a1" by "_delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:28:09 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-f3b852da-c12e-4601-b851-67a366060775 tempest-VolumesSnapshotNegativeTestJSON-1050560072 None] Lock "cinder-quobyte-2a746fc4-c23f-4fa1-b244-27fb4cfb04a1" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:28:09 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-f3b852da-c12e-4601-b851-67a366060775 tempest-VolumesSnapshotNegativeTestJSON-1050560072 None] Deleting offline snapshot 2a746fc4-c23f-4fa1-b244-27fb4cfb04a1 of volume 7e1a2a70-a9ea-496b-9f49-c96231ce82f1 {{(pid=86188) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 20:28:09 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-f3b852da-c12e-4601-b851-67a366060775 tempest-VolumesSnapshotNegativeTestJSON-1050560072 None] snapshot_file for this snap is: volume-7e1a2a70-a9ea-496b-9f49-c96231ce82f1.2a746fc4-c23f-4fa1-b244-27fb4cfb04a1 {{(pid=86188) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 20:28:09 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc4c6759-5997-41f2-a16b-281c9aeb4541]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:28:09 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f3b852da-c12e-4601-b851-67a366060775 tempest-VolumesSnapshotNegativeTestJSON-1050560072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-7e1a2a70-a9ea-496b-9f49-c96231ce82f1.2a746fc4-c23f-4fa1-b244-27fb4cfb04a1 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:28:09 devstack sudo[98516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-7e1a2a70-a9ea-496b-9f49-c96231ce82f1.2a746fc4-c23f-4fa1-b244-27fb4cfb04a1 Sep 16 20:28:09 devstack sudo[98516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:28:09 devstack sudo[98514]: pam_unix(sudo:session): session closed for user root Sep 16 20:28:09 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-1f4b509b-7328-42fd-9766-5deb0b2c82bf tempest-VolumesActionsTest-1215772093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-14e4b8a9-9dca-4bf6-a883-7eec30b66d00" returned: 0 in 0.290s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:28:09 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-1f4b509b-7328-42fd-9766-5deb0b2c82bf tempest-VolumesActionsTest-1215772093 None] <== create_volume: return (831ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:28:09 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-1f4b509b-7328-42fd-9766-5deb0b2c82bf tempest-VolumesActionsTest-1215772093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.834s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:28:09 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-1f4b509b-7328-42fd-9766-5deb0b2c82bf tempest-VolumesActionsTest-1215772093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25810d28-ee5c-4854-950b-00ff79f87d0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14e4b8a9-9dca-4bf6-a883-7eec30b66d00', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:28:09 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-1f4b509b-7328-42fd-9766-5deb0b2c82bf tempest-VolumesActionsTest-1215772093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (083c5b89-30ac-4623-9b8a-cce568234fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:28:09 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-1f4b509b-7328-42fd-9766-5deb0b2c82bf tempest-VolumesActionsTest-1215772093 None] Volume volume-14e4b8a9-9dca-4bf6-a883-7eec30b66d00 (14e4b8a9-9dca-4bf6-a883-7eec30b66d00): created successfully Sep 16 20:28:09 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-1f4b509b-7328-42fd-9766-5deb0b2c82bf tempest-VolumesActionsTest-1215772093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (083c5b89-30ac-4623-9b8a-cce568234fd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:28:09 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-1f4b509b-7328-42fd-9766-5deb0b2c82bf tempest-VolumesActionsTest-1215772093 None] Flow 'volume_create_manager' (2ae69f9e-d79e-4f71-a6ce-afacd3b182f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:28:09 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-1f4b509b-7328-42fd-9766-5deb0b2c82bf tempest-VolumesActionsTest-1215772093 None] Created volume successfully. Sep 16 20:28:10 devstack sudo[98516]: pam_unix(sudo:session): session closed for user root Sep 16 20:28:10 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f3b852da-c12e-4601-b851-67a366060775 tempest-VolumesSnapshotNegativeTestJSON-1050560072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-7e1a2a70-a9ea-496b-9f49-c96231ce82f1.2a746fc4-c23f-4fa1-b244-27fb4cfb04a1" returned: 0 in 0.413s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:28:10 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-f3b852da-c12e-4601-b851-67a366060775 tempest-VolumesSnapshotNegativeTestJSON-1050560072 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7e1a2a70-a9ea-496b-9f49-c96231ce82f1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86188) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 20:28:10 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[044bb7d5-c0ff-476c-8bdb-7fcad54540f4]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:28:10 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f3b852da-c12e-4601-b851-67a366060775 tempest-VolumesSnapshotNegativeTestJSON-1050560072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-7e1a2a70-a9ea-496b-9f49-c96231ce82f1 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:28:10 devstack sudo[98522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-7e1a2a70-a9ea-496b-9f49-c96231ce82f1 Sep 16 20:28:10 devstack sudo[98522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:28:10 devstack sudo[98522]: pam_unix(sudo:session): session closed for user root Sep 16 20:28:10 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f3b852da-c12e-4601-b851-67a366060775 tempest-VolumesSnapshotNegativeTestJSON-1050560072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-7e1a2a70-a9ea-496b-9f49-c96231ce82f1" returned: 0 in 0.405s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:28:10 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f3b852da-c12e-4601-b851-67a366060775 tempest-VolumesSnapshotNegativeTestJSON-1050560072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-7e1a2a70-a9ea-496b-9f49-c96231ce82f1.2a746fc4-c23f-4fa1-b244-27fb4cfb04a1 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:28:10 devstack sudo[98527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-7e1a2a70-a9ea-496b-9f49-c96231ce82f1.2a746fc4-c23f-4fa1-b244-27fb4cfb04a1 Sep 16 20:28:10 devstack sudo[98527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:28:10 devstack sudo[98527]: pam_unix(sudo:session): session closed for user root Sep 16 20:28:10 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f3b852da-c12e-4601-b851-67a366060775 tempest-VolumesSnapshotNegativeTestJSON-1050560072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-7e1a2a70-a9ea-496b-9f49-c96231ce82f1.2a746fc4-c23f-4fa1-b244-27fb4cfb04a1" returned: 0 in 0.376s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:28:10 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f3b852da-c12e-4601-b851-67a366060775 tempest-VolumesSnapshotNegativeTestJSON-1050560072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-7e1a2a70-a9ea-496b-9f49-c96231ce82f1.2a746fc4-c23f-4fa1-b244-27fb4cfb04a1 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:28:11 devstack sudo[98534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-7e1a2a70-a9ea-496b-9f49-c96231ce82f1.2a746fc4-c23f-4fa1-b244-27fb4cfb04a1 Sep 16 20:28:11 devstack sudo[98534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:28:11 devstack sudo[98534]: pam_unix(sudo:session): session closed for user root Sep 16 20:28:11 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f3b852da-c12e-4601-b851-67a366060775 tempest-VolumesSnapshotNegativeTestJSON-1050560072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-7e1a2a70-a9ea-496b-9f49-c96231ce82f1.2a746fc4-c23f-4fa1-b244-27fb4cfb04a1" returned: 0 in 0.270s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:28:11 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-f3b852da-c12e-4601-b851-67a366060775 tempest-VolumesSnapshotNegativeTestJSON-1050560072 None] Lock "cinder-quobyte-2a746fc4-c23f-4fa1-b244-27fb4cfb04a1" released by "_delete_snapshot" :: held 1.592s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:28:11 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-f3b852da-c12e-4601-b851-67a366060775 tempest-VolumesSnapshotNegativeTestJSON-1050560072 None] Lock "cinder-quobyte-7e1a2a70-a9ea-496b-9f49-c96231ce82f1" released by "delete_snapshot" :: held 1.618s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:28:11 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-f3b852da-c12e-4601-b851-67a366060775 tempest-VolumesSnapshotNegativeTestJSON-1050560072 None] Created reservations ['f9252c08-845a-4e62-ade8-ee96c230f5cd', '0632d011-2f4d-48c0-a592-2527b02d8ba6', 'bbb18d63-d78b-4b87-8ef1-f255eac491ad', 'ce4c1092-780a-4ebb-ac16-467b1214be41'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:28:11 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-f3b852da-c12e-4601-b851-67a366060775 tempest-VolumesSnapshotNegativeTestJSON-1050560072 None] Delete snapshot completed successfully. Sep 16 20:28:11 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-f3b852da-c12e-4601-b851-67a366060775 tempest-VolumesSnapshotNegativeTestJSON-1050560072 None] Lock "cinder-2a746fc4-c23f-4fa1-b244-27fb4cfb04a1-delete_snapshot" released by "delete_snapshot" :: held 1.809s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:28:11 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-201199c3-2187-48b4-83a1-1d23bf9e3761 tempest-VolumesSnapshotNegativeTestJSON-1050560072 None] Acquiring lock "cinder-7e1a2a70-a9ea-496b-9f49-c96231ce82f1-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:28:11 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-201199c3-2187-48b4-83a1-1d23bf9e3761 tempest-VolumesSnapshotNegativeTestJSON-1050560072 None] Lock "cinder-7e1a2a70-a9ea-496b-9f49-c96231ce82f1-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:28:11 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-201199c3-2187-48b4-83a1-1d23bf9e3761 tempest-VolumesSnapshotNegativeTestJSON-1050560072 None] Acquiring lock "cinder-quobyte-7e1a2a70-a9ea-496b-9f49-c96231ce82f1" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:28:11 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-201199c3-2187-48b4-83a1-1d23bf9e3761 tempest-VolumesSnapshotNegativeTestJSON-1050560072 None] Lock "cinder-quobyte-7e1a2a70-a9ea-496b-9f49-c96231ce82f1" acquired by "delete_volume" :: waited 0.022s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:28:12 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[31bdce94-99fd-4b58-b988-34d21c9b7383]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:28:12 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-201199c3-2187-48b4-83a1-1d23bf9e3761 tempest-VolumesSnapshotNegativeTestJSON-1050560072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-7e1a2a70-a9ea-496b-9f49-c96231ce82f1 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:28:12 devstack sudo[98540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-7e1a2a70-a9ea-496b-9f49-c96231ce82f1 Sep 16 20:28:12 devstack sudo[98540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:28:12 devstack sudo[98540]: pam_unix(sudo:session): session closed for user root Sep 16 20:28:12 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-201199c3-2187-48b4-83a1-1d23bf9e3761 tempest-VolumesSnapshotNegativeTestJSON-1050560072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-7e1a2a70-a9ea-496b-9f49-c96231ce82f1" returned: 0 in 0.441s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:28:12 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-201199c3-2187-48b4-83a1-1d23bf9e3761 tempest-VolumesSnapshotNegativeTestJSON-1050560072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-7e1a2a70-a9ea-496b-9f49-c96231ce82f1 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:28:12 devstack sudo[98545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-7e1a2a70-a9ea-496b-9f49-c96231ce82f1 Sep 16 20:28:12 devstack sudo[98545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:28:12 devstack sudo[98545]: pam_unix(sudo:session): session closed for user root Sep 16 20:28:12 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-201199c3-2187-48b4-83a1-1d23bf9e3761 tempest-VolumesSnapshotNegativeTestJSON-1050560072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-7e1a2a70-a9ea-496b-9f49-c96231ce82f1" returned: 0 in 0.290s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:28:12 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-201199c3-2187-48b4-83a1-1d23bf9e3761 tempest-VolumesSnapshotNegativeTestJSON-1050560072 None] Lock "cinder-quobyte-7e1a2a70-a9ea-496b-9f49-c96231ce82f1" released by "delete_volume" :: held 0.808s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:28:12 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-201199c3-2187-48b4-83a1-1d23bf9e3761 tempest-VolumesSnapshotNegativeTestJSON-1050560072 None] Created reservations ['ed760c23-9f98-4048-854c-a5444a5a7de0', '04073b66-9001-4567-94a1-38de3f7da630', 'ffd76f9f-362f-4afa-ba7e-201c1e9093d6', '9613a0d9-d54b-4613-9b07-28a75d1e73c1'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:28:12 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-201199c3-2187-48b4-83a1-1d23bf9e3761 tempest-VolumesSnapshotNegativeTestJSON-1050560072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:28:12 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-201199c3-2187-48b4-83a1-1d23bf9e3761 tempest-VolumesSnapshotNegativeTestJSON-1050560072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:28:12 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-201199c3-2187-48b4-83a1-1d23bf9e3761 tempest-VolumesSnapshotNegativeTestJSON-1050560072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:28:12 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-201199c3-2187-48b4-83a1-1d23bf9e3761 tempest-VolumesSnapshotNegativeTestJSON-1050560072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:28:12 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-201199c3-2187-48b4-83a1-1d23bf9e3761 tempest-VolumesSnapshotNegativeTestJSON-1050560072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:28:12 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-201199c3-2187-48b4-83a1-1d23bf9e3761 tempest-VolumesSnapshotNegativeTestJSON-1050560072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:28:12 devstack sudo[98548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:28:12 devstack sudo[98548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:28:13 devstack sudo[98548]: pam_unix(sudo:session): session closed for user root Sep 16 20:28:13 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-201199c3-2187-48b4-83a1-1d23bf9e3761 tempest-VolumesSnapshotNegativeTestJSON-1050560072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.296s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:28:13 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-201199c3-2187-48b4-83a1-1d23bf9e3761 tempest-VolumesSnapshotNegativeTestJSON-1050560072 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:28:13 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-201199c3-2187-48b4-83a1-1d23bf9e3761 tempest-VolumesSnapshotNegativeTestJSON-1050560072 None] Deleted volume successfully. Sep 16 20:28:13 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-201199c3-2187-48b4-83a1-1d23bf9e3761 tempest-VolumesSnapshotNegativeTestJSON-1050560072 None] Lock "cinder-7e1a2a70-a9ea-496b-9f49-c96231ce82f1-delete_volume" released by "delete_volume" :: held 1.367s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:28:14 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba4359f4-58a1-4e63-b996-7f402cf04cba tempest-VolumesDeleteCascade-1991260277 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:28:14 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ba4359f4-58a1-4e63-b996-7f402cf04cba tempest-VolumesDeleteCascade-1991260277 None] Flow 'volume_create_manager' (217a24f6-c542-4770-93d8-fde96ada0837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:28:14 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ba4359f4-58a1-4e63-b996-7f402cf04cba tempest-VolumesDeleteCascade-1991260277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebdb1bd0-b2bf-4002-bce3-87cdb8fbb2f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:28:14 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ba4359f4-58a1-4e63-b996-7f402cf04cba tempest-VolumesDeleteCascade-1991260277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebdb1bd0-b2bf-4002-bce3-87cdb8fbb2f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:28:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-131056349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ad87c2a340d4c57abd678fe060add15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:28:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:28:15Z,use_quota=True,user_id='f51f8820f7264ba49dcb0ae8a1062475',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:28:14 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ba4359f4-58a1-4e63-b996-7f402cf04cba tempest-VolumesDeleteCascade-1991260277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d0311ac-13ff-485f-ba77-3d3dbf983df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:28:14 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ba4359f4-58a1-4e63-b996-7f402cf04cba tempest-VolumesDeleteCascade-1991260277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d0311ac-13ff-485f-ba77-3d3dbf983df7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:28:14 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ba4359f4-58a1-4e63-b996-7f402cf04cba tempest-VolumesDeleteCascade-1991260277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5717b67f-8cfe-41bf-be83-8b9596d5b03d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:28:14 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ba4359f4-58a1-4e63-b996-7f402cf04cba tempest-VolumesDeleteCascade-1991260277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5717b67f-8cfe-41bf-be83-8b9596d5b03d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202', 'volume_name': 'volume-ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:28:14 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ba4359f4-58a1-4e63-b996-7f402cf04cba tempest-VolumesDeleteCascade-1991260277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98644751-5983-44b9-8bcb-eac0a5cb21c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:28:14 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ba4359f4-58a1-4e63-b996-7f402cf04cba tempest-VolumesDeleteCascade-1991260277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98644751-5983-44b9-8bcb-eac0a5cb21c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:28:14 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ba4359f4-58a1-4e63-b996-7f402cf04cba tempest-VolumesDeleteCascade-1991260277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d02e6e8d-a26f-4dc9-81e5-e49935241361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:28:14 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-ba4359f4-58a1-4e63-b996-7f402cf04cba tempest-VolumesDeleteCascade-1991260277 None] Volume ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202', 'volume_size': 1} Sep 16 20:28:14 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-ba4359f4-58a1-4e63-b996-7f402cf04cba tempest-VolumesDeleteCascade-1991260277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:28:14 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-ba4359f4-58a1-4e63-b996-7f402cf04cba tempest-VolumesDeleteCascade-1991260277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:28:14 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-ba4359f4-58a1-4e63-b996-7f402cf04cba tempest-VolumesDeleteCascade-1991260277 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:28:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-131056349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ad87c2a340d4c57abd678fe060add15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:28:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:28:15Z,use_quota=True,user_id='f51f8820f7264ba49dcb0ae8a1062475',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:28:14 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-ba4359f4-58a1-4e63-b996-7f402cf04cba tempest-VolumesDeleteCascade-1991260277 None] Creating volume ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202 {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:28:14 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-ba4359f4-58a1-4e63-b996-7f402cf04cba tempest-VolumesDeleteCascade-1991260277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:28:14 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-ba4359f4-58a1-4e63-b996-7f402cf04cba tempest-VolumesDeleteCascade-1991260277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:28:14 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-ba4359f4-58a1-4e63-b996-7f402cf04cba tempest-VolumesDeleteCascade-1991260277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:28:14 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-ba4359f4-58a1-4e63-b996-7f402cf04cba tempest-VolumesDeleteCascade-1991260277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:28:14 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-ba4359f4-58a1-4e63-b996-7f402cf04cba tempest-VolumesDeleteCascade-1991260277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:28:14 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-ba4359f4-58a1-4e63-b996-7f402cf04cba tempest-VolumesDeleteCascade-1991260277 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:28:14 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-ba4359f4-58a1-4e63-b996-7f402cf04cba tempest-VolumesDeleteCascade-1991260277 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:28:14 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ba4359f4-58a1-4e63-b996-7f402cf04cba tempest-VolumesDeleteCascade-1991260277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:28:14 devstack sudo[98567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202 1073741824 Sep 16 20:28:14 devstack sudo[98567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:28:15 devstack sudo[98567]: pam_unix(sudo:session): session closed for user root Sep 16 20:28:15 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ba4359f4-58a1-4e63-b996-7f402cf04cba tempest-VolumesDeleteCascade-1991260277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202 1073741824" returned: 0 in 0.537s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:28:15 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ba4359f4-58a1-4e63-b996-7f402cf04cba tempest-VolumesDeleteCascade-1991260277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:28:15 devstack sudo[98573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202 Sep 16 20:28:15 devstack sudo[98573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:28:15 devstack sudo[98573]: pam_unix(sudo:session): session closed for user root Sep 16 20:28:15 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ba4359f4-58a1-4e63-b996-7f402cf04cba tempest-VolumesDeleteCascade-1991260277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202" returned: 0 in 0.269s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:28:15 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-ba4359f4-58a1-4e63-b996-7f402cf04cba tempest-VolumesDeleteCascade-1991260277 None] <== create_volume: return (856ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:28:15 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-ba4359f4-58a1-4e63-b996-7f402cf04cba tempest-VolumesDeleteCascade-1991260277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.859s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:28:15 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ba4359f4-58a1-4e63-b996-7f402cf04cba tempest-VolumesDeleteCascade-1991260277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d02e6e8d-a26f-4dc9-81e5-e49935241361) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:28:15 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ba4359f4-58a1-4e63-b996-7f402cf04cba tempest-VolumesDeleteCascade-1991260277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9207d10d-a510-4a46-b0a6-494d1f4c2825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:28:15 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-ba4359f4-58a1-4e63-b996-7f402cf04cba tempest-VolumesDeleteCascade-1991260277 None] Volume volume-ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202 (ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202): created successfully Sep 16 20:28:15 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ba4359f4-58a1-4e63-b996-7f402cf04cba tempest-VolumesDeleteCascade-1991260277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9207d10d-a510-4a46-b0a6-494d1f4c2825) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:28:15 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ba4359f4-58a1-4e63-b996-7f402cf04cba tempest-VolumesDeleteCascade-1991260277 None] Flow 'volume_create_manager' (217a24f6-c542-4770-93d8-fde96ada0837) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:28:15 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-ba4359f4-58a1-4e63-b996-7f402cf04cba tempest-VolumesDeleteCascade-1991260277 None] Created volume successfully. Sep 16 20:28:17 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-ae286052-7ab8-4282-aad3-7f03a636f1a1 tempest-VolumesDeleteCascade-1991260277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:28:17 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-ae286052-7ab8-4282-aad3-7f03a636f1a1 tempest-VolumesDeleteCascade-1991260277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:28:17 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-ae286052-7ab8-4282-aad3-7f03a636f1a1 tempest-VolumesDeleteCascade-1991260277 None] Creating offline snapshot 00b126a0-a48e-4c3b-8d93-fbafa590c5b1 of volume ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202 {{(pid=86188) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 20:28:17 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e64c395-d1bb-47af-8785-f04c4c13d1eb]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:28:17 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ae286052-7ab8-4282-aad3-7f03a636f1a1 tempest-VolumesDeleteCascade-1991260277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:28:17 devstack sudo[98632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202 Sep 16 20:28:17 devstack sudo[98632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:28:18 devstack sudo[98632]: pam_unix(sudo:session): session closed for user root Sep 16 20:28:18 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ae286052-7ab8-4282-aad3-7f03a636f1a1 tempest-VolumesDeleteCascade-1991260277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202" returned: 0 in 0.670s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:28:18 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ae286052-7ab8-4282-aad3-7f03a636f1a1 tempest-VolumesDeleteCascade-1991260277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202.00b126a0-a48e-4c3b-8d93-fbafa590c5b1 1G {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:28:18 devstack sudo[98648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202.00b126a0-a48e-4c3b-8d93-fbafa590c5b1 1G Sep 16 20:28:18 devstack sudo[98648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:28:19 devstack sudo[98648]: pam_unix(sudo:session): session closed for user root Sep 16 20:28:19 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ae286052-7ab8-4282-aad3-7f03a636f1a1 tempest-VolumesDeleteCascade-1991260277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202.00b126a0-a48e-4c3b-8d93-fbafa590c5b1 1G" returned: 0 in 0.746s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:28:19 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ae286052-7ab8-4282-aad3-7f03a636f1a1 tempest-VolumesDeleteCascade-1991260277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202 -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202.00b126a0-a48e-4c3b-8d93-fbafa590c5b1 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:28:19 devstack sudo[98658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202 -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202.00b126a0-a48e-4c3b-8d93-fbafa590c5b1 Sep 16 20:28:19 devstack sudo[98658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:28:19 devstack sudo[98658]: pam_unix(sudo:session): session closed for user root Sep 16 20:28:19 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ae286052-7ab8-4282-aad3-7f03a636f1a1 tempest-VolumesDeleteCascade-1991260277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202 -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202.00b126a0-a48e-4c3b-8d93-fbafa590c5b1" returned: 0 in 0.441s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:28:19 devstack cinder-volume[86188]: WARNING cinder.volume.drivers.remotefs [None req-ae286052-7ab8-4282-aad3-7f03a636f1a1 tempest-VolumesDeleteCascade-1991260277 None] /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202.00b126a0-a48e-4c3b-8d93-fbafa590c5b1 is being set with open permissions: ugo+rw Sep 16 20:28:19 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ae286052-7ab8-4282-aad3-7f03a636f1a1 tempest-VolumesDeleteCascade-1991260277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202.00b126a0-a48e-4c3b-8d93-fbafa590c5b1 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:28:19 devstack sudo[98663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202.00b126a0-a48e-4c3b-8d93-fbafa590c5b1 Sep 16 20:28:19 devstack sudo[98663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:28:19 devstack sudo[98663]: pam_unix(sudo:session): session closed for user root Sep 16 20:28:19 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ae286052-7ab8-4282-aad3-7f03a636f1a1 tempest-VolumesDeleteCascade-1991260277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202.00b126a0-a48e-4c3b-8d93-fbafa590c5b1" returned: 0 in 0.269s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:28:19 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ae286052-7ab8-4282-aad3-7f03a636f1a1 tempest-VolumesDeleteCascade-1991260277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202.info {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:28:19 devstack sudo[98666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202.info Sep 16 20:28:19 devstack sudo[98666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:28:20 devstack sudo[98666]: pam_unix(sudo:session): session closed for user root Sep 16 20:28:20 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ae286052-7ab8-4282-aad3-7f03a636f1a1 tempest-VolumesDeleteCascade-1991260277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202.info" returned: 0 in 0.306s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:28:20 devstack cinder-volume[86188]: WARNING cinder.volume.drivers.remotefs [None req-ae286052-7ab8-4282-aad3-7f03a636f1a1 tempest-VolumesDeleteCascade-1991260277 None] /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202.info is being set with open permissions: ugo+rw Sep 16 20:28:20 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ae286052-7ab8-4282-aad3-7f03a636f1a1 tempest-VolumesDeleteCascade-1991260277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202.info {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:28:20 devstack sudo[98669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202.info Sep 16 20:28:20 devstack sudo[98669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:28:20 devstack sudo[98669]: pam_unix(sudo:session): session closed for user root Sep 16 20:28:20 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ae286052-7ab8-4282-aad3-7f03a636f1a1 tempest-VolumesDeleteCascade-1991260277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202.info" returned: 0 in 0.351s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:28:20 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-ae286052-7ab8-4282-aad3-7f03a636f1a1 tempest-VolumesDeleteCascade-1991260277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.082s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:28:20 devstack cinder-volume[86188]: DEBUG dbcounter [-] [86188] Writing DB stats cinder:UPDATE=195,cinder:SELECT=138,cinder:DELETE=23,cinder:INSERT=55 {{(pid=86188) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 20:28:20 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-ae286052-7ab8-4282-aad3-7f03a636f1a1 tempest-VolumesDeleteCascade-1991260277 None] Create snapshot completed successfully Sep 16 20:28:20 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-2e1b07ba-0d89-4a65-ba42-bec1484c17a6 tempest-VolumesActionsTest-1215772093 None] Acquiring lock "cinder-14e4b8a9-9dca-4bf6-a883-7eec30b66d00" by "attach_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:28:20 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-2e1b07ba-0d89-4a65-ba42-bec1484c17a6 tempest-VolumesActionsTest-1215772093 None] Lock "cinder-14e4b8a9-9dca-4bf6-a883-7eec30b66d00" acquired by "attach_volume" :: waited 0.023s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:28:20 devstack cinder-volume[86188]: DEBUG dbcounter [-] [86188] Writing DB stats cinder:SELECT=148,cinder:INSERT=57,cinder:UPDATE=196,cinder:DELETE=11 {{(pid=86188) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 20:28:20 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-2e1b07ba-0d89-4a65-ba42-bec1484c17a6 tempest-VolumesActionsTest-1215772093 None] Attaching volume 14e4b8a9-9dca-4bf6-a883-7eec30b66d00 to instance e88a6c66-6cb4-464e-990b-227599b4c366 at mountpoint /dev/vdb on host None. Sep 16 20:28:20 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-2e1b07ba-0d89-4a65-ba42-bec1484c17a6 tempest-VolumesActionsTest-1215772093 None] Attach volume completed successfully. Sep 16 20:28:20 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-2e1b07ba-0d89-4a65-ba42-bec1484c17a6 tempest-VolumesActionsTest-1215772093 None] Lock "cinder-14e4b8a9-9dca-4bf6-a883-7eec30b66d00" released by "attach_volume" :: held 0.108s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:28:20 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-67b81a69-0b20-4828-aee0-9fb77d225d76 tempest-VolumesActionsTest-1215772093 None] Acquiring lock "cinder-14e4b8a9-9dca-4bf6-a883-7eec30b66d00-detach_volume" by "detach_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:28:20 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-67b81a69-0b20-4828-aee0-9fb77d225d76 tempest-VolumesActionsTest-1215772093 None] Lock "cinder-14e4b8a9-9dca-4bf6-a883-7eec30b66d00-detach_volume" acquired by "detach_volume" :: waited 0.016s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:28:20 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-67b81a69-0b20-4828-aee0-9fb77d225d76 tempest-VolumesActionsTest-1215772093 None] Detaching volume 14e4b8a9-9dca-4bf6-a883-7eec30b66d00 from instance e88a6c66-6cb4-464e-990b-227599b4c366. Sep 16 20:28:21 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-67b81a69-0b20-4828-aee0-9fb77d225d76 tempest-VolumesActionsTest-1215772093 None] Detach volume completed successfully. Sep 16 20:28:21 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-67b81a69-0b20-4828-aee0-9fb77d225d76 tempest-VolumesActionsTest-1215772093 None] Lock "cinder-14e4b8a9-9dca-4bf6-a883-7eec30b66d00-detach_volume" released by "detach_volume" :: held 0.083s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:28:21 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-12122923-48cd-49ca-89dd-64eeb9602ccb tempest-VolumesDeleteCascade-1991260277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:28:21 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-12122923-48cd-49ca-89dd-64eeb9602ccb tempest-VolumesDeleteCascade-1991260277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:28:22 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-12122923-48cd-49ca-89dd-64eeb9602ccb tempest-VolumesDeleteCascade-1991260277 None] Creating offline snapshot e72c5bea-1f4c-4dda-a099-cc6f5ff10959 of volume ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202 {{(pid=86188) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 20:28:22 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[5acc52f3-1ec3-426d-8535-01ac2b638d44]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:28:22 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-12122923-48cd-49ca-89dd-64eeb9602ccb tempest-VolumesDeleteCascade-1991260277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202.00b126a0-a48e-4c3b-8d93-fbafa590c5b1 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:28:22 devstack sudo[98693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202.00b126a0-a48e-4c3b-8d93-fbafa590c5b1 Sep 16 20:28:22 devstack sudo[98693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:28:22 devstack sudo[98693]: pam_unix(sudo:session): session closed for user root Sep 16 20:28:22 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-12122923-48cd-49ca-89dd-64eeb9602ccb tempest-VolumesDeleteCascade-1991260277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202.00b126a0-a48e-4c3b-8d93-fbafa590c5b1" returned: 0 in 0.519s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:28:22 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-12122923-48cd-49ca-89dd-64eeb9602ccb tempest-VolumesDeleteCascade-1991260277 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86188) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 20:28:22 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-12122923-48cd-49ca-89dd-64eeb9602ccb tempest-VolumesDeleteCascade-1991260277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202.00b126a0-a48e-4c3b-8d93-fbafa590c5b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202.e72c5bea-1f4c-4dda-a099-cc6f5ff10959 1G {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:28:22 devstack sudo[98700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202.00b126a0-a48e-4c3b-8d93-fbafa590c5b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202.e72c5bea-1f4c-4dda-a099-cc6f5ff10959 1G Sep 16 20:28:22 devstack sudo[98700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:28:23 devstack sudo[98700]: pam_unix(sudo:session): session closed for user root Sep 16 20:28:23 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-12122923-48cd-49ca-89dd-64eeb9602ccb tempest-VolumesDeleteCascade-1991260277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202.00b126a0-a48e-4c3b-8d93-fbafa590c5b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202.e72c5bea-1f4c-4dda-a099-cc6f5ff10959 1G" returned: 0 in 0.547s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:28:23 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-12122923-48cd-49ca-89dd-64eeb9602ccb tempest-VolumesDeleteCascade-1991260277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202.00b126a0-a48e-4c3b-8d93-fbafa590c5b1 -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202.e72c5bea-1f4c-4dda-a099-cc6f5ff10959 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:28:23 devstack sudo[98706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202.00b126a0-a48e-4c3b-8d93-fbafa590c5b1 -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202.e72c5bea-1f4c-4dda-a099-cc6f5ff10959 Sep 16 20:28:23 devstack sudo[98706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:28:23 devstack sudo[98706]: pam_unix(sudo:session): session closed for user root Sep 16 20:28:23 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-12122923-48cd-49ca-89dd-64eeb9602ccb tempest-VolumesDeleteCascade-1991260277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202.00b126a0-a48e-4c3b-8d93-fbafa590c5b1 -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202.e72c5bea-1f4c-4dda-a099-cc6f5ff10959" returned: 0 in 0.425s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:28:23 devstack cinder-volume[86188]: WARNING cinder.volume.drivers.remotefs [None req-12122923-48cd-49ca-89dd-64eeb9602ccb tempest-VolumesDeleteCascade-1991260277 None] /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202.e72c5bea-1f4c-4dda-a099-cc6f5ff10959 is being set with open permissions: ugo+rw Sep 16 20:28:23 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-12122923-48cd-49ca-89dd-64eeb9602ccb tempest-VolumesDeleteCascade-1991260277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202.e72c5bea-1f4c-4dda-a099-cc6f5ff10959 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:28:23 devstack sudo[98711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202.e72c5bea-1f4c-4dda-a099-cc6f5ff10959 Sep 16 20:28:23 devstack sudo[98711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:28:23 devstack sudo[98711]: pam_unix(sudo:session): session closed for user root Sep 16 20:28:23 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-12122923-48cd-49ca-89dd-64eeb9602ccb tempest-VolumesDeleteCascade-1991260277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202.e72c5bea-1f4c-4dda-a099-cc6f5ff10959" returned: 0 in 0.278s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:28:23 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-12122923-48cd-49ca-89dd-64eeb9602ccb tempest-VolumesDeleteCascade-1991260277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.913s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:28:23 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-12122923-48cd-49ca-89dd-64eeb9602ccb tempest-VolumesDeleteCascade-1991260277 None] Create snapshot completed successfully Sep 16 20:28:24 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-b35b235a-e8e0-495b-a83f-a8a898d52e6a tempest-VolumesDeleteCascade-1991260277 None] Acquiring lock "cinder-ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:28:24 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-b35b235a-e8e0-495b-a83f-a8a898d52e6a tempest-VolumesDeleteCascade-1991260277 None] Lock "cinder-ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:28:24 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-b35b235a-e8e0-495b-a83f-a8a898d52e6a tempest-VolumesDeleteCascade-1991260277 None] Performing cascade delete. {{(pid=86188) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 16 20:28:24 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-b35b235a-e8e0-495b-a83f-a8a898d52e6a tempest-VolumesDeleteCascade-1991260277 None] Acquiring lock "cinder-00b126a0-a48e-4c3b-8d93-fbafa590c5b1-delete_snapshot" by "delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:28:24 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-b35b235a-e8e0-495b-a83f-a8a898d52e6a tempest-VolumesDeleteCascade-1991260277 None] Lock "cinder-00b126a0-a48e-4c3b-8d93-fbafa590c5b1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:28:24 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-b35b235a-e8e0-495b-a83f-a8a898d52e6a tempest-VolumesDeleteCascade-1991260277 None] Acquiring lock "cinder-quobyte-ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202" by "delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:28:24 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-b35b235a-e8e0-495b-a83f-a8a898d52e6a tempest-VolumesDeleteCascade-1991260277 None] Lock "cinder-quobyte-ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:28:24 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-b35b235a-e8e0-495b-a83f-a8a898d52e6a tempest-VolumesDeleteCascade-1991260277 None] Acquiring lock "cinder-quobyte-00b126a0-a48e-4c3b-8d93-fbafa590c5b1" by "_delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:28:24 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-b35b235a-e8e0-495b-a83f-a8a898d52e6a tempest-VolumesDeleteCascade-1991260277 None] Lock "cinder-quobyte-00b126a0-a48e-4c3b-8d93-fbafa590c5b1" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:28:24 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-b35b235a-e8e0-495b-a83f-a8a898d52e6a tempest-VolumesDeleteCascade-1991260277 None] Deleting offline snapshot 00b126a0-a48e-4c3b-8d93-fbafa590c5b1 of volume ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202 {{(pid=86188) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 20:28:24 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-b35b235a-e8e0-495b-a83f-a8a898d52e6a tempest-VolumesDeleteCascade-1991260277 None] snapshot_file for this snap is: volume-ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202.00b126a0-a48e-4c3b-8d93-fbafa590c5b1 {{(pid=86188) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 20:28:24 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[7de3f6bd-e902-4d65-8f7f-5b9d3c01c77e]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:28:24 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b35b235a-e8e0-495b-a83f-a8a898d52e6a tempest-VolumesDeleteCascade-1991260277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202.00b126a0-a48e-4c3b-8d93-fbafa590c5b1 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:28:24 devstack sudo[98714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202.00b126a0-a48e-4c3b-8d93-fbafa590c5b1 Sep 16 20:28:24 devstack sudo[98714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:28:24 devstack sudo[98714]: pam_unix(sudo:session): session closed for user root Sep 16 20:28:24 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b35b235a-e8e0-495b-a83f-a8a898d52e6a tempest-VolumesDeleteCascade-1991260277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202.00b126a0-a48e-4c3b-8d93-fbafa590c5b1" returned: 0 in 0.467s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:28:24 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-b35b235a-e8e0-495b-a83f-a8a898d52e6a tempest-VolumesDeleteCascade-1991260277 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86188) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 20:28:24 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[d22645d8-0f99-4ef4-9f37-69e31b46dbee]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:28:24 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b35b235a-e8e0-495b-a83f-a8a898d52e6a tempest-VolumesDeleteCascade-1991260277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:28:25 devstack sudo[98722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202 Sep 16 20:28:25 devstack sudo[98722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:28:25 devstack sudo[98722]: pam_unix(sudo:session): session closed for user root Sep 16 20:28:25 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b35b235a-e8e0-495b-a83f-a8a898d52e6a tempest-VolumesDeleteCascade-1991260277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202" returned: 0 in 0.461s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:28:25 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[21e8f540-aea4-4241-ba23-5d4cb8602de5]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:28:25 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b35b235a-e8e0-495b-a83f-a8a898d52e6a tempest-VolumesDeleteCascade-1991260277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202.e72c5bea-1f4c-4dda-a099-cc6f5ff10959 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:28:25 devstack sudo[98727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202.e72c5bea-1f4c-4dda-a099-cc6f5ff10959 Sep 16 20:28:25 devstack sudo[98727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:28:25 devstack sudo[98727]: pam_unix(sudo:session): session closed for user root Sep 16 20:28:25 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b35b235a-e8e0-495b-a83f-a8a898d52e6a tempest-VolumesDeleteCascade-1991260277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202.e72c5bea-1f4c-4dda-a099-cc6f5ff10959" returned: 0 in 0.447s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:28:25 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-b35b235a-e8e0-495b-a83f-a8a898d52e6a tempest-VolumesDeleteCascade-1991260277 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86188) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 20:28:25 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[91eaabd4-ce16-4b02-bc0c-b3ede9c90f49]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:28:25 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b35b235a-e8e0-495b-a83f-a8a898d52e6a tempest-VolumesDeleteCascade-1991260277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202.00b126a0-a48e-4c3b-8d93-fbafa590c5b1 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:28:26 devstack sudo[98732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202.00b126a0-a48e-4c3b-8d93-fbafa590c5b1 Sep 16 20:28:26 devstack sudo[98732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:28:26 devstack sudo[98732]: pam_unix(sudo:session): session closed for user root Sep 16 20:28:26 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b35b235a-e8e0-495b-a83f-a8a898d52e6a tempest-VolumesDeleteCascade-1991260277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202.00b126a0-a48e-4c3b-8d93-fbafa590c5b1" returned: 0 in 0.565s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:28:26 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-b35b235a-e8e0-495b-a83f-a8a898d52e6a tempest-VolumesDeleteCascade-1991260277 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86188) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 20:28:26 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[51d5ed93-69a8-49b3-bc6a-37b43bb7294f]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:28:26 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b35b235a-e8e0-495b-a83f-a8a898d52e6a tempest-VolumesDeleteCascade-1991260277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:28:26 devstack sudo[98740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202 Sep 16 20:28:26 devstack sudo[98740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:28:26 devstack sudo[98740]: pam_unix(sudo:session): session closed for user root Sep 16 20:28:26 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b35b235a-e8e0-495b-a83f-a8a898d52e6a tempest-VolumesDeleteCascade-1991260277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202" returned: 0 in 0.446s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:28:26 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b35b235a-e8e0-495b-a83f-a8a898d52e6a tempest-VolumesDeleteCascade-1991260277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202.00b126a0-a48e-4c3b-8d93-fbafa590c5b1 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:28:27 devstack sudo[98757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202.00b126a0-a48e-4c3b-8d93-fbafa590c5b1 Sep 16 20:28:27 devstack sudo[98757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:28:27 devstack sudo[98757]: pam_unix(sudo:session): session closed for user root Sep 16 20:28:27 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b35b235a-e8e0-495b-a83f-a8a898d52e6a tempest-VolumesDeleteCascade-1991260277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202.00b126a0-a48e-4c3b-8d93-fbafa590c5b1" returned: 0 in 0.466s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:28:27 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b35b235a-e8e0-495b-a83f-a8a898d52e6a tempest-VolumesDeleteCascade-1991260277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202.00b126a0-a48e-4c3b-8d93-fbafa590c5b1 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:28:27 devstack sudo[98766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202.00b126a0-a48e-4c3b-8d93-fbafa590c5b1 Sep 16 20:28:27 devstack sudo[98766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:28:27 devstack sudo[98766]: pam_unix(sudo:session): session closed for user root Sep 16 20:28:27 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b35b235a-e8e0-495b-a83f-a8a898d52e6a tempest-VolumesDeleteCascade-1991260277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202.00b126a0-a48e-4c3b-8d93-fbafa590c5b1" returned: 0 in 0.333s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:28:27 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b35b235a-e8e0-495b-a83f-a8a898d52e6a tempest-VolumesDeleteCascade-1991260277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202.e72c5bea-1f4c-4dda-a099-cc6f5ff10959 -F qcow2 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:28:27 devstack sudo[98769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202.e72c5bea-1f4c-4dda-a099-cc6f5ff10959 -F qcow2 Sep 16 20:28:27 devstack sudo[98769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:28:28 devstack sudo[98769]: pam_unix(sudo:session): session closed for user root Sep 16 20:28:28 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b35b235a-e8e0-495b-a83f-a8a898d52e6a tempest-VolumesDeleteCascade-1991260277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202.e72c5bea-1f4c-4dda-a099-cc6f5ff10959 -F qcow2" returned: 0 in 0.319s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:28:28 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-b35b235a-e8e0-495b-a83f-a8a898d52e6a tempest-VolumesDeleteCascade-1991260277 None] Lock "cinder-quobyte-00b126a0-a48e-4c3b-8d93-fbafa590c5b1" released by "_delete_snapshot" :: held 3.770s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:28:28 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-b35b235a-e8e0-495b-a83f-a8a898d52e6a tempest-VolumesDeleteCascade-1991260277 None] Lock "cinder-quobyte-ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202" released by "delete_snapshot" :: held 3.801s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:28:28 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-b35b235a-e8e0-495b-a83f-a8a898d52e6a tempest-VolumesDeleteCascade-1991260277 None] Created reservations ['692dea77-1563-43bc-af01-6c528aad1a01', '9951f869-82b0-4f54-b28f-48b575bfe937', '732f71f0-a3e8-4e92-9ecc-3f28b0129712', 'c5c48cf6-a722-4542-a81f-fcf1c7f90f5e'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:28:28 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-b35b235a-e8e0-495b-a83f-a8a898d52e6a tempest-VolumesDeleteCascade-1991260277 None] Delete snapshot completed successfully. Sep 16 20:28:28 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-b35b235a-e8e0-495b-a83f-a8a898d52e6a tempest-VolumesDeleteCascade-1991260277 None] Lock "cinder-00b126a0-a48e-4c3b-8d93-fbafa590c5b1-delete_snapshot" released by "delete_snapshot" :: held 3.981s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:28:28 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-b35b235a-e8e0-495b-a83f-a8a898d52e6a tempest-VolumesDeleteCascade-1991260277 None] Acquiring lock "cinder-e72c5bea-1f4c-4dda-a099-cc6f5ff10959-delete_snapshot" by "delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:28:28 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-b35b235a-e8e0-495b-a83f-a8a898d52e6a tempest-VolumesDeleteCascade-1991260277 None] Lock "cinder-e72c5bea-1f4c-4dda-a099-cc6f5ff10959-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:28:28 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-b35b235a-e8e0-495b-a83f-a8a898d52e6a tempest-VolumesDeleteCascade-1991260277 None] Acquiring lock "cinder-quobyte-ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202" by "delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:28:28 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-b35b235a-e8e0-495b-a83f-a8a898d52e6a tempest-VolumesDeleteCascade-1991260277 None] Lock "cinder-quobyte-ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:28:28 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-b35b235a-e8e0-495b-a83f-a8a898d52e6a tempest-VolumesDeleteCascade-1991260277 None] Acquiring lock "cinder-quobyte-e72c5bea-1f4c-4dda-a099-cc6f5ff10959" by "_delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:28:28 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-b35b235a-e8e0-495b-a83f-a8a898d52e6a tempest-VolumesDeleteCascade-1991260277 None] Lock "cinder-quobyte-e72c5bea-1f4c-4dda-a099-cc6f5ff10959" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:28:28 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-b35b235a-e8e0-495b-a83f-a8a898d52e6a tempest-VolumesDeleteCascade-1991260277 None] Deleting offline snapshot e72c5bea-1f4c-4dda-a099-cc6f5ff10959 of volume ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202 {{(pid=86188) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 20:28:28 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-b35b235a-e8e0-495b-a83f-a8a898d52e6a tempest-VolumesDeleteCascade-1991260277 None] snapshot_file for this snap is: volume-ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202.e72c5bea-1f4c-4dda-a099-cc6f5ff10959 {{(pid=86188) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 20:28:28 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[a25ae70c-9307-4f73-afed-ffbc55843e21]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:28:28 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b35b235a-e8e0-495b-a83f-a8a898d52e6a tempest-VolumesDeleteCascade-1991260277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202.e72c5bea-1f4c-4dda-a099-cc6f5ff10959 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:28:28 devstack sudo[98774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202.e72c5bea-1f4c-4dda-a099-cc6f5ff10959 Sep 16 20:28:28 devstack sudo[98774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:28:28 devstack sudo[98774]: pam_unix(sudo:session): session closed for user root Sep 16 20:28:28 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b35b235a-e8e0-495b-a83f-a8a898d52e6a tempest-VolumesDeleteCascade-1991260277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202.e72c5bea-1f4c-4dda-a099-cc6f5ff10959" returned: 0 in 0.445s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:28:28 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-b35b235a-e8e0-495b-a83f-a8a898d52e6a tempest-VolumesDeleteCascade-1991260277 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86188) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 20:28:28 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[248de79f-114d-4425-b307-5fa2c04ef089]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:28:28 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b35b235a-e8e0-495b-a83f-a8a898d52e6a tempest-VolumesDeleteCascade-1991260277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:28:28 devstack sudo[98780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202 Sep 16 20:28:28 devstack sudo[98780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:28:29 devstack sudo[98780]: pam_unix(sudo:session): session closed for user root Sep 16 20:28:29 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b35b235a-e8e0-495b-a83f-a8a898d52e6a tempest-VolumesDeleteCascade-1991260277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202" returned: 0 in 0.457s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:28:29 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b35b235a-e8e0-495b-a83f-a8a898d52e6a tempest-VolumesDeleteCascade-1991260277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202.e72c5bea-1f4c-4dda-a099-cc6f5ff10959 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:28:29 devstack sudo[98798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202.e72c5bea-1f4c-4dda-a099-cc6f5ff10959 Sep 16 20:28:29 devstack sudo[98798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:28:29 devstack sudo[98798]: pam_unix(sudo:session): session closed for user root Sep 16 20:28:29 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b35b235a-e8e0-495b-a83f-a8a898d52e6a tempest-VolumesDeleteCascade-1991260277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202.e72c5bea-1f4c-4dda-a099-cc6f5ff10959" returned: 0 in 0.642s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:28:29 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b35b235a-e8e0-495b-a83f-a8a898d52e6a tempest-VolumesDeleteCascade-1991260277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202.e72c5bea-1f4c-4dda-a099-cc6f5ff10959 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:28:30 devstack sudo[98848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202.e72c5bea-1f4c-4dda-a099-cc6f5ff10959 Sep 16 20:28:30 devstack sudo[98848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:28:30 devstack sudo[98848]: pam_unix(sudo:session): session closed for user root Sep 16 20:28:30 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b35b235a-e8e0-495b-a83f-a8a898d52e6a tempest-VolumesDeleteCascade-1991260277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202.e72c5bea-1f4c-4dda-a099-cc6f5ff10959" returned: 0 in 0.525s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:28:30 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-b35b235a-e8e0-495b-a83f-a8a898d52e6a tempest-VolumesDeleteCascade-1991260277 None] Lock "cinder-quobyte-e72c5bea-1f4c-4dda-a099-cc6f5ff10959" released by "_delete_snapshot" :: held 2.250s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:28:30 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-b35b235a-e8e0-495b-a83f-a8a898d52e6a tempest-VolumesDeleteCascade-1991260277 None] Lock "cinder-quobyte-ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202" released by "delete_snapshot" :: held 2.279s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:28:30 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-b35b235a-e8e0-495b-a83f-a8a898d52e6a tempest-VolumesDeleteCascade-1991260277 None] Created reservations ['0f62d64a-f9c1-4823-88d9-36804a284603', '851e0a58-6f25-4cd1-b028-786495b187dc', '43ddbe35-85e4-4e04-8428-b13380cad15d', '91176cfd-7cb9-449e-9205-89af4cfa02a2'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:28:30 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-b35b235a-e8e0-495b-a83f-a8a898d52e6a tempest-VolumesDeleteCascade-1991260277 None] Delete snapshot completed successfully. Sep 16 20:28:30 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-b35b235a-e8e0-495b-a83f-a8a898d52e6a tempest-VolumesDeleteCascade-1991260277 None] Lock "cinder-e72c5bea-1f4c-4dda-a099-cc6f5ff10959-delete_snapshot" released by "delete_snapshot" :: held 2.634s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:28:30 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-b35b235a-e8e0-495b-a83f-a8a898d52e6a tempest-VolumesDeleteCascade-1991260277 None] Snapshots deleted, issuing volume delete {{(pid=86188) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 16 20:28:30 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-b35b235a-e8e0-495b-a83f-a8a898d52e6a tempest-VolumesDeleteCascade-1991260277 None] Acquiring lock "cinder-quobyte-ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:28:30 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-b35b235a-e8e0-495b-a83f-a8a898d52e6a tempest-VolumesDeleteCascade-1991260277 None] Lock "cinder-quobyte-ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202" acquired by "delete_volume" :: waited 0.036s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:28:31 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec82d20a-0105-487f-af74-57f717951531]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:28:31 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b35b235a-e8e0-495b-a83f-a8a898d52e6a tempest-VolumesDeleteCascade-1991260277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:28:31 devstack sudo[98862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202 Sep 16 20:28:31 devstack sudo[98862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:28:31 devstack sudo[98862]: pam_unix(sudo:session): session closed for user root Sep 16 20:28:31 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b35b235a-e8e0-495b-a83f-a8a898d52e6a tempest-VolumesDeleteCascade-1991260277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202" returned: 0 in 0.523s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:28:31 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b35b235a-e8e0-495b-a83f-a8a898d52e6a tempest-VolumesDeleteCascade-1991260277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:28:31 devstack sudo[98870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202 Sep 16 20:28:31 devstack sudo[98870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:28:31 devstack sudo[98870]: pam_unix(sudo:session): session closed for user root Sep 16 20:28:31 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b35b235a-e8e0-495b-a83f-a8a898d52e6a tempest-VolumesDeleteCascade-1991260277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202" returned: 0 in 0.277s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:28:31 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-b35b235a-e8e0-495b-a83f-a8a898d52e6a tempest-VolumesDeleteCascade-1991260277 None] Lock "cinder-quobyte-ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202" released by "delete_volume" :: held 0.919s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:28:31 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-b35b235a-e8e0-495b-a83f-a8a898d52e6a tempest-VolumesDeleteCascade-1991260277 None] Created reservations ['4403d9c6-b3b6-43a2-b72a-88cc26df49e1', '132edbd3-123d-4cf6-9478-35fd7e70c4dd', '0f2cb8a1-08c6-4ec0-b0d9-57a8d061105b', 'fc08dd1a-b7d7-45ac-aace-f3255563604f'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:28:32 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-b35b235a-e8e0-495b-a83f-a8a898d52e6a tempest-VolumesDeleteCascade-1991260277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:28:32 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-b35b235a-e8e0-495b-a83f-a8a898d52e6a tempest-VolumesDeleteCascade-1991260277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:28:32 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-b35b235a-e8e0-495b-a83f-a8a898d52e6a tempest-VolumesDeleteCascade-1991260277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:28:32 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-b35b235a-e8e0-495b-a83f-a8a898d52e6a tempest-VolumesDeleteCascade-1991260277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:28:32 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-b35b235a-e8e0-495b-a83f-a8a898d52e6a tempest-VolumesDeleteCascade-1991260277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:28:32 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b35b235a-e8e0-495b-a83f-a8a898d52e6a tempest-VolumesDeleteCascade-1991260277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:28:32 devstack sudo[98873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:28:32 devstack sudo[98873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:28:32 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-c94c8997-24bd-4b16-87d0-4c565961bdce tempest-VolumesActionsTest-1215772093 None] Acquiring lock "cinder-14e4b8a9-9dca-4bf6-a883-7eec30b66d00" by "attach_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:28:32 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-c94c8997-24bd-4b16-87d0-4c565961bdce tempest-VolumesActionsTest-1215772093 None] Lock "cinder-14e4b8a9-9dca-4bf6-a883-7eec30b66d00" acquired by "attach_volume" :: waited 0.034s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:28:32 devstack sudo[98873]: pam_unix(sudo:session): session closed for user root Sep 16 20:28:32 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-c94c8997-24bd-4b16-87d0-4c565961bdce tempest-VolumesActionsTest-1215772093 None] Attaching volume 14e4b8a9-9dca-4bf6-a883-7eec30b66d00 to instance 782d4e45-edcb-4ded-a04c-24ccda956c49 at mountpoint /dev/vdb on host None. Sep 16 20:28:32 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b35b235a-e8e0-495b-a83f-a8a898d52e6a tempest-VolumesDeleteCascade-1991260277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.584s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:28:32 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-b35b235a-e8e0-495b-a83f-a8a898d52e6a tempest-VolumesDeleteCascade-1991260277 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:28:32 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-b35b235a-e8e0-495b-a83f-a8a898d52e6a tempest-VolumesDeleteCascade-1991260277 None] Deleted volume successfully. Sep 16 20:28:32 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-b35b235a-e8e0-495b-a83f-a8a898d52e6a tempest-VolumesDeleteCascade-1991260277 None] Lock "cinder-ebe5c1e3-247f-46bf-9bd7-d1c4ee7c1202-delete_volume" released by "delete_volume" :: held 8.508s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:28:32 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-c94c8997-24bd-4b16-87d0-4c565961bdce tempest-VolumesActionsTest-1215772093 None] Attach volume completed successfully. Sep 16 20:28:32 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-c94c8997-24bd-4b16-87d0-4c565961bdce tempest-VolumesActionsTest-1215772093 None] Lock "cinder-14e4b8a9-9dca-4bf6-a883-7eec30b66d00" released by "attach_volume" :: held 0.252s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:28:33 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-8e9624f6-e47c-4fb0-a94d-7fe9e66b49c9 tempest-VolumesActionsTest-1215772093 None] Acquiring lock "cinder-14e4b8a9-9dca-4bf6-a883-7eec30b66d00-detach_volume" by "detach_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:28:33 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-8e9624f6-e47c-4fb0-a94d-7fe9e66b49c9 tempest-VolumesActionsTest-1215772093 None] Lock "cinder-14e4b8a9-9dca-4bf6-a883-7eec30b66d00-detach_volume" acquired by "detach_volume" :: waited 0.028s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:28:33 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-8e9624f6-e47c-4fb0-a94d-7fe9e66b49c9 tempest-VolumesActionsTest-1215772093 None] Detaching volume 14e4b8a9-9dca-4bf6-a883-7eec30b66d00 from instance 782d4e45-edcb-4ded-a04c-24ccda956c49. Sep 16 20:28:33 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-8e9624f6-e47c-4fb0-a94d-7fe9e66b49c9 tempest-VolumesActionsTest-1215772093 None] Detach volume completed successfully. Sep 16 20:28:33 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-8e9624f6-e47c-4fb0-a94d-7fe9e66b49c9 tempest-VolumesActionsTest-1215772093 None] Lock "cinder-14e4b8a9-9dca-4bf6-a883-7eec30b66d00-detach_volume" released by "detach_volume" :: held 0.114s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:28:33 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-a268c347-5f46-4a2c-b316-4d5c80126383 tempest-VolumesDeleteCascade-1991260277 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:28:33 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a268c347-5f46-4a2c-b316-4d5c80126383 tempest-VolumesDeleteCascade-1991260277 None] Flow 'volume_create_manager' (83f2104e-5850-4133-bc8d-45d1523a61f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:28:33 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a268c347-5f46-4a2c-b316-4d5c80126383 tempest-VolumesDeleteCascade-1991260277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48ad9c93-194e-4787-9f4c-d2334da6a794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:28:33 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a268c347-5f46-4a2c-b316-4d5c80126383 tempest-VolumesDeleteCascade-1991260277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48ad9c93-194e-4787-9f4c-d2334da6a794) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:28:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1723650187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2447a15-7fec-4aca-a12e-c828fef49f15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ad87c2a340d4c57abd678fe060add15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:28:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:28:34Z,use_quota=True,user_id='f51f8820f7264ba49dcb0ae8a1062475',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:28:33 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a268c347-5f46-4a2c-b316-4d5c80126383 tempest-VolumesDeleteCascade-1991260277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ec26e2d-a699-48f9-ad63-e23dac870fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:28:33 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a268c347-5f46-4a2c-b316-4d5c80126383 tempest-VolumesDeleteCascade-1991260277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ec26e2d-a699-48f9-ad63-e23dac870fed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:28:33 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a268c347-5f46-4a2c-b316-4d5c80126383 tempest-VolumesDeleteCascade-1991260277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf6fea85-499a-410f-bf3a-f0904719ba9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:28:33 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a268c347-5f46-4a2c-b316-4d5c80126383 tempest-VolumesDeleteCascade-1991260277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf6fea85-499a-410f-bf3a-f0904719ba9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2447a15-7fec-4aca-a12e-c828fef49f15', 'volume_name': 'volume-e2447a15-7fec-4aca-a12e-c828fef49f15', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:28:33 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a268c347-5f46-4a2c-b316-4d5c80126383 tempest-VolumesDeleteCascade-1991260277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba1d7a9c-57ca-43d1-8d6d-8752e7369b84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:28:33 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a268c347-5f46-4a2c-b316-4d5c80126383 tempest-VolumesDeleteCascade-1991260277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba1d7a9c-57ca-43d1-8d6d-8752e7369b84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:28:33 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a268c347-5f46-4a2c-b316-4d5c80126383 tempest-VolumesDeleteCascade-1991260277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2711d3d5-22ed-4f33-97ec-5055bae59d79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:28:33 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-a268c347-5f46-4a2c-b316-4d5c80126383 tempest-VolumesDeleteCascade-1991260277 None] Volume e2447a15-7fec-4aca-a12e-c828fef49f15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2447a15-7fec-4aca-a12e-c828fef49f15', 'volume_size': 1} Sep 16 20:28:33 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a268c347-5f46-4a2c-b316-4d5c80126383 tempest-VolumesDeleteCascade-1991260277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:28:33 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a268c347-5f46-4a2c-b316-4d5c80126383 tempest-VolumesDeleteCascade-1991260277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:28:33 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-a268c347-5f46-4a2c-b316-4d5c80126383 tempest-VolumesDeleteCascade-1991260277 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:28:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1723650187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2447a15-7fec-4aca-a12e-c828fef49f15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ad87c2a340d4c57abd678fe060add15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:28:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:28:34Z,use_quota=True,user_id='f51f8820f7264ba49dcb0ae8a1062475',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:28:33 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-a268c347-5f46-4a2c-b316-4d5c80126383 tempest-VolumesDeleteCascade-1991260277 None] Creating volume e2447a15-7fec-4aca-a12e-c828fef49f15 {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:28:33 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a268c347-5f46-4a2c-b316-4d5c80126383 tempest-VolumesDeleteCascade-1991260277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:28:33 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a268c347-5f46-4a2c-b316-4d5c80126383 tempest-VolumesDeleteCascade-1991260277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:28:33 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-a268c347-5f46-4a2c-b316-4d5c80126383 tempest-VolumesDeleteCascade-1991260277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:28:33 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-a268c347-5f46-4a2c-b316-4d5c80126383 tempest-VolumesDeleteCascade-1991260277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:28:33 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a268c347-5f46-4a2c-b316-4d5c80126383 tempest-VolumesDeleteCascade-1991260277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:28:33 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-a268c347-5f46-4a2c-b316-4d5c80126383 tempest-VolumesDeleteCascade-1991260277 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:28:33 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-a268c347-5f46-4a2c-b316-4d5c80126383 tempest-VolumesDeleteCascade-1991260277 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:28:33 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a268c347-5f46-4a2c-b316-4d5c80126383 tempest-VolumesDeleteCascade-1991260277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e2447a15-7fec-4aca-a12e-c828fef49f15 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:28:33 devstack sudo[98876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e2447a15-7fec-4aca-a12e-c828fef49f15 1073741824 Sep 16 20:28:33 devstack sudo[98876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:28:34 devstack sudo[98876]: pam_unix(sudo:session): session closed for user root Sep 16 20:28:34 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a268c347-5f46-4a2c-b316-4d5c80126383 tempest-VolumesDeleteCascade-1991260277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e2447a15-7fec-4aca-a12e-c828fef49f15 1073741824" returned: 0 in 0.565s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:28:34 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a268c347-5f46-4a2c-b316-4d5c80126383 tempest-VolumesDeleteCascade-1991260277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e2447a15-7fec-4aca-a12e-c828fef49f15 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:28:34 devstack sudo[98891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e2447a15-7fec-4aca-a12e-c828fef49f15 Sep 16 20:28:34 devstack sudo[98891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:28:34 devstack sudo[98891]: pam_unix(sudo:session): session closed for user root Sep 16 20:28:34 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a268c347-5f46-4a2c-b316-4d5c80126383 tempest-VolumesDeleteCascade-1991260277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e2447a15-7fec-4aca-a12e-c828fef49f15" returned: 0 in 0.378s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:28:34 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-a268c347-5f46-4a2c-b316-4d5c80126383 tempest-VolumesDeleteCascade-1991260277 None] <== create_volume: return (1002ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:28:34 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a268c347-5f46-4a2c-b316-4d5c80126383 tempest-VolumesDeleteCascade-1991260277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.004s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:28:34 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a268c347-5f46-4a2c-b316-4d5c80126383 tempest-VolumesDeleteCascade-1991260277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2711d3d5-22ed-4f33-97ec-5055bae59d79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2447a15-7fec-4aca-a12e-c828fef49f15', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:28:34 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a268c347-5f46-4a2c-b316-4d5c80126383 tempest-VolumesDeleteCascade-1991260277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3db35dca-2224-4e55-a656-36a1733f6deb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:28:34 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-a268c347-5f46-4a2c-b316-4d5c80126383 tempest-VolumesDeleteCascade-1991260277 None] Volume volume-e2447a15-7fec-4aca-a12e-c828fef49f15 (e2447a15-7fec-4aca-a12e-c828fef49f15): created successfully Sep 16 20:28:34 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a268c347-5f46-4a2c-b316-4d5c80126383 tempest-VolumesDeleteCascade-1991260277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3db35dca-2224-4e55-a656-36a1733f6deb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:28:34 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a268c347-5f46-4a2c-b316-4d5c80126383 tempest-VolumesDeleteCascade-1991260277 None] Flow 'volume_create_manager' (83f2104e-5850-4133-bc8d-45d1523a61f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:28:34 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-a268c347-5f46-4a2c-b316-4d5c80126383 tempest-VolumesDeleteCascade-1991260277 None] Created volume successfully. Sep 16 20:28:35 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-8733d386-dca0-4b6a-b9be-a5cda2e8b2aa tempest-VolumesDeleteCascade-1991260277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:28:35 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-8733d386-dca0-4b6a-b9be-a5cda2e8b2aa tempest-VolumesDeleteCascade-1991260277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:28:35 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-8733d386-dca0-4b6a-b9be-a5cda2e8b2aa tempest-VolumesDeleteCascade-1991260277 None] Creating offline snapshot fcd4bac4-078d-4fe1-920f-af2575d3e898 of volume e2447a15-7fec-4aca-a12e-c828fef49f15 {{(pid=86188) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 20:28:35 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1ce2a8d-a798-4d76-acb7-8377cccb35d4]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:28:35 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-8733d386-dca0-4b6a-b9be-a5cda2e8b2aa tempest-VolumesDeleteCascade-1991260277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e2447a15-7fec-4aca-a12e-c828fef49f15 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:28:36 devstack sudo[98906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e2447a15-7fec-4aca-a12e-c828fef49f15 Sep 16 20:28:36 devstack sudo[98906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:28:36 devstack sudo[98906]: pam_unix(sudo:session): session closed for user root Sep 16 20:28:36 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-8733d386-dca0-4b6a-b9be-a5cda2e8b2aa tempest-VolumesDeleteCascade-1991260277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e2447a15-7fec-4aca-a12e-c828fef49f15" returned: 0 in 0.411s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:28:36 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-8733d386-dca0-4b6a-b9be-a5cda2e8b2aa tempest-VolumesDeleteCascade-1991260277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e2447a15-7fec-4aca-a12e-c828fef49f15,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e2447a15-7fec-4aca-a12e-c828fef49f15.fcd4bac4-078d-4fe1-920f-af2575d3e898 1G {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:28:36 devstack sudo[98911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e2447a15-7fec-4aca-a12e-c828fef49f15,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e2447a15-7fec-4aca-a12e-c828fef49f15.fcd4bac4-078d-4fe1-920f-af2575d3e898 1G Sep 16 20:28:36 devstack sudo[98911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:28:36 devstack sudo[98911]: pam_unix(sudo:session): session closed for user root Sep 16 20:28:36 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-8733d386-dca0-4b6a-b9be-a5cda2e8b2aa tempest-VolumesDeleteCascade-1991260277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e2447a15-7fec-4aca-a12e-c828fef49f15,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e2447a15-7fec-4aca-a12e-c828fef49f15.fcd4bac4-078d-4fe1-920f-af2575d3e898 1G" returned: 0 in 0.567s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:28:36 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-8733d386-dca0-4b6a-b9be-a5cda2e8b2aa tempest-VolumesDeleteCascade-1991260277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2447a15-7fec-4aca-a12e-c828fef49f15 -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e2447a15-7fec-4aca-a12e-c828fef49f15.fcd4bac4-078d-4fe1-920f-af2575d3e898 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:28:36 devstack sudo[98918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2447a15-7fec-4aca-a12e-c828fef49f15 -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e2447a15-7fec-4aca-a12e-c828fef49f15.fcd4bac4-078d-4fe1-920f-af2575d3e898 Sep 16 20:28:36 devstack sudo[98918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:28:37 devstack sudo[98918]: pam_unix(sudo:session): session closed for user root Sep 16 20:28:37 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-8733d386-dca0-4b6a-b9be-a5cda2e8b2aa tempest-VolumesDeleteCascade-1991260277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2447a15-7fec-4aca-a12e-c828fef49f15 -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e2447a15-7fec-4aca-a12e-c828fef49f15.fcd4bac4-078d-4fe1-920f-af2575d3e898" returned: 0 in 0.370s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:28:37 devstack cinder-volume[86188]: WARNING cinder.volume.drivers.remotefs [None req-8733d386-dca0-4b6a-b9be-a5cda2e8b2aa tempest-VolumesDeleteCascade-1991260277 None] /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e2447a15-7fec-4aca-a12e-c828fef49f15.fcd4bac4-078d-4fe1-920f-af2575d3e898 is being set with open permissions: ugo+rw Sep 16 20:28:37 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-8733d386-dca0-4b6a-b9be-a5cda2e8b2aa tempest-VolumesDeleteCascade-1991260277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e2447a15-7fec-4aca-a12e-c828fef49f15.fcd4bac4-078d-4fe1-920f-af2575d3e898 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:28:37 devstack sudo[98923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e2447a15-7fec-4aca-a12e-c828fef49f15.fcd4bac4-078d-4fe1-920f-af2575d3e898 Sep 16 20:28:37 devstack sudo[98923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:28:37 devstack sudo[98923]: pam_unix(sudo:session): session closed for user root Sep 16 20:28:37 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-8733d386-dca0-4b6a-b9be-a5cda2e8b2aa tempest-VolumesDeleteCascade-1991260277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e2447a15-7fec-4aca-a12e-c828fef49f15.fcd4bac4-078d-4fe1-920f-af2575d3e898" returned: 0 in 0.266s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:28:37 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-8733d386-dca0-4b6a-b9be-a5cda2e8b2aa tempest-VolumesDeleteCascade-1991260277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e2447a15-7fec-4aca-a12e-c828fef49f15.info {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:28:37 devstack sudo[98926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e2447a15-7fec-4aca-a12e-c828fef49f15.info Sep 16 20:28:37 devstack sudo[98926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:28:37 devstack sudo[98926]: pam_unix(sudo:session): session closed for user root Sep 16 20:28:37 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-8733d386-dca0-4b6a-b9be-a5cda2e8b2aa tempest-VolumesDeleteCascade-1991260277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e2447a15-7fec-4aca-a12e-c828fef49f15.info" returned: 0 in 0.307s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:28:37 devstack cinder-volume[86188]: WARNING cinder.volume.drivers.remotefs [None req-8733d386-dca0-4b6a-b9be-a5cda2e8b2aa tempest-VolumesDeleteCascade-1991260277 None] /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e2447a15-7fec-4aca-a12e-c828fef49f15.info is being set with open permissions: ugo+rw Sep 16 20:28:37 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-8733d386-dca0-4b6a-b9be-a5cda2e8b2aa tempest-VolumesDeleteCascade-1991260277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e2447a15-7fec-4aca-a12e-c828fef49f15.info {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:28:37 devstack sudo[98929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e2447a15-7fec-4aca-a12e-c828fef49f15.info Sep 16 20:28:37 devstack sudo[98929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:28:38 devstack sudo[98929]: pam_unix(sudo:session): session closed for user root Sep 16 20:28:38 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-8733d386-dca0-4b6a-b9be-a5cda2e8b2aa tempest-VolumesDeleteCascade-1991260277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e2447a15-7fec-4aca-a12e-c828fef49f15.info" returned: 0 in 0.389s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:28:38 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-8733d386-dca0-4b6a-b9be-a5cda2e8b2aa tempest-VolumesDeleteCascade-1991260277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.454s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:28:38 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-8733d386-dca0-4b6a-b9be-a5cda2e8b2aa tempest-VolumesDeleteCascade-1991260277 None] Create snapshot completed successfully Sep 16 20:28:39 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-4949db49-8f3c-47af-875d-4ef2a0016882 tempest-VolumesActionsTest-1215772093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:28:39 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-4949db49-8f3c-47af-875d-4ef2a0016882 tempest-VolumesActionsTest-1215772093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.004s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:28:39 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d67115d-aa65-4094-84a0-f15c115adb63]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:28:39 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-4949db49-8f3c-47af-875d-4ef2a0016882 tempest-VolumesActionsTest-1215772093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-14e4b8a9-9dca-4bf6-a883-7eec30b66d00 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:28:39 devstack sudo[98933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-14e4b8a9-9dca-4bf6-a883-7eec30b66d00 Sep 16 20:28:39 devstack sudo[98933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:28:39 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1c9ac1f-80e5-469e-a0de-6939d872b2e3 tempest-VolumesDeleteCascade-1991260277 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:28:39 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e1c9ac1f-80e5-469e-a0de-6939d872b2e3 tempest-VolumesDeleteCascade-1991260277 None] Flow 'volume_create_manager' (b3ed0421-324b-4d89-bf6d-6c11df1803af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:28:39 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e1c9ac1f-80e5-469e-a0de-6939d872b2e3 tempest-VolumesDeleteCascade-1991260277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f15cdd0-bad2-4080-b660-740e56c4c723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:28:39 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e1c9ac1f-80e5-469e-a0de-6939d872b2e3 tempest-VolumesDeleteCascade-1991260277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f15cdd0-bad2-4080-b660-740e56c4c723) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:28:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2013387421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b81403ed-a197-4fb6-885e-f9bb3305c41f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ad87c2a340d4c57abd678fe060add15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:28:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=fcd4bac4-078d-4fe1-920f-af2575d3e898,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:28:40Z,use_quota=True,user_id='f51f8820f7264ba49dcb0ae8a1062475',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:28:39 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e1c9ac1f-80e5-469e-a0de-6939d872b2e3 tempest-VolumesDeleteCascade-1991260277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47edd308-2c7e-43a1-9c65-67b7f281e9fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:28:39 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e1c9ac1f-80e5-469e-a0de-6939d872b2e3 tempest-VolumesDeleteCascade-1991260277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47edd308-2c7e-43a1-9c65-67b7f281e9fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:28:39 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e1c9ac1f-80e5-469e-a0de-6939d872b2e3 tempest-VolumesDeleteCascade-1991260277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef163cf2-31e5-4e56-9bba-90345bd8d51b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:28:39 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e1c9ac1f-80e5-469e-a0de-6939d872b2e3 tempest-VolumesDeleteCascade-1991260277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef163cf2-31e5-4e56-9bba-90345bd8d51b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b81403ed-a197-4fb6-885e-f9bb3305c41f', 'volume_name': 'volume-b81403ed-a197-4fb6-885e-f9bb3305c41f', 'volume_size': 1, 'snapshot_id': 'fcd4bac4-078d-4fe1-920f-af2575d3e898'}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:28:39 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e1c9ac1f-80e5-469e-a0de-6939d872b2e3 tempest-VolumesDeleteCascade-1991260277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9964697-6f58-4ad4-8a59-e42ae62ac13c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:28:39 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e1c9ac1f-80e5-469e-a0de-6939d872b2e3 tempest-VolumesDeleteCascade-1991260277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9964697-6f58-4ad4-8a59-e42ae62ac13c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:28:39 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e1c9ac1f-80e5-469e-a0de-6939d872b2e3 tempest-VolumesDeleteCascade-1991260277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e98734ab-2f3c-4501-8d5c-02ee5b8a9fc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:28:39 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-e1c9ac1f-80e5-469e-a0de-6939d872b2e3 tempest-VolumesDeleteCascade-1991260277 None] Volume b81403ed-a197-4fb6-885e-f9bb3305c41f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b81403ed-a197-4fb6-885e-f9bb3305c41f', 'volume_size': 1, 'snapshot_id': 'fcd4bac4-078d-4fe1-920f-af2575d3e898'} Sep 16 20:28:39 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-e1c9ac1f-80e5-469e-a0de-6939d872b2e3 tempest-VolumesDeleteCascade-1991260277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:28:39 devstack sudo[98933]: pam_unix(sudo:session): session closed for user root Sep 16 20:28:39 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-4949db49-8f3c-47af-875d-4ef2a0016882 tempest-VolumesActionsTest-1215772093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-14e4b8a9-9dca-4bf6-a883-7eec30b66d00" returned: 0 in 0.526s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:28:39 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[0280d55b-d5b3-48cc-8e9d-d7b296b5c847]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:28:39 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-4949db49-8f3c-47af-875d-4ef2a0016882 tempest-VolumesActionsTest-1215772093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-14e4b8a9-9dca-4bf6-a883-7eec30b66d00 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:28:39 devstack sudo[98938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-14e4b8a9-9dca-4bf6-a883-7eec30b66d00 Sep 16 20:28:39 devstack sudo[98938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:28:40 devstack sudo[98938]: pam_unix(sudo:session): session closed for user root Sep 16 20:28:40 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-4949db49-8f3c-47af-875d-4ef2a0016882 tempest-VolumesActionsTest-1215772093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-14e4b8a9-9dca-4bf6-a883-7eec30b66d00" returned: 0 in 0.389s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:28:40 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-4949db49-8f3c-47af-875d-4ef2a0016882 tempest-VolumesActionsTest-1215772093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-14e4b8a9-9dca-4bf6-a883-7eec30b66d00 /opt/stack/data/cinder/conversion/14e4b8a9-9dca-4bf6-a883-7eec30b66d00.temp_image.0db66191-9609-4a38-bbc6-243fe3cc6e52cd1h6iu6.img {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:28:40 devstack sudo[98943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-14e4b8a9-9dca-4bf6-a883-7eec30b66d00 /opt/stack/data/cinder/conversion/14e4b8a9-9dca-4bf6-a883-7eec30b66d00.temp_image.0db66191-9609-4a38-bbc6-243fe3cc6e52cd1h6iu6.img Sep 16 20:28:40 devstack sudo[98943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:28:47 devstack sudo[98943]: pam_unix(sudo:session): session closed for user root Sep 16 20:28:47 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-4949db49-8f3c-47af-875d-4ef2a0016882 tempest-VolumesActionsTest-1215772093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-14e4b8a9-9dca-4bf6-a883-7eec30b66d00 /opt/stack/data/cinder/conversion/14e4b8a9-9dca-4bf6-a883-7eec30b66d00.temp_image.0db66191-9609-4a38-bbc6-243fe3cc6e52cd1h6iu6.img" returned: 0 in 6.994s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:28:47 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[89491371-51f0-4373-9a8f-94ac6615416b]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:28:47 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-4949db49-8f3c-47af-875d-4ef2a0016882 tempest-VolumesActionsTest-1215772093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-14e4b8a9-9dca-4bf6-a883-7eec30b66d00 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:28:47 devstack sudo[98956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-14e4b8a9-9dca-4bf6-a883-7eec30b66d00 Sep 16 20:28:47 devstack sudo[98956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:28:47 devstack sudo[98956]: pam_unix(sudo:session): session closed for user root Sep 16 20:28:47 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-4949db49-8f3c-47af-875d-4ef2a0016882 tempest-VolumesActionsTest-1215772093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-14e4b8a9-9dca-4bf6-a883-7eec30b66d00" returned: 0 in 0.552s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:28:47 devstack cinder-volume[86188]: DEBUG cinder.image.image_utils [None req-4949db49-8f3c-47af-875d-4ef2a0016882 tempest-VolumesActionsTest-1215772093 None] Image conversion details: src /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-14e4b8a9-9dca-4bf6-a883-7eec30b66d00, size 1024.00 MB, duration 7.00 sec, destination /opt/stack/data/cinder/conversion/14e4b8a9-9dca-4bf6-a883-7eec30b66d00.temp_image.0db66191-9609-4a38-bbc6-243fe3cc6e52cd1h6iu6.img {{(pid=86188) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 16 20:28:47 devstack cinder-volume[86188]: INFO cinder.image.image_utils [None req-4949db49-8f3c-47af-875d-4ef2a0016882 tempest-VolumesActionsTest-1215772093 None] Converted 1024.00 MB image at 146.38 MB/s Sep 16 20:28:47 devstack cinder-volume[86188]: DEBUG cinder.image.image_utils [None req-4949db49-8f3c-47af-875d-4ef2a0016882 tempest-VolumesActionsTest-1215772093 None] 0db66191-9609-4a38-bbc6-243fe3cc6e52 was raw, no need to convert to raw {{(pid=86188) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 16 20:28:48 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed4e919c-e113-4d40-9bfe-a9e8b0e78927 tempest-TestInstancesWithCinderVolumes-1553461958 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:28:48 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ed4e919c-e113-4d40-9bfe-a9e8b0e78927 tempest-TestInstancesWithCinderVolumes-1553461958 None] Flow 'volume_create_manager' (427e0d8e-86c9-4988-8da2-eab46c728343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:28:48 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ed4e919c-e113-4d40-9bfe-a9e8b0e78927 tempest-TestInstancesWithCinderVolumes-1553461958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (798ad81b-bf4a-4a26-b225-12ba7206adbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:28:48 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ed4e919c-e113-4d40-9bfe-a9e8b0e78927 tempest-TestInstancesWithCinderVolumes-1553461958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (798ad81b-bf4a-4a26-b225-12ba7206adbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:28:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-406560940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b0f4d04-de77-46dd-b428-982c9e7d7f82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fad99bedfd048c9906202815781714c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:28:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:28:48Z,use_quota=True,user_id='5723c65d9d3745d18c2091dd1f703694',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f9a37777-fed5-4690-bb91-c68f1ece5fd0),volume_type_id=f9a37777-fed5-4690-bb91-c68f1ece5fd0)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:28:48 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ed4e919c-e113-4d40-9bfe-a9e8b0e78927 tempest-TestInstancesWithCinderVolumes-1553461958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b6b187e-1b81-415f-899b-dafba9e7517c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:28:48 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ed4e919c-e113-4d40-9bfe-a9e8b0e78927 tempest-TestInstancesWithCinderVolumes-1553461958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b6b187e-1b81-415f-899b-dafba9e7517c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:28:48 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ed4e919c-e113-4d40-9bfe-a9e8b0e78927 tempest-TestInstancesWithCinderVolumes-1553461958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96a7097c-25fd-4fc4-a55b-c26887199833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:28:48 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ed4e919c-e113-4d40-9bfe-a9e8b0e78927 tempest-TestInstancesWithCinderVolumes-1553461958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96a7097c-25fd-4fc4-a55b-c26887199833) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b0f4d04-de77-46dd-b428-982c9e7d7f82', 'volume_name': 'volume-3b0f4d04-de77-46dd-b428-982c9e7d7f82', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:28:48 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ed4e919c-e113-4d40-9bfe-a9e8b0e78927 tempest-TestInstancesWithCinderVolumes-1553461958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07070538-7998-441c-97ea-3cd25dc7c7bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:28:48 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ed4e919c-e113-4d40-9bfe-a9e8b0e78927 tempest-TestInstancesWithCinderVolumes-1553461958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07070538-7998-441c-97ea-3cd25dc7c7bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:28:48 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ed4e919c-e113-4d40-9bfe-a9e8b0e78927 tempest-TestInstancesWithCinderVolumes-1553461958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8357641d-5031-4c9f-ae9e-90b1a59d44cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:28:48 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-ed4e919c-e113-4d40-9bfe-a9e8b0e78927 tempest-TestInstancesWithCinderVolumes-1553461958 None] Volume 3b0f4d04-de77-46dd-b428-982c9e7d7f82: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b0f4d04-de77-46dd-b428-982c9e7d7f82', 'volume_size': 1} Sep 16 20:28:48 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-ed4e919c-e113-4d40-9bfe-a9e8b0e78927 tempest-TestInstancesWithCinderVolumes-1553461958 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:28:48 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-4439bcef-814e-423b-9af3-0e23e89d94d9 tempest-TestInstancesWithCinderVolumes-1553461958 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:28:48 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-4439bcef-814e-423b-9af3-0e23e89d94d9 tempest-TestInstancesWithCinderVolumes-1553461958 None] Flow 'volume_create_manager' (7156dba7-728c-42f0-9ff7-7cc624e88e11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:28:48 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-4439bcef-814e-423b-9af3-0e23e89d94d9 tempest-TestInstancesWithCinderVolumes-1553461958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e38764a-5f82-4c76-9d75-158cf1a51f22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:28:48 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-4439bcef-814e-423b-9af3-0e23e89d94d9 tempest-TestInstancesWithCinderVolumes-1553461958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e38764a-5f82-4c76-9d75-158cf1a51f22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:28:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1937240554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=808d0b31-b417-4b34-9976-d150b62aeb2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fad99bedfd048c9906202815781714c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:28:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:28:49Z,use_quota=True,user_id='5723c65d9d3745d18c2091dd1f703694',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9149a32e-53fe-4b14-a13e-bf8709ef93e9),volume_type_id=9149a32e-53fe-4b14-a13e-bf8709ef93e9)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:28:48 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-4439bcef-814e-423b-9af3-0e23e89d94d9 tempest-TestInstancesWithCinderVolumes-1553461958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (188ee43a-dcfa-47ec-bc20-2067b4fd7675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:28:48 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-4439bcef-814e-423b-9af3-0e23e89d94d9 tempest-TestInstancesWithCinderVolumes-1553461958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (188ee43a-dcfa-47ec-bc20-2067b4fd7675) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:28:48 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-4439bcef-814e-423b-9af3-0e23e89d94d9 tempest-TestInstancesWithCinderVolumes-1553461958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ebee025-cb17-44c9-afc6-1dbff8657ba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:28:48 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-4439bcef-814e-423b-9af3-0e23e89d94d9 tempest-TestInstancesWithCinderVolumes-1553461958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ebee025-cb17-44c9-afc6-1dbff8657ba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '808d0b31-b417-4b34-9976-d150b62aeb2a', 'volume_name': 'volume-808d0b31-b417-4b34-9976-d150b62aeb2a', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:28:48 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-4439bcef-814e-423b-9af3-0e23e89d94d9 tempest-TestInstancesWithCinderVolumes-1553461958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b248ea2-d5fd-4b8c-bec6-bdeed33a8c24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:28:48 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-4439bcef-814e-423b-9af3-0e23e89d94d9 tempest-TestInstancesWithCinderVolumes-1553461958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b248ea2-d5fd-4b8c-bec6-bdeed33a8c24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:28:48 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-4439bcef-814e-423b-9af3-0e23e89d94d9 tempest-TestInstancesWithCinderVolumes-1553461958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb01be7f-d68f-4ae0-be08-59ed268358e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:28:48 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-4439bcef-814e-423b-9af3-0e23e89d94d9 tempest-TestInstancesWithCinderVolumes-1553461958 None] Volume 808d0b31-b417-4b34-9976-d150b62aeb2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-808d0b31-b417-4b34-9976-d150b62aeb2a', 'volume_size': 1} Sep 16 20:28:48 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-4439bcef-814e-423b-9af3-0e23e89d94d9 tempest-TestInstancesWithCinderVolumes-1553461958 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:28:49 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-afb97dd8-1607-4962-826d-aabcc2cef19f tempest-TestInstancesWithCinderVolumes-1553461958 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:28:49 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-afb97dd8-1607-4962-826d-aabcc2cef19f tempest-TestInstancesWithCinderVolumes-1553461958 None] Flow 'volume_create_manager' (cfc87a43-7869-4d62-aff8-73d4d227c324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:28:49 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-afb97dd8-1607-4962-826d-aabcc2cef19f tempest-TestInstancesWithCinderVolumes-1553461958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df38fd51-7799-40b9-aa5e-edf95d824140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:28:49 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-afb97dd8-1607-4962-826d-aabcc2cef19f tempest-TestInstancesWithCinderVolumes-1553461958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df38fd51-7799-40b9-aa5e-edf95d824140) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:28:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1174952075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed767f87-8501-4441-b005-ce0270bb7fe7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fad99bedfd048c9906202815781714c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:28:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:28:49Z,use_quota=True,user_id='5723c65d9d3745d18c2091dd1f703694',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d42ea7cb-135f-402b-a7a7-d900739f9177),volume_type_id=d42ea7cb-135f-402b-a7a7-d900739f9177)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:28:49 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-afb97dd8-1607-4962-826d-aabcc2cef19f tempest-TestInstancesWithCinderVolumes-1553461958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c144d91a-3063-415c-ae13-2db0c67d97b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:28:49 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-afb97dd8-1607-4962-826d-aabcc2cef19f tempest-TestInstancesWithCinderVolumes-1553461958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c144d91a-3063-415c-ae13-2db0c67d97b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:28:49 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-afb97dd8-1607-4962-826d-aabcc2cef19f tempest-TestInstancesWithCinderVolumes-1553461958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (565efe60-8e65-4d5a-90eb-fecd8387bb92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:28:49 devstack cinder-volume[86188]: DEBUG cinder.image.glance [None req-afb97dd8-1607-4962-826d-aabcc2cef19f tempest-TestInstancesWithCinderVolumes-1553461958 None] Creating Keystone auth plugin from conf {{(pid=86188) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 16 20:28:49 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-afb97dd8-1607-4962-826d-aabcc2cef19f tempest-TestInstancesWithCinderVolumes-1553461958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (565efe60-8e65-4d5a-90eb-fecd8387bb92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ed767f87-8501-4441-b005-ce0270bb7fe7', 'volume_name': 'volume-ed767f87-8501-4441-b005-ce0270bb7fe7', 'volume_size': 1, 'image_id': 'c5394efc-1bb6-4e97-a909-3206dae9b39a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c5394efc-1bb6-4e97-a909-3206dae9b39a', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1678878612', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2fad99bedfd048c9906202815781714c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c5394efc-1bb6-4e97-a909-3206dae9b39a', 'created_at': datetime.datetime(2026, 9, 16, 18, 28, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 18, 28, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c5394efc-1bb6-4e97-a909-3206dae9b39a/file', 'properties': {}}, 'image_service': }' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:28:49 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-afb97dd8-1607-4962-826d-aabcc2cef19f tempest-TestInstancesWithCinderVolumes-1553461958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5520f55b-0009-4c48-a4dc-eb45761429da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:28:49 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-afb97dd8-1607-4962-826d-aabcc2cef19f tempest-TestInstancesWithCinderVolumes-1553461958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5520f55b-0009-4c48-a4dc-eb45761429da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:28:49 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-afb97dd8-1607-4962-826d-aabcc2cef19f tempest-TestInstancesWithCinderVolumes-1553461958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b972783-f5d4-4985-9eed-12ad4989f342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:28:49 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-afb97dd8-1607-4962-826d-aabcc2cef19f tempest-TestInstancesWithCinderVolumes-1553461958 None] Volume ed767f87-8501-4441-b005-ce0270bb7fe7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ed767f87-8501-4441-b005-ce0270bb7fe7', 'volume_size': 1, 'image_id': 'c5394efc-1bb6-4e97-a909-3206dae9b39a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c5394efc-1bb6-4e97-a909-3206dae9b39a', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1678878612', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2fad99bedfd048c9906202815781714c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c5394efc-1bb6-4e97-a909-3206dae9b39a', 'created_at': datetime.datetime(2026, 9, 16, 18, 28, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 18, 28, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c5394efc-1bb6-4e97-a909-3206dae9b39a/file', 'properties': {}}, 'image_service': } Sep 16 20:28:49 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-afb97dd8-1607-4962-826d-aabcc2cef19f tempest-TestInstancesWithCinderVolumes-1553461958 None] Trying to clone ed767f87-8501-4441-b005-ce0270bb7fe7 from image c5394efc-1bb6-4e97-a909-3206dae9b39a at location (None, [{'url': 'file:///opt/stack/data/glance/images/c5394efc-1bb6-4e97-a909-3206dae9b39a', 'metadata': {}}]). {{(pid=86188) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 16 20:28:53 devstack cinder-volume[86188]: DEBUG oslo_service.periodic_task [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86188) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 20:28:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:28:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:28:53 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:28:53 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:28:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:28:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:28:53 devstack sudo[98962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:28:53 devstack sudo[98962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:28:53 devstack sudo[98962]: pam_unix(sudo:session): session closed for user root Sep 16 20:28:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.262s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:28:53 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:28:53 devstack cinder-volume[86188]: DEBUG oslo_service.periodic_task [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Running periodic task VolumeManager._thread_info {{(pid=86188) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 20:28:53 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] thread count: 28 {{(pid=86188) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 16 20:28:53 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] thread info: [<_MainThread(MainThread, started 139858124406912)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86188) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 16 20:28:53 devstack cinder-volume[86188]: DEBUG cinder.image.image_utils [None req-afb97dd8-1607-4962-826d-aabcc2cef19f tempest-TestInstancesWithCinderVolumes-1553461958 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c5394efc-1bb6-4e97-a909-3206dae9b39a_72m49qxgdevstack@QuobyteHD, size 20.69 MB, duration 3.76 sec {{(pid=86188) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 16 20:28:53 devstack cinder-volume[86188]: INFO cinder.image.image_utils [None req-afb97dd8-1607-4962-826d-aabcc2cef19f tempest-TestInstancesWithCinderVolumes-1553461958 None] Image download 20.69 MB at 5.51 MB/s Sep 16 20:28:53 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d539153-efd5-42c8-acb3-3916db864026]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:28:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-afb97dd8-1607-4962-826d-aabcc2cef19f tempest-TestInstancesWithCinderVolumes-1553461958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c5394efc-1bb6-4e97-a909-3206dae9b39a_72m49qxgdevstack@QuobyteHD {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:28:53 devstack sudo[98965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c5394efc-1bb6-4e97-a909-3206dae9b39a_72m49qxgdevstack@QuobyteHD Sep 16 20:28:53 devstack sudo[98965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:28:53 devstack sudo[98965]: pam_unix(sudo:session): session closed for user root Sep 16 20:28:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-afb97dd8-1607-4962-826d-aabcc2cef19f tempest-TestInstancesWithCinderVolumes-1553461958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c5394efc-1bb6-4e97-a909-3206dae9b39a_72m49qxgdevstack@QuobyteHD" returned: 0 in 0.343s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:28:53 devstack cinder-volume[86188]: DEBUG cinder.image.image_utils [None req-afb97dd8-1607-4962-826d-aabcc2cef19f tempest-TestInstancesWithCinderVolumes-1553461958 None] Temporary image c5394efc-1bb6-4e97-a909-3206dae9b39a is fetched for user 5723c65d9d3745d18c2091dd1f703694. {{(pid=86188) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 16 20:28:54 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6b973ef-21d0-4dec-98e2-2b58032c233d]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:28:54 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-afb97dd8-1607-4962-826d-aabcc2cef19f tempest-TestInstancesWithCinderVolumes-1553461958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c5394efc-1bb6-4e97-a909-3206dae9b39a_72m49qxgdevstack@QuobyteHD {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:28:54 devstack sudo[98970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c5394efc-1bb6-4e97-a909-3206dae9b39a_72m49qxgdevstack@QuobyteHD Sep 16 20:28:54 devstack sudo[98970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:28:54 devstack sudo[98970]: pam_unix(sudo:session): session closed for user root Sep 16 20:28:54 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-afb97dd8-1607-4962-826d-aabcc2cef19f tempest-TestInstancesWithCinderVolumes-1553461958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c5394efc-1bb6-4e97-a909-3206dae9b39a_72m49qxgdevstack@QuobyteHD" returned: 0 in 0.348s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:28:54 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-afb97dd8-1607-4962-826d-aabcc2cef19f tempest-TestInstancesWithCinderVolumes-1553461958 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:29:03 devstack cinder-volume[86188]: DEBUG dbcounter [-] [86188] Writing DB stats cinder:INSERT=10,cinder:SELECT=35,cinder:UPDATE=39,cinder:DELETE=2 {{(pid=86188) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 20:29:03 devstack cinder-volume[86188]: DEBUG dbcounter [-] [86188] Writing DB stats cinder:SELECT=50,cinder:INSERT=9,cinder:UPDATE=25,cinder:DELETE=2 {{(pid=86188) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 20:29:07 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-4949db49-8f3c-47af-875d-4ef2a0016882 tempest-VolumesActionsTest-1215772093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 27.955s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:29:07 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-4949db49-8f3c-47af-875d-4ef2a0016882 tempest-VolumesActionsTest-1215772093 None] Uploaded volume to glance image-id: 0db66191-9609-4a38-bbc6-243fe3cc6e52. {{(pid=86188) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 16 20:29:07 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-e1c9ac1f-80e5-469e-a0de-6939d872b2e3 tempest-VolumesDeleteCascade-1991260277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 27.413s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:29:07 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-e1c9ac1f-80e5-469e-a0de-6939d872b2e3 tempest-VolumesDeleteCascade-1991260277 None] Acquiring lock "cinder-quobyte-fcd4bac4-078d-4fe1-920f-af2575d3e898-b81403ed-a197-4fb6-885e-f9bb3305c41f" by "_create_volume_from_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:29:07 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-e1c9ac1f-80e5-469e-a0de-6939d872b2e3 tempest-VolumesDeleteCascade-1991260277 None] Lock "cinder-quobyte-fcd4bac4-078d-4fe1-920f-af2575d3e898-b81403ed-a197-4fb6-885e-f9bb3305c41f" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:29:07 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-e1c9ac1f-80e5-469e-a0de-6939d872b2e3 tempest-VolumesDeleteCascade-1991260277 None] Creating volume b81403ed-a197-4fb6-885e-f9bb3305c41f from snapshot fcd4bac4-078d-4fe1-920f-af2575d3e898 {{(pid=86188) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 16 20:29:07 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-e1c9ac1f-80e5-469e-a0de-6939d872b2e3 tempest-VolumesDeleteCascade-1991260277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:29:07 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-e1c9ac1f-80e5-469e-a0de-6939d872b2e3 tempest-VolumesDeleteCascade-1991260277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:29:07 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-e1c9ac1f-80e5-469e-a0de-6939d872b2e3 tempest-VolumesDeleteCascade-1991260277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:29:07 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-e1c9ac1f-80e5-469e-a0de-6939d872b2e3 tempest-VolumesDeleteCascade-1991260277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:29:07 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-e1c9ac1f-80e5-469e-a0de-6939d872b2e3 tempest-VolumesDeleteCascade-1991260277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:29:07 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-e1c9ac1f-80e5-469e-a0de-6939d872b2e3 tempest-VolumesDeleteCascade-1991260277 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:29:07 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-e1c9ac1f-80e5-469e-a0de-6939d872b2e3 tempest-VolumesDeleteCascade-1991260277 None] Acquiring lock "cinder-quobyte-b81403ed-a197-4fb6-885e-f9bb3305c41f" by "_copy_volume_from_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:29:07 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-4949db49-8f3c-47af-875d-4ef2a0016882 tempest-VolumesActionsTest-1215772093 None] Copy volume to image completed successfully. Sep 16 20:29:07 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-e1c9ac1f-80e5-469e-a0de-6939d872b2e3 tempest-VolumesDeleteCascade-1991260277 None] Lock "cinder-quobyte-b81403ed-a197-4fb6-885e-f9bb3305c41f" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:29:07 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-e1c9ac1f-80e5-469e-a0de-6939d872b2e3 tempest-VolumesDeleteCascade-1991260277 None] snapshot: fcd4bac4-078d-4fe1-920f-af2575d3e898, volume: b81403ed-a197-4fb6-885e-f9bb3305c41f, {{(pid=86188) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 16 20:29:07 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-e1c9ac1f-80e5-469e-a0de-6939d872b2e3 tempest-VolumesDeleteCascade-1991260277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:29:07 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-e1c9ac1f-80e5-469e-a0de-6939d872b2e3 tempest-VolumesDeleteCascade-1991260277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:29:07 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-e1c9ac1f-80e5-469e-a0de-6939d872b2e3 tempest-VolumesDeleteCascade-1991260277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:29:07 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-e1c9ac1f-80e5-469e-a0de-6939d872b2e3 tempest-VolumesDeleteCascade-1991260277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:29:07 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-e1c9ac1f-80e5-469e-a0de-6939d872b2e3 tempest-VolumesDeleteCascade-1991260277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:29:07 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e5d057a-b14c-42ac-9647-a787695af49a]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:29:07 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e1c9ac1f-80e5-469e-a0de-6939d872b2e3 tempest-VolumesDeleteCascade-1991260277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e2447a15-7fec-4aca-a12e-c828fef49f15.fcd4bac4-078d-4fe1-920f-af2575d3e898 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:29:07 devstack sudo[99021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e2447a15-7fec-4aca-a12e-c828fef49f15.fcd4bac4-078d-4fe1-920f-af2575d3e898 Sep 16 20:29:07 devstack sudo[99021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:29:07 devstack sudo[99021]: pam_unix(sudo:session): session closed for user root Sep 16 20:29:07 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e1c9ac1f-80e5-469e-a0de-6939d872b2e3 tempest-VolumesDeleteCascade-1991260277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e2447a15-7fec-4aca-a12e-c828fef49f15.fcd4bac4-078d-4fe1-920f-af2575d3e898" returned: 0 in 0.431s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:29:07 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-e1c9ac1f-80e5-469e-a0de-6939d872b2e3 tempest-VolumesDeleteCascade-1991260277 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e2447a15-7fec-4aca-a12e-c828fef49f15(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86188) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 20:29:07 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cb0395a-3852-44a2-b7d6-101b6a2becf1]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:29:07 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e1c9ac1f-80e5-469e-a0de-6939d872b2e3 tempest-VolumesDeleteCascade-1991260277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e2447a15-7fec-4aca-a12e-c828fef49f15 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:29:07 devstack sudo[99028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e2447a15-7fec-4aca-a12e-c828fef49f15 Sep 16 20:29:07 devstack sudo[99028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:29:08 devstack sudo[99028]: pam_unix(sudo:session): session closed for user root Sep 16 20:29:08 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e1c9ac1f-80e5-469e-a0de-6939d872b2e3 tempest-VolumesDeleteCascade-1991260277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e2447a15-7fec-4aca-a12e-c828fef49f15" returned: 0 in 0.351s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:29:08 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-e1c9ac1f-80e5-469e-a0de-6939d872b2e3 tempest-VolumesDeleteCascade-1991260277 None] will copy from snapshot at /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e2447a15-7fec-4aca-a12e-c828fef49f15 {{(pid=86188) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 16 20:29:08 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-e1c9ac1f-80e5-469e-a0de-6939d872b2e3 tempest-VolumesDeleteCascade-1991260277 None] Creating direct copy from snapshot {{(pid=86188) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 16 20:29:08 devstack cinder-volume[86188]: DEBUG cinder.utils [None req-e1c9ac1f-80e5-469e-a0de-6939d872b2e3 tempest-VolumesDeleteCascade-1991260277 None] Path /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b81403ed-a197-4fb6-885e-f9bb3305c41f not found in is_blk_device check {{(pid=86188) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 16 20:29:08 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e1c9ac1f-80e5-469e-a0de-6939d872b2e3 tempest-VolumesDeleteCascade-1991260277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e2447a15-7fec-4aca-a12e-c828fef49f15 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b81403ed-a197-4fb6-885e-f9bb3305c41f {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:29:08 devstack sudo[99033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e2447a15-7fec-4aca-a12e-c828fef49f15 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b81403ed-a197-4fb6-885e-f9bb3305c41f Sep 16 20:29:08 devstack sudo[99033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:29:08 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-63c173a4-d873-4f55-9593-0d3bf701ce46 tempest-VolumesActionsTest-1215772093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:29:14 devstack sudo[99033]: pam_unix(sudo:session): session closed for user root Sep 16 20:29:14 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e1c9ac1f-80e5-469e-a0de-6939d872b2e3 tempest-VolumesDeleteCascade-1991260277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e2447a15-7fec-4aca-a12e-c828fef49f15 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b81403ed-a197-4fb6-885e-f9bb3305c41f" returned: 0 in 6.117s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:29:14 devstack cinder-volume[86188]: DEBUG cinder.image.image_utils [None req-e1c9ac1f-80e5-469e-a0de-6939d872b2e3 tempest-VolumesDeleteCascade-1991260277 None] Image conversion details: src /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e2447a15-7fec-4aca-a12e-c828fef49f15, size 1024.00 MB, duration 6.12 sec, destination /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b81403ed-a197-4fb6-885e-f9bb3305c41f {{(pid=86188) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 16 20:29:14 devstack cinder-volume[86188]: INFO cinder.image.image_utils [None req-e1c9ac1f-80e5-469e-a0de-6939d872b2e3 tempest-VolumesDeleteCascade-1991260277 None] Converted 1024.00 MB image at 167.36 MB/s Sep 16 20:29:14 devstack cinder-volume[86188]: WARNING cinder.volume.drivers.remotefs [None req-e1c9ac1f-80e5-469e-a0de-6939d872b2e3 tempest-VolumesDeleteCascade-1991260277 None] /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b81403ed-a197-4fb6-885e-f9bb3305c41f is being set with open permissions: ugo+rw Sep 16 20:29:14 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e1c9ac1f-80e5-469e-a0de-6939d872b2e3 tempest-VolumesDeleteCascade-1991260277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b81403ed-a197-4fb6-885e-f9bb3305c41f {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:29:14 devstack sudo[99050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b81403ed-a197-4fb6-885e-f9bb3305c41f Sep 16 20:29:14 devstack sudo[99050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:29:14 devstack sudo[99050]: pam_unix(sudo:session): session closed for user root Sep 16 20:29:14 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e1c9ac1f-80e5-469e-a0de-6939d872b2e3 tempest-VolumesDeleteCascade-1991260277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b81403ed-a197-4fb6-885e-f9bb3305c41f" returned: 0 in 0.242s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:29:14 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-e1c9ac1f-80e5-469e-a0de-6939d872b2e3 tempest-VolumesDeleteCascade-1991260277 None] Lock "cinder-quobyte-b81403ed-a197-4fb6-885e-f9bb3305c41f" released by "_copy_volume_from_snapshot" :: held 7.219s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:29:14 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-e1c9ac1f-80e5-469e-a0de-6939d872b2e3 tempest-VolumesDeleteCascade-1991260277 None] Lock "cinder-quobyte-fcd4bac4-078d-4fe1-920f-af2575d3e898-b81403ed-a197-4fb6-885e-f9bb3305c41f" released by "_create_volume_from_snapshot" :: held 7.294s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:29:14 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-e1c9ac1f-80e5-469e-a0de-6939d872b2e3 tempest-VolumesDeleteCascade-1991260277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.318s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:29:14 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-ed4e919c-e113-4d40-9bfe-a9e8b0e78927 tempest-TestInstancesWithCinderVolumes-1553461958 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 26.055s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:29:14 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-ed4e919c-e113-4d40-9bfe-a9e8b0e78927 tempest-TestInstancesWithCinderVolumes-1553461958 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:28:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-406560940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b0f4d04-de77-46dd-b428-982c9e7d7f82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fad99bedfd048c9906202815781714c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:28:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:28:48Z,use_quota=True,user_id='5723c65d9d3745d18c2091dd1f703694',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f9a37777-fed5-4690-bb91-c68f1ece5fd0),volume_type_id=f9a37777-fed5-4690-bb91-c68f1ece5fd0)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:29:14 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-ed4e919c-e113-4d40-9bfe-a9e8b0e78927 tempest-TestInstancesWithCinderVolumes-1553461958 None] Creating volume 3b0f4d04-de77-46dd-b428-982c9e7d7f82 {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:29:14 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-ed4e919c-e113-4d40-9bfe-a9e8b0e78927 tempest-TestInstancesWithCinderVolumes-1553461958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:29:14 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-ed4e919c-e113-4d40-9bfe-a9e8b0e78927 tempest-TestInstancesWithCinderVolumes-1553461958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:29:14 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-ed4e919c-e113-4d40-9bfe-a9e8b0e78927 tempest-TestInstancesWithCinderVolumes-1553461958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:29:14 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-ed4e919c-e113-4d40-9bfe-a9e8b0e78927 tempest-TestInstancesWithCinderVolumes-1553461958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:29:14 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-ed4e919c-e113-4d40-9bfe-a9e8b0e78927 tempest-TestInstancesWithCinderVolumes-1553461958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:29:14 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-ed4e919c-e113-4d40-9bfe-a9e8b0e78927 tempest-TestInstancesWithCinderVolumes-1553461958 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:29:14 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-ed4e919c-e113-4d40-9bfe-a9e8b0e78927 tempest-TestInstancesWithCinderVolumes-1553461958 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:29:14 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ed4e919c-e113-4d40-9bfe-a9e8b0e78927 tempest-TestInstancesWithCinderVolumes-1553461958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-3b0f4d04-de77-46dd-b428-982c9e7d7f82 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:29:14 devstack sudo[99053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-3b0f4d04-de77-46dd-b428-982c9e7d7f82 1073741824 Sep 16 20:29:14 devstack sudo[99053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:29:14 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e1c9ac1f-80e5-469e-a0de-6939d872b2e3 tempest-VolumesDeleteCascade-1991260277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e98734ab-2f3c-4501-8d5c-02ee5b8a9fc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b81403ed-a197-4fb6-885e-f9bb3305c41f', 'volume_size': 1, 'snapshot_id': 'fcd4bac4-078d-4fe1-920f-af2575d3e898'}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:29:14 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e1c9ac1f-80e5-469e-a0de-6939d872b2e3 tempest-VolumesDeleteCascade-1991260277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (558c8369-9b53-416b-8eca-545cd81fae85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:29:14 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-e1c9ac1f-80e5-469e-a0de-6939d872b2e3 tempest-VolumesDeleteCascade-1991260277 None] Volume volume-b81403ed-a197-4fb6-885e-f9bb3305c41f (b81403ed-a197-4fb6-885e-f9bb3305c41f): created successfully Sep 16 20:29:14 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e1c9ac1f-80e5-469e-a0de-6939d872b2e3 tempest-VolumesDeleteCascade-1991260277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (558c8369-9b53-416b-8eca-545cd81fae85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:29:14 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e1c9ac1f-80e5-469e-a0de-6939d872b2e3 tempest-VolumesDeleteCascade-1991260277 None] Flow 'volume_create_manager' (b3ed0421-324b-4d89-bf6d-6c11df1803af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:29:14 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-e1c9ac1f-80e5-469e-a0de-6939d872b2e3 tempest-VolumesDeleteCascade-1991260277 None] Created volume successfully. Sep 16 20:29:15 devstack sudo[99053]: pam_unix(sudo:session): session closed for user root Sep 16 20:29:15 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ed4e919c-e113-4d40-9bfe-a9e8b0e78927 tempest-TestInstancesWithCinderVolumes-1553461958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-3b0f4d04-de77-46dd-b428-982c9e7d7f82 1073741824" returned: 0 in 0.406s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:29:15 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ed4e919c-e113-4d40-9bfe-a9e8b0e78927 tempest-TestInstancesWithCinderVolumes-1553461958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-3b0f4d04-de77-46dd-b428-982c9e7d7f82 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:29:15 devstack sudo[99059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-3b0f4d04-de77-46dd-b428-982c9e7d7f82 Sep 16 20:29:15 devstack sudo[99059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:29:15 devstack sudo[99059]: pam_unix(sudo:session): session closed for user root Sep 16 20:29:15 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ed4e919c-e113-4d40-9bfe-a9e8b0e78927 tempest-TestInstancesWithCinderVolumes-1553461958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-3b0f4d04-de77-46dd-b428-982c9e7d7f82" returned: 0 in 0.239s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:29:15 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-ed4e919c-e113-4d40-9bfe-a9e8b0e78927 tempest-TestInstancesWithCinderVolumes-1553461958 None] <== create_volume: return (683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:29:15 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-ed4e919c-e113-4d40-9bfe-a9e8b0e78927 tempest-TestInstancesWithCinderVolumes-1553461958 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.686s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:29:15 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-4439bcef-814e-423b-9af3-0e23e89d94d9 tempest-TestInstancesWithCinderVolumes-1553461958 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 26.372s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:29:15 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-4439bcef-814e-423b-9af3-0e23e89d94d9 tempest-TestInstancesWithCinderVolumes-1553461958 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:28:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1937240554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=808d0b31-b417-4b34-9976-d150b62aeb2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fad99bedfd048c9906202815781714c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:28:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:28:49Z,use_quota=True,user_id='5723c65d9d3745d18c2091dd1f703694',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9149a32e-53fe-4b14-a13e-bf8709ef93e9),volume_type_id=9149a32e-53fe-4b14-a13e-bf8709ef93e9)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:29:15 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-4439bcef-814e-423b-9af3-0e23e89d94d9 tempest-TestInstancesWithCinderVolumes-1553461958 None] Creating volume 808d0b31-b417-4b34-9976-d150b62aeb2a {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:29:15 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-4439bcef-814e-423b-9af3-0e23e89d94d9 tempest-TestInstancesWithCinderVolumes-1553461958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:29:15 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-4439bcef-814e-423b-9af3-0e23e89d94d9 tempest-TestInstancesWithCinderVolumes-1553461958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:29:15 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-4439bcef-814e-423b-9af3-0e23e89d94d9 tempest-TestInstancesWithCinderVolumes-1553461958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:29:15 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-4439bcef-814e-423b-9af3-0e23e89d94d9 tempest-TestInstancesWithCinderVolumes-1553461958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:29:15 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-4439bcef-814e-423b-9af3-0e23e89d94d9 tempest-TestInstancesWithCinderVolumes-1553461958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:29:15 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-4439bcef-814e-423b-9af3-0e23e89d94d9 tempest-TestInstancesWithCinderVolumes-1553461958 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:29:15 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-4439bcef-814e-423b-9af3-0e23e89d94d9 tempest-TestInstancesWithCinderVolumes-1553461958 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:29:15 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-4439bcef-814e-423b-9af3-0e23e89d94d9 tempest-TestInstancesWithCinderVolumes-1553461958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-808d0b31-b417-4b34-9976-d150b62aeb2a 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:29:15 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ed4e919c-e113-4d40-9bfe-a9e8b0e78927 tempest-TestInstancesWithCinderVolumes-1553461958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8357641d-5031-4c9f-ae9e-90b1a59d44cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b0f4d04-de77-46dd-b428-982c9e7d7f82', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:29:15 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ed4e919c-e113-4d40-9bfe-a9e8b0e78927 tempest-TestInstancesWithCinderVolumes-1553461958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f65e351-16e4-4a7d-85e7-1a1952c3a505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:29:15 devstack sudo[99062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-808d0b31-b417-4b34-9976-d150b62aeb2a 1073741824 Sep 16 20:29:15 devstack sudo[99062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:29:15 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-ed4e919c-e113-4d40-9bfe-a9e8b0e78927 tempest-TestInstancesWithCinderVolumes-1553461958 None] Volume volume-3b0f4d04-de77-46dd-b428-982c9e7d7f82 (3b0f4d04-de77-46dd-b428-982c9e7d7f82): created successfully Sep 16 20:29:15 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ed4e919c-e113-4d40-9bfe-a9e8b0e78927 tempest-TestInstancesWithCinderVolumes-1553461958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f65e351-16e4-4a7d-85e7-1a1952c3a505) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:29:15 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ed4e919c-e113-4d40-9bfe-a9e8b0e78927 tempest-TestInstancesWithCinderVolumes-1553461958 None] Flow 'volume_create_manager' (427e0d8e-86c9-4988-8da2-eab46c728343) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:29:15 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-ed4e919c-e113-4d40-9bfe-a9e8b0e78927 tempest-TestInstancesWithCinderVolumes-1553461958 None] Created volume successfully. Sep 16 20:29:15 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-ddc33b6a-5b13-4314-a06c-fd7a6f99db2b tempest-VolumesDeleteCascade-1991260277 None] Acquiring lock "cinder-e2447a15-7fec-4aca-a12e-c828fef49f15-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:29:15 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-ddc33b6a-5b13-4314-a06c-fd7a6f99db2b tempest-VolumesDeleteCascade-1991260277 None] Lock "cinder-e2447a15-7fec-4aca-a12e-c828fef49f15-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:29:15 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ddc33b6a-5b13-4314-a06c-fd7a6f99db2b tempest-VolumesDeleteCascade-1991260277 None] Performing cascade delete. {{(pid=86188) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 16 20:29:15 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-ddc33b6a-5b13-4314-a06c-fd7a6f99db2b tempest-VolumesDeleteCascade-1991260277 None] Acquiring lock "cinder-fcd4bac4-078d-4fe1-920f-af2575d3e898-delete_snapshot" by "delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:29:15 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-ddc33b6a-5b13-4314-a06c-fd7a6f99db2b tempest-VolumesDeleteCascade-1991260277 None] Lock "cinder-fcd4bac4-078d-4fe1-920f-af2575d3e898-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:29:15 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-ddc33b6a-5b13-4314-a06c-fd7a6f99db2b tempest-VolumesDeleteCascade-1991260277 None] Acquiring lock "cinder-quobyte-e2447a15-7fec-4aca-a12e-c828fef49f15" by "delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:29:15 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-ddc33b6a-5b13-4314-a06c-fd7a6f99db2b tempest-VolumesDeleteCascade-1991260277 None] Lock "cinder-quobyte-e2447a15-7fec-4aca-a12e-c828fef49f15" acquired by "delete_snapshot" :: waited 0.012s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:29:15 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-ddc33b6a-5b13-4314-a06c-fd7a6f99db2b tempest-VolumesDeleteCascade-1991260277 None] Acquiring lock "cinder-quobyte-fcd4bac4-078d-4fe1-920f-af2575d3e898" by "_delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:29:15 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-ddc33b6a-5b13-4314-a06c-fd7a6f99db2b tempest-VolumesDeleteCascade-1991260277 None] Lock "cinder-quobyte-fcd4bac4-078d-4fe1-920f-af2575d3e898" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:29:15 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-ddc33b6a-5b13-4314-a06c-fd7a6f99db2b tempest-VolumesDeleteCascade-1991260277 None] Deleting offline snapshot fcd4bac4-078d-4fe1-920f-af2575d3e898 of volume e2447a15-7fec-4aca-a12e-c828fef49f15 {{(pid=86188) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 20:29:15 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-ddc33b6a-5b13-4314-a06c-fd7a6f99db2b tempest-VolumesDeleteCascade-1991260277 None] snapshot_file for this snap is: volume-e2447a15-7fec-4aca-a12e-c828fef49f15.fcd4bac4-078d-4fe1-920f-af2575d3e898 {{(pid=86188) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 20:29:15 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[66e6b8e8-8062-4598-bd6c-7c938c178d7a]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:29:15 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ddc33b6a-5b13-4314-a06c-fd7a6f99db2b tempest-VolumesDeleteCascade-1991260277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e2447a15-7fec-4aca-a12e-c828fef49f15.fcd4bac4-078d-4fe1-920f-af2575d3e898 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:29:15 devstack sudo[99066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e2447a15-7fec-4aca-a12e-c828fef49f15.fcd4bac4-078d-4fe1-920f-af2575d3e898 Sep 16 20:29:15 devstack sudo[99066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:29:15 devstack sudo[99062]: pam_unix(sudo:session): session closed for user root Sep 16 20:29:15 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-4439bcef-814e-423b-9af3-0e23e89d94d9 tempest-TestInstancesWithCinderVolumes-1553461958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-808d0b31-b417-4b34-9976-d150b62aeb2a 1073741824" returned: 0 in 0.440s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:29:15 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-4439bcef-814e-423b-9af3-0e23e89d94d9 tempest-TestInstancesWithCinderVolumes-1553461958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-808d0b31-b417-4b34-9976-d150b62aeb2a {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:29:15 devstack sudo[99070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-808d0b31-b417-4b34-9976-d150b62aeb2a Sep 16 20:29:15 devstack sudo[99070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:29:15 devstack sudo[99066]: pam_unix(sudo:session): session closed for user root Sep 16 20:29:15 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ddc33b6a-5b13-4314-a06c-fd7a6f99db2b tempest-VolumesDeleteCascade-1991260277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e2447a15-7fec-4aca-a12e-c828fef49f15.fcd4bac4-078d-4fe1-920f-af2575d3e898" returned: 0 in 0.365s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:29:15 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-ddc33b6a-5b13-4314-a06c-fd7a6f99db2b tempest-VolumesDeleteCascade-1991260277 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e2447a15-7fec-4aca-a12e-c828fef49f15(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86188) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 20:29:15 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[619d9e81-8cfb-4452-94d8-29a48b304317]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:29:15 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ddc33b6a-5b13-4314-a06c-fd7a6f99db2b tempest-VolumesDeleteCascade-1991260277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e2447a15-7fec-4aca-a12e-c828fef49f15 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:29:16 devstack sudo[99070]: pam_unix(sudo:session): session closed for user root Sep 16 20:29:16 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-4439bcef-814e-423b-9af3-0e23e89d94d9 tempest-TestInstancesWithCinderVolumes-1553461958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-808d0b31-b417-4b34-9976-d150b62aeb2a" returned: 0 in 0.251s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:29:16 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-4439bcef-814e-423b-9af3-0e23e89d94d9 tempest-TestInstancesWithCinderVolumes-1553461958 None] <== create_volume: return (735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:29:16 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-4439bcef-814e-423b-9af3-0e23e89d94d9 tempest-TestInstancesWithCinderVolumes-1553461958 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.739s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:29:16 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-afb97dd8-1607-4962-826d-aabcc2cef19f tempest-TestInstancesWithCinderVolumes-1553461958 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 21.676s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:29:16 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-afb97dd8-1607-4962-826d-aabcc2cef19f tempest-TestInstancesWithCinderVolumes-1553461958 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:28:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1174952075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed767f87-8501-4441-b005-ce0270bb7fe7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fad99bedfd048c9906202815781714c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:28:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:28:49Z,use_quota=True,user_id='5723c65d9d3745d18c2091dd1f703694',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d42ea7cb-135f-402b-a7a7-d900739f9177),volume_type_id=d42ea7cb-135f-402b-a7a7-d900739f9177)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:29:16 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-afb97dd8-1607-4962-826d-aabcc2cef19f tempest-TestInstancesWithCinderVolumes-1553461958 None] Creating volume ed767f87-8501-4441-b005-ce0270bb7fe7 {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:29:16 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-afb97dd8-1607-4962-826d-aabcc2cef19f tempest-TestInstancesWithCinderVolumes-1553461958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:29:16 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-afb97dd8-1607-4962-826d-aabcc2cef19f tempest-TestInstancesWithCinderVolumes-1553461958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:29:16 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-afb97dd8-1607-4962-826d-aabcc2cef19f tempest-TestInstancesWithCinderVolumes-1553461958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:29:16 devstack sudo[99075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e2447a15-7fec-4aca-a12e-c828fef49f15 Sep 16 20:29:16 devstack sudo[99075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:29:16 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-afb97dd8-1607-4962-826d-aabcc2cef19f tempest-TestInstancesWithCinderVolumes-1553461958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:29:16 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-afb97dd8-1607-4962-826d-aabcc2cef19f tempest-TestInstancesWithCinderVolumes-1553461958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:29:16 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-afb97dd8-1607-4962-826d-aabcc2cef19f tempest-TestInstancesWithCinderVolumes-1553461958 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:29:16 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-afb97dd8-1607-4962-826d-aabcc2cef19f tempest-TestInstancesWithCinderVolumes-1553461958 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:29:16 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-afb97dd8-1607-4962-826d-aabcc2cef19f tempest-TestInstancesWithCinderVolumes-1553461958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ed767f87-8501-4441-b005-ce0270bb7fe7 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:29:16 devstack sudo[99078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ed767f87-8501-4441-b005-ce0270bb7fe7 1073741824 Sep 16 20:29:16 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-4439bcef-814e-423b-9af3-0e23e89d94d9 tempest-TestInstancesWithCinderVolumes-1553461958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb01be7f-d68f-4ae0-be08-59ed268358e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-808d0b31-b417-4b34-9976-d150b62aeb2a', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:29:16 devstack sudo[99078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:29:16 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-4439bcef-814e-423b-9af3-0e23e89d94d9 tempest-TestInstancesWithCinderVolumes-1553461958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33a5427b-3726-493a-9c23-340b6f157c86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:29:16 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-4439bcef-814e-423b-9af3-0e23e89d94d9 tempest-TestInstancesWithCinderVolumes-1553461958 None] Volume volume-808d0b31-b417-4b34-9976-d150b62aeb2a (808d0b31-b417-4b34-9976-d150b62aeb2a): created successfully Sep 16 20:29:16 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-4439bcef-814e-423b-9af3-0e23e89d94d9 tempest-TestInstancesWithCinderVolumes-1553461958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33a5427b-3726-493a-9c23-340b6f157c86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:29:16 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-4439bcef-814e-423b-9af3-0e23e89d94d9 tempest-TestInstancesWithCinderVolumes-1553461958 None] Flow 'volume_create_manager' (7156dba7-728c-42f0-9ff7-7cc624e88e11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:29:16 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-4439bcef-814e-423b-9af3-0e23e89d94d9 tempest-TestInstancesWithCinderVolumes-1553461958 None] Created volume successfully. Sep 16 20:29:16 devstack sudo[99078]: pam_unix(sudo:session): session closed for user root Sep 16 20:29:16 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-afb97dd8-1607-4962-826d-aabcc2cef19f tempest-TestInstancesWithCinderVolumes-1553461958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ed767f87-8501-4441-b005-ce0270bb7fe7 1073741824" returned: 0 in 0.402s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:29:16 devstack sudo[99075]: pam_unix(sudo:session): session closed for user root Sep 16 20:29:16 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-afb97dd8-1607-4962-826d-aabcc2cef19f tempest-TestInstancesWithCinderVolumes-1553461958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ed767f87-8501-4441-b005-ce0270bb7fe7 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:29:16 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ddc33b6a-5b13-4314-a06c-fd7a6f99db2b tempest-VolumesDeleteCascade-1991260277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e2447a15-7fec-4aca-a12e-c828fef49f15" returned: 0 in 0.570s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:29:16 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ddc33b6a-5b13-4314-a06c-fd7a6f99db2b tempest-VolumesDeleteCascade-1991260277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e2447a15-7fec-4aca-a12e-c828fef49f15.fcd4bac4-078d-4fe1-920f-af2575d3e898 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:29:16 devstack sudo[99086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ed767f87-8501-4441-b005-ce0270bb7fe7 Sep 16 20:29:16 devstack sudo[99086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:29:16 devstack sudo[99087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e2447a15-7fec-4aca-a12e-c828fef49f15.fcd4bac4-078d-4fe1-920f-af2575d3e898 Sep 16 20:29:16 devstack sudo[99087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:29:16 devstack sudo[99086]: pam_unix(sudo:session): session closed for user root Sep 16 20:29:16 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-afb97dd8-1607-4962-826d-aabcc2cef19f tempest-TestInstancesWithCinderVolumes-1553461958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ed767f87-8501-4441-b005-ce0270bb7fe7" returned: 0 in 0.255s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:29:16 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-afb97dd8-1607-4962-826d-aabcc2cef19f tempest-TestInstancesWithCinderVolumes-1553461958 None] <== create_volume: return (702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:29:16 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-afb97dd8-1607-4962-826d-aabcc2cef19f tempest-TestInstancesWithCinderVolumes-1553461958 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.705s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:29:16 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-63c173a4-d873-4f55-9593-0d3bf701ce46 tempest-VolumesActionsTest-1215772093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 8.486s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:29:16 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[00e30fcf-eb6a-473e-90d9-e4507df14c88]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:29:16 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-63c173a4-d873-4f55-9593-0d3bf701ce46 tempest-VolumesActionsTest-1215772093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-14e4b8a9-9dca-4bf6-a883-7eec30b66d00 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:29:16 devstack cinder-volume[86188]: DEBUG cinder.volume.volume_utils [None req-afb97dd8-1607-4962-826d-aabcc2cef19f tempest-TestInstancesWithCinderVolumes-1553461958 None] Attempting download of c5394efc-1bb6-4e97-a909-3206dae9b39a ((None, [{'url': 'file:///opt/stack/data/glance/images/c5394efc-1bb6-4e97-a909-3206dae9b39a', 'metadata': {}}])) to volume ed767f87-8501-4441-b005-ce0270bb7fe7. {{(pid=86188) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 16 20:29:16 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd66fb49-8493-4531-95ea-22fac11394a0]: (4, 'raw') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:29:16 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-afb97dd8-1607-4962-826d-aabcc2cef19f tempest-TestInstancesWithCinderVolumes-1553461958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c5394efc-1bb6-4e97-a909-3206dae9b39a_5paw4lwd {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:29:16 devstack sudo[99087]: pam_unix(sudo:session): session closed for user root Sep 16 20:29:16 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ddc33b6a-5b13-4314-a06c-fd7a6f99db2b tempest-VolumesDeleteCascade-1991260277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e2447a15-7fec-4aca-a12e-c828fef49f15.fcd4bac4-078d-4fe1-920f-af2575d3e898" returned: 0 in 0.353s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:29:16 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ddc33b6a-5b13-4314-a06c-fd7a6f99db2b tempest-VolumesDeleteCascade-1991260277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e2447a15-7fec-4aca-a12e-c828fef49f15.fcd4bac4-078d-4fe1-920f-af2575d3e898 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:29:16 devstack sudo[99096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e2447a15-7fec-4aca-a12e-c828fef49f15.fcd4bac4-078d-4fe1-920f-af2575d3e898 Sep 16 20:29:16 devstack sudo[99096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:29:16 devstack sudo[99094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-14e4b8a9-9dca-4bf6-a883-7eec30b66d00 Sep 16 20:29:16 devstack sudo[99094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:29:16 devstack sudo[99095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c5394efc-1bb6-4e97-a909-3206dae9b39a_5paw4lwd Sep 16 20:29:16 devstack sudo[99095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:29:17 devstack sudo[99096]: pam_unix(sudo:session): session closed for user root Sep 16 20:29:17 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ddc33b6a-5b13-4314-a06c-fd7a6f99db2b tempest-VolumesDeleteCascade-1991260277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e2447a15-7fec-4aca-a12e-c828fef49f15.fcd4bac4-078d-4fe1-920f-af2575d3e898" returned: 0 in 0.262s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:29:17 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-ddc33b6a-5b13-4314-a06c-fd7a6f99db2b tempest-VolumesDeleteCascade-1991260277 None] Lock "cinder-quobyte-fcd4bac4-078d-4fe1-920f-af2575d3e898" released by "_delete_snapshot" :: held 1.657s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:29:17 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-ddc33b6a-5b13-4314-a06c-fd7a6f99db2b tempest-VolumesDeleteCascade-1991260277 None] Lock "cinder-quobyte-e2447a15-7fec-4aca-a12e-c828fef49f15" released by "delete_snapshot" :: held 1.683s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:29:17 devstack sudo[99094]: pam_unix(sudo:session): session closed for user root Sep 16 20:29:17 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-63c173a4-d873-4f55-9593-0d3bf701ce46 tempest-VolumesActionsTest-1215772093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-14e4b8a9-9dca-4bf6-a883-7eec30b66d00" returned: 0 in 0.409s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:29:17 devstack sudo[99095]: pam_unix(sudo:session): session closed for user root Sep 16 20:29:17 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-afb97dd8-1607-4962-826d-aabcc2cef19f tempest-TestInstancesWithCinderVolumes-1553461958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c5394efc-1bb6-4e97-a909-3206dae9b39a_5paw4lwd" returned: 0 in 0.357s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:29:17 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-afb97dd8-1607-4962-826d-aabcc2cef19f tempest-TestInstancesWithCinderVolumes-1553461958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c5394efc-1bb6-4e97-a909-3206dae9b39a_5paw4lwd {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:29:17 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[371c9ee2-b805-4d6f-8625-174d2717723d]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:29:17 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-63c173a4-d873-4f55-9593-0d3bf701ce46 tempest-VolumesActionsTest-1215772093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-14e4b8a9-9dca-4bf6-a883-7eec30b66d00 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:29:17 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-ddc33b6a-5b13-4314-a06c-fd7a6f99db2b tempest-VolumesDeleteCascade-1991260277 None] Created reservations ['0ae529c8-d2c3-40af-81d8-071524fc2581', 'e8fab7de-6cf1-4a5f-9e18-812135966e10', '71b7c274-2bb4-4c63-b036-c5d1b9291b9b', '3af28e9e-4837-4ac4-9c41-02678868d812'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:29:17 devstack sudo[99106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c5394efc-1bb6-4e97-a909-3206dae9b39a_5paw4lwd Sep 16 20:29:17 devstack sudo[99106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:29:17 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-ddc33b6a-5b13-4314-a06c-fd7a6f99db2b tempest-VolumesDeleteCascade-1991260277 None] Delete snapshot completed successfully. Sep 16 20:29:17 devstack sudo[99107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-14e4b8a9-9dca-4bf6-a883-7eec30b66d00 Sep 16 20:29:17 devstack sudo[99107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:29:17 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-ddc33b6a-5b13-4314-a06c-fd7a6f99db2b tempest-VolumesDeleteCascade-1991260277 None] Lock "cinder-fcd4bac4-078d-4fe1-920f-af2575d3e898-delete_snapshot" released by "delete_snapshot" :: held 1.871s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:29:17 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ddc33b6a-5b13-4314-a06c-fd7a6f99db2b tempest-VolumesDeleteCascade-1991260277 None] Snapshots deleted, issuing volume delete {{(pid=86188) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 16 20:29:17 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-ddc33b6a-5b13-4314-a06c-fd7a6f99db2b tempest-VolumesDeleteCascade-1991260277 None] Acquiring lock "cinder-quobyte-e2447a15-7fec-4aca-a12e-c828fef49f15" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:29:17 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-ddc33b6a-5b13-4314-a06c-fd7a6f99db2b tempest-VolumesDeleteCascade-1991260277 None] Lock "cinder-quobyte-e2447a15-7fec-4aca-a12e-c828fef49f15" acquired by "delete_volume" :: waited 0.017s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:29:17 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dad5242-2fdc-495a-bd86-682458041541]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:29:17 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ddc33b6a-5b13-4314-a06c-fd7a6f99db2b tempest-VolumesDeleteCascade-1991260277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e2447a15-7fec-4aca-a12e-c828fef49f15 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:29:17 devstack sudo[99110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e2447a15-7fec-4aca-a12e-c828fef49f15 Sep 16 20:29:17 devstack sudo[99110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:29:17 devstack sudo[99106]: pam_unix(sudo:session): session closed for user root Sep 16 20:29:17 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-afb97dd8-1607-4962-826d-aabcc2cef19f tempest-TestInstancesWithCinderVolumes-1553461958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c5394efc-1bb6-4e97-a909-3206dae9b39a_5paw4lwd" returned: 1 in 0.351s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:29:17 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-afb97dd8-1607-4962-826d-aabcc2cef19f tempest-TestInstancesWithCinderVolumes-1553461958 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c5394efc-1bb6-4e97-a909-3206dae9b39a_5paw4lwd' failed. Not Retrying. {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 16 20:29:17 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[895645b7-32d8-4cd0-bf19-a48eb0447f70]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:29:17 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-afb97dd8-1607-4962-826d-aabcc2cef19f tempest-TestInstancesWithCinderVolumes-1553461958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c5394efc-1bb6-4e97-a909-3206dae9b39a_72m49qxgdevstack@QuobyteHD {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:29:17 devstack sudo[99107]: pam_unix(sudo:session): session closed for user root Sep 16 20:29:17 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-63c173a4-d873-4f55-9593-0d3bf701ce46 tempest-VolumesActionsTest-1215772093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-14e4b8a9-9dca-4bf6-a883-7eec30b66d00" returned: 0 in 0.401s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:29:17 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-63c173a4-d873-4f55-9593-0d3bf701ce46 tempest-VolumesActionsTest-1215772093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-14e4b8a9-9dca-4bf6-a883-7eec30b66d00 /opt/stack/data/cinder/conversion/14e4b8a9-9dca-4bf6-a883-7eec30b66d00.temp_image.faa3201f-43ce-4942-9f11-9e1e47fa414f_l8nvoe3.img {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:29:17 devstack sudo[99118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-14e4b8a9-9dca-4bf6-a883-7eec30b66d00 /opt/stack/data/cinder/conversion/14e4b8a9-9dca-4bf6-a883-7eec30b66d00.temp_image.faa3201f-43ce-4942-9f11-9e1e47fa414f_l8nvoe3.img Sep 16 20:29:17 devstack sudo[99118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:29:17 devstack sudo[99117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c5394efc-1bb6-4e97-a909-3206dae9b39a_72m49qxgdevstack@QuobyteHD Sep 16 20:29:17 devstack sudo[99117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:29:17 devstack sudo[99110]: pam_unix(sudo:session): session closed for user root Sep 16 20:29:17 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ddc33b6a-5b13-4314-a06c-fd7a6f99db2b tempest-VolumesDeleteCascade-1991260277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e2447a15-7fec-4aca-a12e-c828fef49f15" returned: 0 in 0.382s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:29:17 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ddc33b6a-5b13-4314-a06c-fd7a6f99db2b tempest-VolumesDeleteCascade-1991260277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e2447a15-7fec-4aca-a12e-c828fef49f15 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:29:17 devstack sudo[99124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e2447a15-7fec-4aca-a12e-c828fef49f15 Sep 16 20:29:17 devstack sudo[99124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:29:17 devstack sudo[99117]: pam_unix(sudo:session): session closed for user root Sep 16 20:29:17 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-afb97dd8-1607-4962-826d-aabcc2cef19f tempest-TestInstancesWithCinderVolumes-1553461958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c5394efc-1bb6-4e97-a909-3206dae9b39a_72m49qxgdevstack@QuobyteHD" returned: 0 in 0.370s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:29:17 devstack cinder-volume[86188]: DEBUG cinder.image.image_utils [None req-afb97dd8-1607-4962-826d-aabcc2cef19f tempest-TestInstancesWithCinderVolumes-1553461958 None] c5394efc-1bb6-4e97-a909-3206dae9b39a was qcow2, converting to qcow2 {{(pid=86188) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 16 20:29:17 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-afb97dd8-1607-4962-826d-aabcc2cef19f tempest-TestInstancesWithCinderVolumes-1553461958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c5394efc-1bb6-4e97-a909-3206dae9b39a_72m49qxgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ed767f87-8501-4441-b005-ce0270bb7fe7 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:29:18 devstack sudo[99137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c5394efc-1bb6-4e97-a909-3206dae9b39a_72m49qxgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ed767f87-8501-4441-b005-ce0270bb7fe7 Sep 16 20:29:18 devstack sudo[99137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:29:18 devstack sudo[99124]: pam_unix(sudo:session): session closed for user root Sep 16 20:29:18 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ddc33b6a-5b13-4314-a06c-fd7a6f99db2b tempest-VolumesDeleteCascade-1991260277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e2447a15-7fec-4aca-a12e-c828fef49f15" returned: 0 in 0.348s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:29:18 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-ddc33b6a-5b13-4314-a06c-fd7a6f99db2b tempest-VolumesDeleteCascade-1991260277 None] Lock "cinder-quobyte-e2447a15-7fec-4aca-a12e-c828fef49f15" released by "delete_volume" :: held 0.834s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:29:18 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-ddc33b6a-5b13-4314-a06c-fd7a6f99db2b tempest-VolumesDeleteCascade-1991260277 None] Created reservations ['4ab848be-6b18-41af-8b5d-a5a3426fe025', 'c81ea1a1-e93a-42fa-9316-1a963b15d6b7', '0a6f05c5-ed2e-4386-a329-a3e680237252', '7d08d68a-22a0-48fc-9ae7-6acf07bd3682'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:29:18 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-ddc33b6a-5b13-4314-a06c-fd7a6f99db2b tempest-VolumesDeleteCascade-1991260277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:29:18 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-ddc33b6a-5b13-4314-a06c-fd7a6f99db2b tempest-VolumesDeleteCascade-1991260277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:29:18 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-ddc33b6a-5b13-4314-a06c-fd7a6f99db2b tempest-VolumesDeleteCascade-1991260277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:29:18 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-ddc33b6a-5b13-4314-a06c-fd7a6f99db2b tempest-VolumesDeleteCascade-1991260277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:29:18 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-ddc33b6a-5b13-4314-a06c-fd7a6f99db2b tempest-VolumesDeleteCascade-1991260277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:29:18 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ddc33b6a-5b13-4314-a06c-fd7a6f99db2b tempest-VolumesDeleteCascade-1991260277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:29:18 devstack sudo[99146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:29:18 devstack sudo[99146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:29:18 devstack sudo[99146]: pam_unix(sudo:session): session closed for user root Sep 16 20:29:18 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ddc33b6a-5b13-4314-a06c-fd7a6f99db2b tempest-VolumesDeleteCascade-1991260277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.348s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:29:18 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-ddc33b6a-5b13-4314-a06c-fd7a6f99db2b tempest-VolumesDeleteCascade-1991260277 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:29:18 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-ddc33b6a-5b13-4314-a06c-fd7a6f99db2b tempest-VolumesDeleteCascade-1991260277 None] Deleted volume successfully. Sep 16 20:29:18 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-ddc33b6a-5b13-4314-a06c-fd7a6f99db2b tempest-VolumesDeleteCascade-1991260277 None] Lock "cinder-e2447a15-7fec-4aca-a12e-c828fef49f15-delete_volume" released by "delete_volume" :: held 3.446s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:29:18 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-40520515-6240-4c7a-90c8-f142481e0ae2 tempest-VolumesDeleteCascade-1991260277 None] Acquiring lock "cinder-b81403ed-a197-4fb6-885e-f9bb3305c41f-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:29:19 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-40520515-6240-4c7a-90c8-f142481e0ae2 tempest-VolumesDeleteCascade-1991260277 None] Lock "cinder-b81403ed-a197-4fb6-885e-f9bb3305c41f-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:29:19 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-40520515-6240-4c7a-90c8-f142481e0ae2 tempest-VolumesDeleteCascade-1991260277 None] Acquiring lock "cinder-quobyte-b81403ed-a197-4fb6-885e-f9bb3305c41f" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:29:19 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-40520515-6240-4c7a-90c8-f142481e0ae2 tempest-VolumesDeleteCascade-1991260277 None] Lock "cinder-quobyte-b81403ed-a197-4fb6-885e-f9bb3305c41f" acquired by "delete_volume" :: waited 0.021s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:29:19 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0ba56da-004c-4660-8810-99db31be7be8]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:29:19 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-40520515-6240-4c7a-90c8-f142481e0ae2 tempest-VolumesDeleteCascade-1991260277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b81403ed-a197-4fb6-885e-f9bb3305c41f {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:29:19 devstack sudo[99151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b81403ed-a197-4fb6-885e-f9bb3305c41f Sep 16 20:29:19 devstack sudo[99151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:29:19 devstack sudo[99151]: pam_unix(sudo:session): session closed for user root Sep 16 20:29:19 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-40520515-6240-4c7a-90c8-f142481e0ae2 tempest-VolumesDeleteCascade-1991260277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b81403ed-a197-4fb6-885e-f9bb3305c41f" returned: 0 in 0.587s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:29:19 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-40520515-6240-4c7a-90c8-f142481e0ae2 tempest-VolumesDeleteCascade-1991260277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b81403ed-a197-4fb6-885e-f9bb3305c41f {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:29:19 devstack sudo[99157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b81403ed-a197-4fb6-885e-f9bb3305c41f Sep 16 20:29:19 devstack sudo[99157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:29:20 devstack sudo[99157]: pam_unix(sudo:session): session closed for user root Sep 16 20:29:20 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-40520515-6240-4c7a-90c8-f142481e0ae2 tempest-VolumesDeleteCascade-1991260277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b81403ed-a197-4fb6-885e-f9bb3305c41f" returned: 0 in 0.329s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:29:20 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-40520515-6240-4c7a-90c8-f142481e0ae2 tempest-VolumesDeleteCascade-1991260277 None] Lock "cinder-quobyte-b81403ed-a197-4fb6-885e-f9bb3305c41f" released by "delete_volume" :: held 0.990s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:29:20 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-40520515-6240-4c7a-90c8-f142481e0ae2 tempest-VolumesDeleteCascade-1991260277 None] Created reservations ['9e5b9221-6d42-4610-a5fb-9e8ba2e5307f', '78d99bbf-d3b1-4591-8a1e-89d23f56122d', '1e39a02a-13af-49aa-9350-5e5450acd9c5', '7c1b86e7-5b94-40c5-b4f6-11374b34fd45'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:29:20 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-40520515-6240-4c7a-90c8-f142481e0ae2 tempest-VolumesDeleteCascade-1991260277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:29:20 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-40520515-6240-4c7a-90c8-f142481e0ae2 tempest-VolumesDeleteCascade-1991260277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:29:20 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-40520515-6240-4c7a-90c8-f142481e0ae2 tempest-VolumesDeleteCascade-1991260277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:29:20 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-40520515-6240-4c7a-90c8-f142481e0ae2 tempest-VolumesDeleteCascade-1991260277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:29:20 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-40520515-6240-4c7a-90c8-f142481e0ae2 tempest-VolumesDeleteCascade-1991260277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:29:20 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-40520515-6240-4c7a-90c8-f142481e0ae2 tempest-VolumesDeleteCascade-1991260277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:29:20 devstack sudo[99160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:29:20 devstack sudo[99160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:29:20 devstack sudo[99160]: pam_unix(sudo:session): session closed for user root Sep 16 20:29:20 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-40520515-6240-4c7a-90c8-f142481e0ae2 tempest-VolumesDeleteCascade-1991260277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.373s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:29:20 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-40520515-6240-4c7a-90c8-f142481e0ae2 tempest-VolumesDeleteCascade-1991260277 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:29:20 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-40520515-6240-4c7a-90c8-f142481e0ae2 tempest-VolumesDeleteCascade-1991260277 None] Deleted volume successfully. Sep 16 20:29:20 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-40520515-6240-4c7a-90c8-f142481e0ae2 tempest-VolumesDeleteCascade-1991260277 None] Lock "cinder-b81403ed-a197-4fb6-885e-f9bb3305c41f-delete_volume" released by "delete_volume" :: held 1.707s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:29:23 devstack sudo[99137]: pam_unix(sudo:session): session closed for user root Sep 16 20:29:23 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-afb97dd8-1607-4962-826d-aabcc2cef19f tempest-TestInstancesWithCinderVolumes-1553461958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c5394efc-1bb6-4e97-a909-3206dae9b39a_72m49qxgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ed767f87-8501-4441-b005-ce0270bb7fe7" returned: 0 in 5.405s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:29:23 devstack cinder-volume[86188]: DEBUG cinder.image.image_utils [None req-afb97dd8-1607-4962-826d-aabcc2cef19f tempest-TestInstancesWithCinderVolumes-1553461958 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c5394efc-1bb6-4e97-a909-3206dae9b39a_72m49qxgdevstack@QuobyteHD, size 112.00 MB, duration 5.41 sec, destination /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ed767f87-8501-4441-b005-ce0270bb7fe7 {{(pid=86188) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 16 20:29:23 devstack cinder-volume[86188]: INFO cinder.image.image_utils [None req-afb97dd8-1607-4962-826d-aabcc2cef19f tempest-TestInstancesWithCinderVolumes-1553461958 None] Converted 112.00 MB image at 20.71 MB/s Sep 16 20:29:23 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-afb97dd8-1607-4962-826d-aabcc2cef19f tempest-TestInstancesWithCinderVolumes-1553461958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ed767f87-8501-4441-b005-ce0270bb7fe7 1G {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:29:23 devstack sudo[99163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ed767f87-8501-4441-b005-ce0270bb7fe7 1G Sep 16 20:29:23 devstack sudo[99163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:29:23 devstack sudo[99163]: pam_unix(sudo:session): session closed for user root Sep 16 20:29:23 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-afb97dd8-1607-4962-826d-aabcc2cef19f tempest-TestInstancesWithCinderVolumes-1553461958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ed767f87-8501-4441-b005-ce0270bb7fe7 1G" returned: 0 in 0.602s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:29:23 devstack cinder-volume[86188]: DEBUG cinder.volume.volume_utils [None req-afb97dd8-1607-4962-826d-aabcc2cef19f tempest-TestInstancesWithCinderVolumes-1553461958 None] Downloaded image c5394efc-1bb6-4e97-a909-3206dae9b39a ((None, [{'url': 'file:///opt/stack/data/glance/images/c5394efc-1bb6-4e97-a909-3206dae9b39a', 'metadata': {}}])) to volume ed767f87-8501-4441-b005-ce0270bb7fe7 successfully. {{(pid=86188) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 16 20:29:23 devstack cinder-volume[86188]: DEBUG cinder.image.image_utils [None req-afb97dd8-1607-4962-826d-aabcc2cef19f tempest-TestInstancesWithCinderVolumes-1553461958 None] Temporary image c5394efc-1bb6-4e97-a909-3206dae9b39a for user 5723c65d9d3745d18c2091dd1f703694 is deleted. {{(pid=86188) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 16 20:29:23 devstack cinder-volume[86188]: DEBUG cinder.volume.volume_utils [None req-afb97dd8-1607-4962-826d-aabcc2cef19f tempest-TestInstancesWithCinderVolumes-1553461958 None] Marking volume ed767f87-8501-4441-b005-ce0270bb7fe7 as bootable. {{(pid=86188) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 16 20:29:24 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-afb97dd8-1607-4962-826d-aabcc2cef19f tempest-TestInstancesWithCinderVolumes-1553461958 None] Copying metadata from image c5394efc-1bb6-4e97-a909-3206dae9b39a to ed767f87-8501-4441-b005-ce0270bb7fe7. {{(pid=86188) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 16 20:29:24 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-afb97dd8-1607-4962-826d-aabcc2cef19f tempest-TestInstancesWithCinderVolumes-1553461958 None] Creating volume glance metadata for volume ed767f87-8501-4441-b005-ce0270bb7fe7 backed by image c5394efc-1bb6-4e97-a909-3206dae9b39a with: {'image_id': 'c5394efc-1bb6-4e97-a909-3206dae9b39a', 'image_name': 'tempest-scenario-img--1678878612', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86188) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 16 20:29:24 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-afb97dd8-1607-4962-826d-aabcc2cef19f tempest-TestInstancesWithCinderVolumes-1553461958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b972783-f5d4-4985-9eed-12ad4989f342) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed767f87-8501-4441-b005-ce0270bb7fe7', 'volume_size': 1, 'image_id': 'c5394efc-1bb6-4e97-a909-3206dae9b39a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c5394efc-1bb6-4e97-a909-3206dae9b39a', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1678878612', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2fad99bedfd048c9906202815781714c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c5394efc-1bb6-4e97-a909-3206dae9b39a', 'created_at': datetime.datetime(2026, 9, 16, 18, 28, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 18, 28, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c5394efc-1bb6-4e97-a909-3206dae9b39a/file', 'properties': {}}, 'image_service': }' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:29:24 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-afb97dd8-1607-4962-826d-aabcc2cef19f tempest-TestInstancesWithCinderVolumes-1553461958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fbdb5bd-f81e-4971-8400-43eb52da3310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:29:24 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-afb97dd8-1607-4962-826d-aabcc2cef19f tempest-TestInstancesWithCinderVolumes-1553461958 None] Volume volume-ed767f87-8501-4441-b005-ce0270bb7fe7 (ed767f87-8501-4441-b005-ce0270bb7fe7): created successfully Sep 16 20:29:24 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-afb97dd8-1607-4962-826d-aabcc2cef19f tempest-TestInstancesWithCinderVolumes-1553461958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fbdb5bd-f81e-4971-8400-43eb52da3310) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:29:24 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-afb97dd8-1607-4962-826d-aabcc2cef19f tempest-TestInstancesWithCinderVolumes-1553461958 None] Flow 'volume_create_manager' (cfc87a43-7869-4d62-aff8-73d4d227c324) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:29:24 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-afb97dd8-1607-4962-826d-aabcc2cef19f tempest-TestInstancesWithCinderVolumes-1553461958 None] Created volume successfully. Sep 16 20:29:25 devstack sudo[99118]: pam_unix(sudo:session): session closed for user root Sep 16 20:29:25 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-63c173a4-d873-4f55-9593-0d3bf701ce46 tempest-VolumesActionsTest-1215772093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-14e4b8a9-9dca-4bf6-a883-7eec30b66d00 /opt/stack/data/cinder/conversion/14e4b8a9-9dca-4bf6-a883-7eec30b66d00.temp_image.faa3201f-43ce-4942-9f11-9e1e47fa414f_l8nvoe3.img" returned: 0 in 7.485s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:29:25 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ccd32e0-c772-4c45-b2de-19d8a8894f6d]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:29:25 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-63c173a4-d873-4f55-9593-0d3bf701ce46 tempest-VolumesActionsTest-1215772093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-14e4b8a9-9dca-4bf6-a883-7eec30b66d00 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:29:25 devstack sudo[99169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-14e4b8a9-9dca-4bf6-a883-7eec30b66d00 Sep 16 20:29:25 devstack sudo[99169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:29:25 devstack sudo[99169]: pam_unix(sudo:session): session closed for user root Sep 16 20:29:25 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-63c173a4-d873-4f55-9593-0d3bf701ce46 tempest-VolumesActionsTest-1215772093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-14e4b8a9-9dca-4bf6-a883-7eec30b66d00" returned: 0 in 0.549s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:29:25 devstack cinder-volume[86188]: DEBUG cinder.image.image_utils [None req-63c173a4-d873-4f55-9593-0d3bf701ce46 tempest-VolumesActionsTest-1215772093 None] Image conversion details: src /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-14e4b8a9-9dca-4bf6-a883-7eec30b66d00, size 1024.00 MB, duration 7.49 sec, destination /opt/stack/data/cinder/conversion/14e4b8a9-9dca-4bf6-a883-7eec30b66d00.temp_image.faa3201f-43ce-4942-9f11-9e1e47fa414f_l8nvoe3.img {{(pid=86188) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 16 20:29:25 devstack cinder-volume[86188]: INFO cinder.image.image_utils [None req-63c173a4-d873-4f55-9593-0d3bf701ce46 tempest-VolumesActionsTest-1215772093 None] Converted 1024.00 MB image at 136.78 MB/s Sep 16 20:29:25 devstack cinder-volume[86188]: DEBUG cinder.image.image_utils [None req-63c173a4-d873-4f55-9593-0d3bf701ce46 tempest-VolumesActionsTest-1215772093 None] faa3201f-43ce-4942-9f11-9e1e47fa414f was raw, converting to qcow2 {{(pid=86188) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Sep 16 20:29:25 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[59166aa4-2485-4c55-8ca1-b3cb3e9bd727]: (4, 'raw') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:29:25 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-63c173a4-d873-4f55-9593-0d3bf701ce46 tempest-VolumesActionsTest-1215772093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/14e4b8a9-9dca-4bf6-a883-7eec30b66d00.temp_image.faa3201f-43ce-4942-9f11-9e1e47fa414f_l8nvoe3.img {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:29:25 devstack sudo[99175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/14e4b8a9-9dca-4bf6-a883-7eec30b66d00.temp_image.faa3201f-43ce-4942-9f11-9e1e47fa414f_l8nvoe3.img Sep 16 20:29:25 devstack sudo[99175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:29:26 devstack sudo[99175]: pam_unix(sudo:session): session closed for user root Sep 16 20:29:26 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-63c173a4-d873-4f55-9593-0d3bf701ce46 tempest-VolumesActionsTest-1215772093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/14e4b8a9-9dca-4bf6-a883-7eec30b66d00.temp_image.faa3201f-43ce-4942-9f11-9e1e47fa414f_l8nvoe3.img" returned: 0 in 0.360s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:29:26 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-63c173a4-d873-4f55-9593-0d3bf701ce46 tempest-VolumesActionsTest-1215772093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/14e4b8a9-9dca-4bf6-a883-7eec30b66d00.temp_image.faa3201f-43ce-4942-9f11-9e1e47fa414f_l8nvoe3.img {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:29:26 devstack sudo[99179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/14e4b8a9-9dca-4bf6-a883-7eec30b66d00.temp_image.faa3201f-43ce-4942-9f11-9e1e47fa414f_l8nvoe3.img Sep 16 20:29:26 devstack sudo[99179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:29:26 devstack sudo[99179]: pam_unix(sudo:session): session closed for user root Sep 16 20:29:26 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-63c173a4-d873-4f55-9593-0d3bf701ce46 tempest-VolumesActionsTest-1215772093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/14e4b8a9-9dca-4bf6-a883-7eec30b66d00.temp_image.faa3201f-43ce-4942-9f11-9e1e47fa414f_l8nvoe3.img" returned: 1 in 0.388s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:29:26 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-63c173a4-d873-4f55-9593-0d3bf701ce46 tempest-VolumesActionsTest-1215772093 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/14e4b8a9-9dca-4bf6-a883-7eec30b66d00.temp_image.faa3201f-43ce-4942-9f11-9e1e47fa414f_l8nvoe3.img' failed. Not Retrying. {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 16 20:29:26 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-63c173a4-d873-4f55-9593-0d3bf701ce46 tempest-VolumesActionsTest-1215772093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/14e4b8a9-9dca-4bf6-a883-7eec30b66d00.temp_image.faa3201f-43ce-4942-9f11-9e1e47fa414f_l8nvoe3.img /opt/stack/data/cinder/conversion/vol_upload_yicfc3_k {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:29:26 devstack sudo[99187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/14e4b8a9-9dca-4bf6-a883-7eec30b66d00.temp_image.faa3201f-43ce-4942-9f11-9e1e47fa414f_l8nvoe3.img /opt/stack/data/cinder/conversion/vol_upload_yicfc3_k Sep 16 20:29:26 devstack sudo[99187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:29:26 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-e14af1de-474c-4a54-9ac5-c2b1aa3521b6 tempest-VolumesListTestJSON-1015418202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:29:26 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e14af1de-474c-4a54-9ac5-c2b1aa3521b6 tempest-VolumesListTestJSON-1015418202 None] Flow 'volume_create_manager' (01d684d3-1334-4f3a-ac36-66480bc67b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:29:26 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e14af1de-474c-4a54-9ac5-c2b1aa3521b6 tempest-VolumesListTestJSON-1015418202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (155280c0-fbb8-4516-8c42-f8f59c3def8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:29:26 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e14af1de-474c-4a54-9ac5-c2b1aa3521b6 tempest-VolumesListTestJSON-1015418202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (155280c0-fbb8-4516-8c42-f8f59c3def8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:29:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1413822705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8a997cf-36b4-4340-bbb3-c5bb00a506e2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b9ab700985e24c7faf3f3bfce289a470',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:29:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:29:27Z,use_quota=True,user_id='6b56c1ddc86d42e79708b47f977f5ab4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:29:26 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e14af1de-474c-4a54-9ac5-c2b1aa3521b6 tempest-VolumesListTestJSON-1015418202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90d3ff7a-3614-452c-92b6-420638f16905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:29:26 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e14af1de-474c-4a54-9ac5-c2b1aa3521b6 tempest-VolumesListTestJSON-1015418202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90d3ff7a-3614-452c-92b6-420638f16905) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:29:26 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e14af1de-474c-4a54-9ac5-c2b1aa3521b6 tempest-VolumesListTestJSON-1015418202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52712083-8f1b-4d26-8882-dd68d43c4218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:29:26 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e14af1de-474c-4a54-9ac5-c2b1aa3521b6 tempest-VolumesListTestJSON-1015418202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52712083-8f1b-4d26-8882-dd68d43c4218) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8a997cf-36b4-4340-bbb3-c5bb00a506e2', 'volume_name': 'volume-d8a997cf-36b4-4340-bbb3-c5bb00a506e2', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:29:26 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e14af1de-474c-4a54-9ac5-c2b1aa3521b6 tempest-VolumesListTestJSON-1015418202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e89966b-e57b-455d-b920-ed57225e6207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:29:26 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e14af1de-474c-4a54-9ac5-c2b1aa3521b6 tempest-VolumesListTestJSON-1015418202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e89966b-e57b-455d-b920-ed57225e6207) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:29:26 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e14af1de-474c-4a54-9ac5-c2b1aa3521b6 tempest-VolumesListTestJSON-1015418202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c8ef963-50ca-4cf8-907a-4f905a333f08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:29:26 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-e14af1de-474c-4a54-9ac5-c2b1aa3521b6 tempest-VolumesListTestJSON-1015418202 None] Volume d8a997cf-36b4-4340-bbb3-c5bb00a506e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8a997cf-36b4-4340-bbb3-c5bb00a506e2', 'volume_size': 1} Sep 16 20:29:26 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-e14af1de-474c-4a54-9ac5-c2b1aa3521b6 tempest-VolumesListTestJSON-1015418202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:29:26 devstack sudo[99187]: pam_unix(sudo:session): session closed for user root Sep 16 20:29:26 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-63c173a4-d873-4f55-9593-0d3bf701ce46 tempest-VolumesActionsTest-1215772093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/14e4b8a9-9dca-4bf6-a883-7eec30b66d00.temp_image.faa3201f-43ce-4942-9f11-9e1e47fa414f_l8nvoe3.img /opt/stack/data/cinder/conversion/vol_upload_yicfc3_k" returned: 0 in 0.381s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:29:26 devstack cinder-volume[86188]: DEBUG cinder.image.image_utils [None req-63c173a4-d873-4f55-9593-0d3bf701ce46 tempest-VolumesActionsTest-1215772093 None] Image conversion details: src /opt/stack/data/cinder/conversion/14e4b8a9-9dca-4bf6-a883-7eec30b66d00.temp_image.faa3201f-43ce-4942-9f11-9e1e47fa414f_l8nvoe3.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_yicfc3_k {{(pid=86188) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 16 20:29:26 devstack cinder-volume[86188]: INFO cinder.image.image_utils [None req-63c173a4-d873-4f55-9593-0d3bf701ce46 tempest-VolumesActionsTest-1215772093 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 16 20:29:26 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[106dd883-e003-4707-82aa-b6a22b3615c8]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:29:26 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-63c173a4-d873-4f55-9593-0d3bf701ce46 tempest-VolumesActionsTest-1215772093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_yicfc3_k {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:29:26 devstack sudo[99193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_yicfc3_k Sep 16 20:29:26 devstack sudo[99193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:29:27 devstack sudo[99193]: pam_unix(sudo:session): session closed for user root Sep 16 20:29:27 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-63c173a4-d873-4f55-9593-0d3bf701ce46 tempest-VolumesActionsTest-1215772093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_yicfc3_k" returned: 0 in 0.327s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:29:28 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [req-703a49c7-f3b3-4064-b5fa-f2d483bab534 req-2271ceeb-98d6-4a25-9c72-47f24d91c717 tempest-TestInstancesWithCinderVolumes-1553461958 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:29:28 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-63c173a4-d873-4f55-9593-0d3bf701ce46 tempest-VolumesActionsTest-1215772093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 11.998s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:29:28 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-63c173a4-d873-4f55-9593-0d3bf701ce46 tempest-VolumesActionsTest-1215772093 None] Uploaded volume to glance image-id: faa3201f-43ce-4942-9f11-9e1e47fa414f. {{(pid=86188) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 16 20:29:28 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-e14af1de-474c-4a54-9ac5-c2b1aa3521b6 tempest-VolumesListTestJSON-1015418202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.962s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:29:28 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-e14af1de-474c-4a54-9ac5-c2b1aa3521b6 tempest-VolumesListTestJSON-1015418202 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:29:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1413822705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8a997cf-36b4-4340-bbb3-c5bb00a506e2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b9ab700985e24c7faf3f3bfce289a470',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:29:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:29:27Z,use_quota=True,user_id='6b56c1ddc86d42e79708b47f977f5ab4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:29:28 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-e14af1de-474c-4a54-9ac5-c2b1aa3521b6 tempest-VolumesListTestJSON-1015418202 None] Creating volume d8a997cf-36b4-4340-bbb3-c5bb00a506e2 {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:29:28 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-e14af1de-474c-4a54-9ac5-c2b1aa3521b6 tempest-VolumesListTestJSON-1015418202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:29:28 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-e14af1de-474c-4a54-9ac5-c2b1aa3521b6 tempest-VolumesListTestJSON-1015418202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:29:28 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-e14af1de-474c-4a54-9ac5-c2b1aa3521b6 tempest-VolumesListTestJSON-1015418202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:29:28 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-e14af1de-474c-4a54-9ac5-c2b1aa3521b6 tempest-VolumesListTestJSON-1015418202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:29:28 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-e14af1de-474c-4a54-9ac5-c2b1aa3521b6 tempest-VolumesListTestJSON-1015418202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:29:28 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-e14af1de-474c-4a54-9ac5-c2b1aa3521b6 tempest-VolumesListTestJSON-1015418202 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:29:28 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-e14af1de-474c-4a54-9ac5-c2b1aa3521b6 tempest-VolumesListTestJSON-1015418202 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:29:28 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e14af1de-474c-4a54-9ac5-c2b1aa3521b6 tempest-VolumesListTestJSON-1015418202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d8a997cf-36b4-4340-bbb3-c5bb00a506e2 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:29:28 devstack sudo[99206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d8a997cf-36b4-4340-bbb3-c5bb00a506e2 1073741824 Sep 16 20:29:28 devstack sudo[99206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:29:28 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-63c173a4-d873-4f55-9593-0d3bf701ce46 tempest-VolumesActionsTest-1215772093 None] Copy volume to image completed successfully. Sep 16 20:29:29 devstack sudo[99206]: pam_unix(sudo:session): session closed for user root Sep 16 20:29:29 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e14af1de-474c-4a54-9ac5-c2b1aa3521b6 tempest-VolumesListTestJSON-1015418202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d8a997cf-36b4-4340-bbb3-c5bb00a506e2 1073741824" returned: 0 in 0.530s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:29:29 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e14af1de-474c-4a54-9ac5-c2b1aa3521b6 tempest-VolumesListTestJSON-1015418202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d8a997cf-36b4-4340-bbb3-c5bb00a506e2 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:29:29 devstack sudo[99214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d8a997cf-36b4-4340-bbb3-c5bb00a506e2 Sep 16 20:29:29 devstack sudo[99214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:29:29 devstack sudo[99214]: pam_unix(sudo:session): session closed for user root Sep 16 20:29:29 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e14af1de-474c-4a54-9ac5-c2b1aa3521b6 tempest-VolumesListTestJSON-1015418202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d8a997cf-36b4-4340-bbb3-c5bb00a506e2" returned: 0 in 0.274s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:29:29 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-e14af1de-474c-4a54-9ac5-c2b1aa3521b6 tempest-VolumesListTestJSON-1015418202 None] <== create_volume: return (850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:29:29 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-e14af1de-474c-4a54-9ac5-c2b1aa3521b6 tempest-VolumesListTestJSON-1015418202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.853s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:29:29 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [req-703a49c7-f3b3-4064-b5fa-f2d483bab534 req-2271ceeb-98d6-4a25-9c72-47f24d91c717 tempest-TestInstancesWithCinderVolumes-1553461958 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.583s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:29:29 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [req-703a49c7-f3b3-4064-b5fa-f2d483bab534 req-2271ceeb-98d6-4a25-9c72-47f24d91c717 tempest-TestInstancesWithCinderVolumes-1553461958 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:29:29 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e14af1de-474c-4a54-9ac5-c2b1aa3521b6 tempest-VolumesListTestJSON-1015418202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c8ef963-50ca-4cf8-907a-4f905a333f08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8a997cf-36b4-4340-bbb3-c5bb00a506e2', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:29:29 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e14af1de-474c-4a54-9ac5-c2b1aa3521b6 tempest-VolumesListTestJSON-1015418202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f097450f-1311-48de-b5fa-fe1d200bc856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:29:29 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-e14af1de-474c-4a54-9ac5-c2b1aa3521b6 tempest-VolumesListTestJSON-1015418202 None] Volume volume-d8a997cf-36b4-4340-bbb3-c5bb00a506e2 (d8a997cf-36b4-4340-bbb3-c5bb00a506e2): created successfully Sep 16 20:29:29 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e14af1de-474c-4a54-9ac5-c2b1aa3521b6 tempest-VolumesListTestJSON-1015418202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f097450f-1311-48de-b5fa-fe1d200bc856) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:29:29 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e14af1de-474c-4a54-9ac5-c2b1aa3521b6 tempest-VolumesListTestJSON-1015418202 None] Flow 'volume_create_manager' (01d684d3-1334-4f3a-ac36-66480bc67b3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:29:29 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-e14af1de-474c-4a54-9ac5-c2b1aa3521b6 tempest-VolumesListTestJSON-1015418202 None] Created volume successfully. Sep 16 20:29:29 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [req-703a49c7-f3b3-4064-b5fa-f2d483bab534 req-2271ceeb-98d6-4a25-9c72-47f24d91c717 tempest-TestInstancesWithCinderVolumes-1553461958 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81', 'name': 'volume-ed767f87-8501-4441-b005-ce0270bb7fe7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0872f8be-7cc5-477b-b30e-cabcfbbf279c', 'enforce_multipath': True} {{(pid=86188) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 16 20:29:29 devstack cinder-volume[86188]: INFO cinder.volume.manager [req-703a49c7-f3b3-4064-b5fa-f2d483bab534 req-2271ceeb-98d6-4a25-9c72-47f24d91c717 tempest-TestInstancesWithCinderVolumes-1553461958 None] attachment_update completed successfully. Sep 16 20:29:29 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-1f05b67e-08da-45e3-9d3a-daf255e111de tempest-VolumesActionsTest-1215772093 None] Acquiring lock "cinder-14e4b8a9-9dca-4bf6-a883-7eec30b66d00-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:29:29 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-1f05b67e-08da-45e3-9d3a-daf255e111de tempest-VolumesActionsTest-1215772093 None] Lock "cinder-14e4b8a9-9dca-4bf6-a883-7eec30b66d00-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:29:29 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-1f05b67e-08da-45e3-9d3a-daf255e111de tempest-VolumesActionsTest-1215772093 None] Acquiring lock "cinder-quobyte-14e4b8a9-9dca-4bf6-a883-7eec30b66d00" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:29:30 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-1f05b67e-08da-45e3-9d3a-daf255e111de tempest-VolumesActionsTest-1215772093 None] Lock "cinder-quobyte-14e4b8a9-9dca-4bf6-a883-7eec30b66d00" acquired by "delete_volume" :: waited 0.028s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:29:30 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[e925cd27-0478-45f1-9c52-934c9f78c65d]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:29:30 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-1f05b67e-08da-45e3-9d3a-daf255e111de tempest-VolumesActionsTest-1215772093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-14e4b8a9-9dca-4bf6-a883-7eec30b66d00 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:29:30 devstack sudo[99218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-14e4b8a9-9dca-4bf6-a883-7eec30b66d00 Sep 16 20:29:30 devstack sudo[99218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:29:30 devstack sudo[99218]: pam_unix(sudo:session): session closed for user root Sep 16 20:29:30 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-1f05b67e-08da-45e3-9d3a-daf255e111de tempest-VolumesActionsTest-1215772093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-14e4b8a9-9dca-4bf6-a883-7eec30b66d00" returned: 0 in 0.602s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:29:30 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-1f05b67e-08da-45e3-9d3a-daf255e111de tempest-VolumesActionsTest-1215772093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-14e4b8a9-9dca-4bf6-a883-7eec30b66d00 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:29:30 devstack sudo[99321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-14e4b8a9-9dca-4bf6-a883-7eec30b66d00 Sep 16 20:29:30 devstack sudo[99321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:29:30 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c8616f0-28d0-49fb-9012-2290bcc3894a tempest-VolumesListTestJSON-1015418202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:29:30 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-6c8616f0-28d0-49fb-9012-2290bcc3894a tempest-VolumesListTestJSON-1015418202 None] Flow 'volume_create_manager' (770f62a0-1c5a-4ca1-807f-76943029feda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:29:30 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-6c8616f0-28d0-49fb-9012-2290bcc3894a tempest-VolumesListTestJSON-1015418202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3854f9c3-4ed5-40a8-84b6-a59ddd12c9d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:29:30 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-6c8616f0-28d0-49fb-9012-2290bcc3894a tempest-VolumesListTestJSON-1015418202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3854f9c3-4ed5-40a8-84b6-a59ddd12c9d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:29:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-491740120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bef14d46-5f14-4307-ac23-3d9dbab9cf88,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b9ab700985e24c7faf3f3bfce289a470',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:29:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:29:31Z,use_quota=True,user_id='6b56c1ddc86d42e79708b47f977f5ab4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:29:30 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-6c8616f0-28d0-49fb-9012-2290bcc3894a tempest-VolumesListTestJSON-1015418202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc1d27af-640b-41f6-aefb-1ca09c9c9e29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:29:30 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-6c8616f0-28d0-49fb-9012-2290bcc3894a tempest-VolumesListTestJSON-1015418202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc1d27af-640b-41f6-aefb-1ca09c9c9e29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:29:30 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-6c8616f0-28d0-49fb-9012-2290bcc3894a tempest-VolumesListTestJSON-1015418202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48905c40-76fc-4885-bc4a-83bdc2b19eb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:29:30 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-6c8616f0-28d0-49fb-9012-2290bcc3894a tempest-VolumesListTestJSON-1015418202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48905c40-76fc-4885-bc4a-83bdc2b19eb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bef14d46-5f14-4307-ac23-3d9dbab9cf88', 'volume_name': 'volume-bef14d46-5f14-4307-ac23-3d9dbab9cf88', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:29:30 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-6c8616f0-28d0-49fb-9012-2290bcc3894a tempest-VolumesListTestJSON-1015418202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8aff133-5b39-4cff-8bb7-19c01eb38175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:29:30 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-6c8616f0-28d0-49fb-9012-2290bcc3894a tempest-VolumesListTestJSON-1015418202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8aff133-5b39-4cff-8bb7-19c01eb38175) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:29:30 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-6c8616f0-28d0-49fb-9012-2290bcc3894a tempest-VolumesListTestJSON-1015418202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (886965b2-d81e-4dff-8b10-4ce0c8ac146e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:29:30 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-6c8616f0-28d0-49fb-9012-2290bcc3894a tempest-VolumesListTestJSON-1015418202 None] Volume bef14d46-5f14-4307-ac23-3d9dbab9cf88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bef14d46-5f14-4307-ac23-3d9dbab9cf88', 'volume_size': 1} Sep 16 20:29:30 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-6c8616f0-28d0-49fb-9012-2290bcc3894a tempest-VolumesListTestJSON-1015418202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:29:30 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-6c8616f0-28d0-49fb-9012-2290bcc3894a tempest-VolumesListTestJSON-1015418202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:29:30 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-6c8616f0-28d0-49fb-9012-2290bcc3894a tempest-VolumesListTestJSON-1015418202 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:29:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-491740120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bef14d46-5f14-4307-ac23-3d9dbab9cf88,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b9ab700985e24c7faf3f3bfce289a470',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:29:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:29:31Z,use_quota=True,user_id='6b56c1ddc86d42e79708b47f977f5ab4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:29:30 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-6c8616f0-28d0-49fb-9012-2290bcc3894a tempest-VolumesListTestJSON-1015418202 None] Creating volume bef14d46-5f14-4307-ac23-3d9dbab9cf88 {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:29:30 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-6c8616f0-28d0-49fb-9012-2290bcc3894a tempest-VolumesListTestJSON-1015418202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:29:30 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-6c8616f0-28d0-49fb-9012-2290bcc3894a tempest-VolumesListTestJSON-1015418202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:29:30 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-6c8616f0-28d0-49fb-9012-2290bcc3894a tempest-VolumesListTestJSON-1015418202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:29:30 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-6c8616f0-28d0-49fb-9012-2290bcc3894a tempest-VolumesListTestJSON-1015418202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:29:30 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-6c8616f0-28d0-49fb-9012-2290bcc3894a tempest-VolumesListTestJSON-1015418202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:29:30 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-6c8616f0-28d0-49fb-9012-2290bcc3894a tempest-VolumesListTestJSON-1015418202 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:29:30 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-6c8616f0-28d0-49fb-9012-2290bcc3894a tempest-VolumesListTestJSON-1015418202 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:29:30 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-6c8616f0-28d0-49fb-9012-2290bcc3894a tempest-VolumesListTestJSON-1015418202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-bef14d46-5f14-4307-ac23-3d9dbab9cf88 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:29:30 devstack sudo[99332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-bef14d46-5f14-4307-ac23-3d9dbab9cf88 1073741824 Sep 16 20:29:30 devstack sudo[99332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:29:31 devstack sudo[99321]: pam_unix(sudo:session): session closed for user root Sep 16 20:29:31 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-1f05b67e-08da-45e3-9d3a-daf255e111de tempest-VolumesActionsTest-1215772093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-14e4b8a9-9dca-4bf6-a883-7eec30b66d00" returned: 0 in 0.534s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:29:31 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-1f05b67e-08da-45e3-9d3a-daf255e111de tempest-VolumesActionsTest-1215772093 None] Lock "cinder-quobyte-14e4b8a9-9dca-4bf6-a883-7eec30b66d00" released by "delete_volume" :: held 1.222s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:29:31 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-1f05b67e-08da-45e3-9d3a-daf255e111de tempest-VolumesActionsTest-1215772093 None] Created reservations ['978091ce-c188-4939-896e-c0911d83e668', '73308262-6fc2-4068-b681-a568bd97f242', '442d270b-a723-4859-ac33-a9e6d6a64cbf', '737c8e60-6f46-4f4c-8cea-d52dd1e00b10'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:29:31 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-1f05b67e-08da-45e3-9d3a-daf255e111de tempest-VolumesActionsTest-1215772093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:29:31 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-1f05b67e-08da-45e3-9d3a-daf255e111de tempest-VolumesActionsTest-1215772093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:29:31 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-1f05b67e-08da-45e3-9d3a-daf255e111de tempest-VolumesActionsTest-1215772093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:29:31 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-1f05b67e-08da-45e3-9d3a-daf255e111de tempest-VolumesActionsTest-1215772093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:29:31 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-1f05b67e-08da-45e3-9d3a-daf255e111de tempest-VolumesActionsTest-1215772093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:29:31 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-1f05b67e-08da-45e3-9d3a-daf255e111de tempest-VolumesActionsTest-1215772093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:29:31 devstack sudo[99688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:29:31 devstack sudo[99688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:29:31 devstack sudo[99332]: pam_unix(sudo:session): session closed for user root Sep 16 20:29:31 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-6c8616f0-28d0-49fb-9012-2290bcc3894a tempest-VolumesListTestJSON-1015418202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-bef14d46-5f14-4307-ac23-3d9dbab9cf88 1073741824" returned: 0 in 0.932s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:29:31 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-6c8616f0-28d0-49fb-9012-2290bcc3894a tempest-VolumesListTestJSON-1015418202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-bef14d46-5f14-4307-ac23-3d9dbab9cf88 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:29:31 devstack sudo[99706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-bef14d46-5f14-4307-ac23-3d9dbab9cf88 Sep 16 20:29:31 devstack sudo[99706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:29:32 devstack sudo[99688]: pam_unix(sudo:session): session closed for user root Sep 16 20:29:32 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-1f05b67e-08da-45e3-9d3a-daf255e111de tempest-VolumesActionsTest-1215772093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.554s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:29:32 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-1f05b67e-08da-45e3-9d3a-daf255e111de tempest-VolumesActionsTest-1215772093 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:29:32 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-1f05b67e-08da-45e3-9d3a-daf255e111de tempest-VolumesActionsTest-1215772093 None] Deleted volume successfully. Sep 16 20:29:32 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-1f05b67e-08da-45e3-9d3a-daf255e111de tempest-VolumesActionsTest-1215772093 None] Lock "cinder-14e4b8a9-9dca-4bf6-a883-7eec30b66d00-delete_volume" released by "delete_volume" :: held 2.135s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:29:32 devstack sudo[99706]: pam_unix(sudo:session): session closed for user root Sep 16 20:29:32 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-6c8616f0-28d0-49fb-9012-2290bcc3894a tempest-VolumesListTestJSON-1015418202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-bef14d46-5f14-4307-ac23-3d9dbab9cf88" returned: 0 in 0.292s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:29:32 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-6c8616f0-28d0-49fb-9012-2290bcc3894a tempest-VolumesListTestJSON-1015418202 None] <== create_volume: return (1305ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:29:32 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-6c8616f0-28d0-49fb-9012-2290bcc3894a tempest-VolumesListTestJSON-1015418202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.311s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:29:32 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-6c8616f0-28d0-49fb-9012-2290bcc3894a tempest-VolumesListTestJSON-1015418202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (886965b2-d81e-4dff-8b10-4ce0c8ac146e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bef14d46-5f14-4307-ac23-3d9dbab9cf88', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:29:32 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-6c8616f0-28d0-49fb-9012-2290bcc3894a tempest-VolumesListTestJSON-1015418202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a062fe0-760c-4c20-b043-a867ae36565e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:29:32 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-6c8616f0-28d0-49fb-9012-2290bcc3894a tempest-VolumesListTestJSON-1015418202 None] Volume volume-bef14d46-5f14-4307-ac23-3d9dbab9cf88 (bef14d46-5f14-4307-ac23-3d9dbab9cf88): created successfully Sep 16 20:29:32 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-6c8616f0-28d0-49fb-9012-2290bcc3894a tempest-VolumesListTestJSON-1015418202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a062fe0-760c-4c20-b043-a867ae36565e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:29:32 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-6c8616f0-28d0-49fb-9012-2290bcc3894a tempest-VolumesListTestJSON-1015418202 None] Flow 'volume_create_manager' (770f62a0-1c5a-4ca1-807f-76943029feda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:29:32 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-6c8616f0-28d0-49fb-9012-2290bcc3894a tempest-VolumesListTestJSON-1015418202 None] Created volume successfully. Sep 16 20:29:33 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-a77ca6f4-4aeb-460f-95a7-0791c05c5145 tempest-VolumesListTestJSON-1015418202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:29:33 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a77ca6f4-4aeb-460f-95a7-0791c05c5145 tempest-VolumesListTestJSON-1015418202 None] Flow 'volume_create_manager' (9ab557fb-da6d-42d6-91ef-f642f520f5a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:29:33 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a77ca6f4-4aeb-460f-95a7-0791c05c5145 tempest-VolumesListTestJSON-1015418202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (392510ad-20a9-4c5a-922b-76abd3191b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:29:33 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a77ca6f4-4aeb-460f-95a7-0791c05c5145 tempest-VolumesListTestJSON-1015418202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (392510ad-20a9-4c5a-922b-76abd3191b94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:29:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2026744106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a42dd0f8-f5b9-4cee-af8e-de5728e5d09b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b9ab700985e24c7faf3f3bfce289a470',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:29:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:29:34Z,use_quota=True,user_id='6b56c1ddc86d42e79708b47f977f5ab4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:29:33 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a77ca6f4-4aeb-460f-95a7-0791c05c5145 tempest-VolumesListTestJSON-1015418202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (804ef4eb-be5d-4f20-b9a9-e6fb220d4f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:29:33 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a77ca6f4-4aeb-460f-95a7-0791c05c5145 tempest-VolumesListTestJSON-1015418202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (804ef4eb-be5d-4f20-b9a9-e6fb220d4f39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:29:33 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a77ca6f4-4aeb-460f-95a7-0791c05c5145 tempest-VolumesListTestJSON-1015418202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69f42cf6-570f-4eaa-9250-67f07cd19176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:29:33 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a77ca6f4-4aeb-460f-95a7-0791c05c5145 tempest-VolumesListTestJSON-1015418202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69f42cf6-570f-4eaa-9250-67f07cd19176) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a42dd0f8-f5b9-4cee-af8e-de5728e5d09b', 'volume_name': 'volume-a42dd0f8-f5b9-4cee-af8e-de5728e5d09b', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:29:33 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a77ca6f4-4aeb-460f-95a7-0791c05c5145 tempest-VolumesListTestJSON-1015418202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0872858-1cfb-4344-a8ee-79b11fb94a86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:29:33 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a77ca6f4-4aeb-460f-95a7-0791c05c5145 tempest-VolumesListTestJSON-1015418202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0872858-1cfb-4344-a8ee-79b11fb94a86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:29:33 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a77ca6f4-4aeb-460f-95a7-0791c05c5145 tempest-VolumesListTestJSON-1015418202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0af1733-f17b-4ba3-a07a-1e69690a675a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:29:33 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-a77ca6f4-4aeb-460f-95a7-0791c05c5145 tempest-VolumesListTestJSON-1015418202 None] Volume a42dd0f8-f5b9-4cee-af8e-de5728e5d09b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a42dd0f8-f5b9-4cee-af8e-de5728e5d09b', 'volume_size': 1} Sep 16 20:29:33 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a77ca6f4-4aeb-460f-95a7-0791c05c5145 tempest-VolumesListTestJSON-1015418202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:29:33 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a77ca6f4-4aeb-460f-95a7-0791c05c5145 tempest-VolumesListTestJSON-1015418202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:29:33 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-a77ca6f4-4aeb-460f-95a7-0791c05c5145 tempest-VolumesListTestJSON-1015418202 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:29:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2026744106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a42dd0f8-f5b9-4cee-af8e-de5728e5d09b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b9ab700985e24c7faf3f3bfce289a470',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:29:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:29:34Z,use_quota=True,user_id='6b56c1ddc86d42e79708b47f977f5ab4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:29:33 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-a77ca6f4-4aeb-460f-95a7-0791c05c5145 tempest-VolumesListTestJSON-1015418202 None] Creating volume a42dd0f8-f5b9-4cee-af8e-de5728e5d09b {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:29:33 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a77ca6f4-4aeb-460f-95a7-0791c05c5145 tempest-VolumesListTestJSON-1015418202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:29:33 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a77ca6f4-4aeb-460f-95a7-0791c05c5145 tempest-VolumesListTestJSON-1015418202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:29:33 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-a77ca6f4-4aeb-460f-95a7-0791c05c5145 tempest-VolumesListTestJSON-1015418202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:29:33 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-a77ca6f4-4aeb-460f-95a7-0791c05c5145 tempest-VolumesListTestJSON-1015418202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:29:33 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a77ca6f4-4aeb-460f-95a7-0791c05c5145 tempest-VolumesListTestJSON-1015418202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:29:33 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-a77ca6f4-4aeb-460f-95a7-0791c05c5145 tempest-VolumesListTestJSON-1015418202 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:29:33 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-a77ca6f4-4aeb-460f-95a7-0791c05c5145 tempest-VolumesListTestJSON-1015418202 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:29:33 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a77ca6f4-4aeb-460f-95a7-0791c05c5145 tempest-VolumesListTestJSON-1015418202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a42dd0f8-f5b9-4cee-af8e-de5728e5d09b 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:29:33 devstack sudo[99714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a42dd0f8-f5b9-4cee-af8e-de5728e5d09b 1073741824 Sep 16 20:29:33 devstack sudo[99714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:29:34 devstack sudo[99714]: pam_unix(sudo:session): session closed for user root Sep 16 20:29:34 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a77ca6f4-4aeb-460f-95a7-0791c05c5145 tempest-VolumesListTestJSON-1015418202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a42dd0f8-f5b9-4cee-af8e-de5728e5d09b 1073741824" returned: 0 in 0.679s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:29:34 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a77ca6f4-4aeb-460f-95a7-0791c05c5145 tempest-VolumesListTestJSON-1015418202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a42dd0f8-f5b9-4cee-af8e-de5728e5d09b {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:29:34 devstack sudo[99721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a42dd0f8-f5b9-4cee-af8e-de5728e5d09b Sep 16 20:29:34 devstack sudo[99721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:29:34 devstack sudo[99721]: pam_unix(sudo:session): session closed for user root Sep 16 20:29:34 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a77ca6f4-4aeb-460f-95a7-0791c05c5145 tempest-VolumesListTestJSON-1015418202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a42dd0f8-f5b9-4cee-af8e-de5728e5d09b" returned: 0 in 0.306s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:29:34 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-a77ca6f4-4aeb-460f-95a7-0791c05c5145 tempest-VolumesListTestJSON-1015418202 None] <== create_volume: return (1064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:29:34 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a77ca6f4-4aeb-460f-95a7-0791c05c5145 tempest-VolumesListTestJSON-1015418202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.069s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:29:34 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a77ca6f4-4aeb-460f-95a7-0791c05c5145 tempest-VolumesListTestJSON-1015418202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0af1733-f17b-4ba3-a07a-1e69690a675a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a42dd0f8-f5b9-4cee-af8e-de5728e5d09b', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:29:34 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a77ca6f4-4aeb-460f-95a7-0791c05c5145 tempest-VolumesListTestJSON-1015418202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (990b8b36-e22b-4b1a-8aac-245d126092ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:29:35 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-a77ca6f4-4aeb-460f-95a7-0791c05c5145 tempest-VolumesListTestJSON-1015418202 None] Volume volume-a42dd0f8-f5b9-4cee-af8e-de5728e5d09b (a42dd0f8-f5b9-4cee-af8e-de5728e5d09b): created successfully Sep 16 20:29:35 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a77ca6f4-4aeb-460f-95a7-0791c05c5145 tempest-VolumesListTestJSON-1015418202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (990b8b36-e22b-4b1a-8aac-245d126092ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:29:35 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a77ca6f4-4aeb-460f-95a7-0791c05c5145 tempest-VolumesListTestJSON-1015418202 None] Flow 'volume_create_manager' (9ab557fb-da6d-42d6-91ef-f642f520f5a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:29:35 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-a77ca6f4-4aeb-460f-95a7-0791c05c5145 tempest-VolumesListTestJSON-1015418202 None] Created volume successfully. Sep 16 20:29:39 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-f53bd4a3-1536-463e-9dc9-906b7c4854cf tempest-VolumesListTestJSON-1015418202 None] Acquiring lock "cinder-a42dd0f8-f5b9-4cee-af8e-de5728e5d09b-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:29:39 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-f53bd4a3-1536-463e-9dc9-906b7c4854cf tempest-VolumesListTestJSON-1015418202 None] Lock "cinder-a42dd0f8-f5b9-4cee-af8e-de5728e5d09b-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:29:39 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-f53bd4a3-1536-463e-9dc9-906b7c4854cf tempest-VolumesListTestJSON-1015418202 None] Acquiring lock "cinder-quobyte-a42dd0f8-f5b9-4cee-af8e-de5728e5d09b" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:29:39 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-f53bd4a3-1536-463e-9dc9-906b7c4854cf tempest-VolumesListTestJSON-1015418202 None] Lock "cinder-quobyte-a42dd0f8-f5b9-4cee-af8e-de5728e5d09b" acquired by "delete_volume" :: waited 0.022s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:29:39 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[44cd318c-db07-4417-86db-5fc5bc81bd19]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:29:39 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f53bd4a3-1536-463e-9dc9-906b7c4854cf tempest-VolumesListTestJSON-1015418202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a42dd0f8-f5b9-4cee-af8e-de5728e5d09b {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:29:39 devstack sudo[99728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a42dd0f8-f5b9-4cee-af8e-de5728e5d09b Sep 16 20:29:39 devstack sudo[99728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:29:40 devstack sudo[99728]: pam_unix(sudo:session): session closed for user root Sep 16 20:29:40 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f53bd4a3-1536-463e-9dc9-906b7c4854cf tempest-VolumesListTestJSON-1015418202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a42dd0f8-f5b9-4cee-af8e-de5728e5d09b" returned: 0 in 0.532s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:29:40 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f53bd4a3-1536-463e-9dc9-906b7c4854cf tempest-VolumesListTestJSON-1015418202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a42dd0f8-f5b9-4cee-af8e-de5728e5d09b {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:29:40 devstack sudo[99733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a42dd0f8-f5b9-4cee-af8e-de5728e5d09b Sep 16 20:29:40 devstack sudo[99733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:29:40 devstack sudo[99733]: pam_unix(sudo:session): session closed for user root Sep 16 20:29:40 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f53bd4a3-1536-463e-9dc9-906b7c4854cf tempest-VolumesListTestJSON-1015418202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a42dd0f8-f5b9-4cee-af8e-de5728e5d09b" returned: 0 in 0.292s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:29:40 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-f53bd4a3-1536-463e-9dc9-906b7c4854cf tempest-VolumesListTestJSON-1015418202 None] Lock "cinder-quobyte-a42dd0f8-f5b9-4cee-af8e-de5728e5d09b" released by "delete_volume" :: held 0.886s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:29:40 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-f53bd4a3-1536-463e-9dc9-906b7c4854cf tempest-VolumesListTestJSON-1015418202 None] Created reservations ['d5d7fd45-5d28-4ccb-9313-b25e37620bae', '65915d7a-ece4-4868-b505-a2ef30022d88', 'a76201f1-870e-407e-a8d0-e2b52b113b11', '1e0adbfc-ad2c-429a-94e9-f403aca3e1b7'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:29:40 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-f53bd4a3-1536-463e-9dc9-906b7c4854cf tempest-VolumesListTestJSON-1015418202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:29:40 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-f53bd4a3-1536-463e-9dc9-906b7c4854cf tempest-VolumesListTestJSON-1015418202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:29:40 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-f53bd4a3-1536-463e-9dc9-906b7c4854cf tempest-VolumesListTestJSON-1015418202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:29:40 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-f53bd4a3-1536-463e-9dc9-906b7c4854cf tempest-VolumesListTestJSON-1015418202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:29:40 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-f53bd4a3-1536-463e-9dc9-906b7c4854cf tempest-VolumesListTestJSON-1015418202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:29:40 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f53bd4a3-1536-463e-9dc9-906b7c4854cf tempest-VolumesListTestJSON-1015418202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:29:40 devstack sudo[99736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:29:40 devstack sudo[99736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:29:40 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-6a733de5-a072-4fd9-b01f-049d826f3a8d tempest-VolumesListTestJSON-1015418202 None] Acquiring lock "cinder-bef14d46-5f14-4307-ac23-3d9dbab9cf88-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:29:41 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-6a733de5-a072-4fd9-b01f-049d826f3a8d tempest-VolumesListTestJSON-1015418202 None] Lock "cinder-bef14d46-5f14-4307-ac23-3d9dbab9cf88-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:29:41 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-6a733de5-a072-4fd9-b01f-049d826f3a8d tempest-VolumesListTestJSON-1015418202 None] Acquiring lock "cinder-quobyte-bef14d46-5f14-4307-ac23-3d9dbab9cf88" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:29:41 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-6a733de5-a072-4fd9-b01f-049d826f3a8d tempest-VolumesListTestJSON-1015418202 None] Lock "cinder-quobyte-bef14d46-5f14-4307-ac23-3d9dbab9cf88" acquired by "delete_volume" :: waited 0.026s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:29:41 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[c138361c-29ff-48e3-8c23-c88bccc5a5ec]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:29:41 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-6a733de5-a072-4fd9-b01f-049d826f3a8d tempest-VolumesListTestJSON-1015418202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-bef14d46-5f14-4307-ac23-3d9dbab9cf88 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:29:41 devstack sudo[99736]: pam_unix(sudo:session): session closed for user root Sep 16 20:29:41 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f53bd4a3-1536-463e-9dc9-906b7c4854cf tempest-VolumesListTestJSON-1015418202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.481s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:29:41 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-f53bd4a3-1536-463e-9dc9-906b7c4854cf tempest-VolumesListTestJSON-1015418202 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:29:41 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-f53bd4a3-1536-463e-9dc9-906b7c4854cf tempest-VolumesListTestJSON-1015418202 None] Deleted volume successfully. Sep 16 20:29:41 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-f53bd4a3-1536-463e-9dc9-906b7c4854cf tempest-VolumesListTestJSON-1015418202 None] Lock "cinder-a42dd0f8-f5b9-4cee-af8e-de5728e5d09b-delete_volume" released by "delete_volume" :: held 1.652s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:29:41 devstack sudo[99739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-bef14d46-5f14-4307-ac23-3d9dbab9cf88 Sep 16 20:29:41 devstack sudo[99739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:29:41 devstack sudo[99739]: pam_unix(sudo:session): session closed for user root Sep 16 20:29:41 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-6a733de5-a072-4fd9-b01f-049d826f3a8d tempest-VolumesListTestJSON-1015418202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-bef14d46-5f14-4307-ac23-3d9dbab9cf88" returned: 0 in 0.689s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:29:41 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-6a733de5-a072-4fd9-b01f-049d826f3a8d tempest-VolumesListTestJSON-1015418202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-bef14d46-5f14-4307-ac23-3d9dbab9cf88 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:29:41 devstack sudo[99745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-bef14d46-5f14-4307-ac23-3d9dbab9cf88 Sep 16 20:29:41 devstack sudo[99745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:29:42 devstack sudo[99745]: pam_unix(sudo:session): session closed for user root Sep 16 20:29:42 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-6a733de5-a072-4fd9-b01f-049d826f3a8d tempest-VolumesListTestJSON-1015418202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-bef14d46-5f14-4307-ac23-3d9dbab9cf88" returned: 0 in 0.274s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:29:42 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-6a733de5-a072-4fd9-b01f-049d826f3a8d tempest-VolumesListTestJSON-1015418202 None] Lock "cinder-quobyte-bef14d46-5f14-4307-ac23-3d9dbab9cf88" released by "delete_volume" :: held 1.053s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:29:42 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-6a733de5-a072-4fd9-b01f-049d826f3a8d tempest-VolumesListTestJSON-1015418202 None] Created reservations ['84033303-afe8-4187-b0c2-f3c183912a33', 'c04d0bbb-e265-4288-af22-e4d88d916b93', '1675fbe8-250c-45ef-88d9-140139bf1bc7', 'b4a9701a-2a7c-4970-a06a-c3495a2cee5d'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:29:42 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-6a733de5-a072-4fd9-b01f-049d826f3a8d tempest-VolumesListTestJSON-1015418202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:29:42 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-6a733de5-a072-4fd9-b01f-049d826f3a8d tempest-VolumesListTestJSON-1015418202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:29:42 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-6a733de5-a072-4fd9-b01f-049d826f3a8d tempest-VolumesListTestJSON-1015418202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:29:42 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-6a733de5-a072-4fd9-b01f-049d826f3a8d tempest-VolumesListTestJSON-1015418202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:29:42 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-6a733de5-a072-4fd9-b01f-049d826f3a8d tempest-VolumesListTestJSON-1015418202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:29:42 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-6a733de5-a072-4fd9-b01f-049d826f3a8d tempest-VolumesListTestJSON-1015418202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:29:42 devstack sudo[99748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:29:42 devstack sudo[99748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:29:42 devstack sudo[99748]: pam_unix(sudo:session): session closed for user root Sep 16 20:29:42 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-6a733de5-a072-4fd9-b01f-049d826f3a8d tempest-VolumesListTestJSON-1015418202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.249s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:29:42 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-6a733de5-a072-4fd9-b01f-049d826f3a8d tempest-VolumesListTestJSON-1015418202 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:29:42 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-6a733de5-a072-4fd9-b01f-049d826f3a8d tempest-VolumesListTestJSON-1015418202 None] Deleted volume successfully. Sep 16 20:29:42 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-6a733de5-a072-4fd9-b01f-049d826f3a8d tempest-VolumesListTestJSON-1015418202 None] Lock "cinder-bef14d46-5f14-4307-ac23-3d9dbab9cf88-delete_volume" released by "delete_volume" :: held 1.567s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:29:43 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-00bf1a92-1f0a-4feb-87c2-d8d5d50135dd tempest-VolumesGetTest-1431096848 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:29:43 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-00bf1a92-1f0a-4feb-87c2-d8d5d50135dd tempest-VolumesGetTest-1431096848 None] Flow 'volume_create_manager' (a24d2ac9-2321-4959-bd04-7feace15efec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:29:43 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-00bf1a92-1f0a-4feb-87c2-d8d5d50135dd tempest-VolumesGetTest-1431096848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd980bad-0808-4f8e-81cc-ddebf21053e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:29:43 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-00bf1a92-1f0a-4feb-87c2-d8d5d50135dd tempest-VolumesGetTest-1431096848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd980bad-0808-4f8e-81cc-ddebf21053e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:29:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-986480596',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3336e9fb-63da-4942-ba65-86eb70a0a3fd,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f71bf8bb99894f1d87c310177b239798',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:29:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:29:43Z,use_quota=True,user_id='1e0a03b0f86d497299b719cf3b8e51bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:29:43 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-00bf1a92-1f0a-4feb-87c2-d8d5d50135dd tempest-VolumesGetTest-1431096848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (840a45b6-c39b-4866-afd1-f5a42efb6532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:29:43 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-00bf1a92-1f0a-4feb-87c2-d8d5d50135dd tempest-VolumesGetTest-1431096848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (840a45b6-c39b-4866-afd1-f5a42efb6532) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:29:43 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-00bf1a92-1f0a-4feb-87c2-d8d5d50135dd tempest-VolumesGetTest-1431096848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d1213a9-bb00-4a95-81e2-0c957537bc5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:29:43 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-00bf1a92-1f0a-4feb-87c2-d8d5d50135dd tempest-VolumesGetTest-1431096848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d1213a9-bb00-4a95-81e2-0c957537bc5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3336e9fb-63da-4942-ba65-86eb70a0a3fd', 'volume_name': 'volume-3336e9fb-63da-4942-ba65-86eb70a0a3fd', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:29:43 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-00bf1a92-1f0a-4feb-87c2-d8d5d50135dd tempest-VolumesGetTest-1431096848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7b552cf-97d3-4cbb-b5f5-f0678848d3ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:29:43 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-00bf1a92-1f0a-4feb-87c2-d8d5d50135dd tempest-VolumesGetTest-1431096848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7b552cf-97d3-4cbb-b5f5-f0678848d3ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:29:43 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-00bf1a92-1f0a-4feb-87c2-d8d5d50135dd tempest-VolumesGetTest-1431096848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d60368f4-35ea-4914-be26-47e5737f9639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:29:43 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-00bf1a92-1f0a-4feb-87c2-d8d5d50135dd tempest-VolumesGetTest-1431096848 None] Volume 3336e9fb-63da-4942-ba65-86eb70a0a3fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3336e9fb-63da-4942-ba65-86eb70a0a3fd', 'volume_size': 1} Sep 16 20:29:43 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-00bf1a92-1f0a-4feb-87c2-d8d5d50135dd tempest-VolumesGetTest-1431096848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:29:43 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-00bf1a92-1f0a-4feb-87c2-d8d5d50135dd tempest-VolumesGetTest-1431096848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:29:43 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-00bf1a92-1f0a-4feb-87c2-d8d5d50135dd tempest-VolumesGetTest-1431096848 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:29:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-986480596',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3336e9fb-63da-4942-ba65-86eb70a0a3fd,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f71bf8bb99894f1d87c310177b239798',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:29:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:29:43Z,use_quota=True,user_id='1e0a03b0f86d497299b719cf3b8e51bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:29:43 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-00bf1a92-1f0a-4feb-87c2-d8d5d50135dd tempest-VolumesGetTest-1431096848 None] Creating volume 3336e9fb-63da-4942-ba65-86eb70a0a3fd {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:29:43 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-00bf1a92-1f0a-4feb-87c2-d8d5d50135dd tempest-VolumesGetTest-1431096848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:29:43 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-00bf1a92-1f0a-4feb-87c2-d8d5d50135dd tempest-VolumesGetTest-1431096848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:29:43 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-00bf1a92-1f0a-4feb-87c2-d8d5d50135dd tempest-VolumesGetTest-1431096848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:29:43 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-00bf1a92-1f0a-4feb-87c2-d8d5d50135dd tempest-VolumesGetTest-1431096848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:29:43 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-00bf1a92-1f0a-4feb-87c2-d8d5d50135dd tempest-VolumesGetTest-1431096848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:29:43 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-00bf1a92-1f0a-4feb-87c2-d8d5d50135dd tempest-VolumesGetTest-1431096848 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:29:43 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-00bf1a92-1f0a-4feb-87c2-d8d5d50135dd tempest-VolumesGetTest-1431096848 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:29:43 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-00bf1a92-1f0a-4feb-87c2-d8d5d50135dd tempest-VolumesGetTest-1431096848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-3336e9fb-63da-4942-ba65-86eb70a0a3fd 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:29:43 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-4d6e8647-593a-4a27-a0bb-3c4b5d39220a tempest-VolumesListTestJSON-1015418202 None] Acquiring lock "cinder-d8a997cf-36b4-4340-bbb3-c5bb00a506e2-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:29:43 devstack sudo[99751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-3336e9fb-63da-4942-ba65-86eb70a0a3fd 1073741824 Sep 16 20:29:43 devstack sudo[99751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:29:43 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-4d6e8647-593a-4a27-a0bb-3c4b5d39220a tempest-VolumesListTestJSON-1015418202 None] Lock "cinder-d8a997cf-36b4-4340-bbb3-c5bb00a506e2-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:29:43 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-4d6e8647-593a-4a27-a0bb-3c4b5d39220a tempest-VolumesListTestJSON-1015418202 None] Acquiring lock "cinder-quobyte-d8a997cf-36b4-4340-bbb3-c5bb00a506e2" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:29:43 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-4d6e8647-593a-4a27-a0bb-3c4b5d39220a tempest-VolumesListTestJSON-1015418202 None] Lock "cinder-quobyte-d8a997cf-36b4-4340-bbb3-c5bb00a506e2" acquired by "delete_volume" :: waited 0.020s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:29:43 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd989096-81fa-41e3-812b-44006c7cb955]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:29:43 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-4d6e8647-593a-4a27-a0bb-3c4b5d39220a tempest-VolumesListTestJSON-1015418202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d8a997cf-36b4-4340-bbb3-c5bb00a506e2 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:29:43 devstack sudo[99753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d8a997cf-36b4-4340-bbb3-c5bb00a506e2 Sep 16 20:29:43 devstack sudo[99753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:29:43 devstack sudo[99751]: pam_unix(sudo:session): session closed for user root Sep 16 20:29:43 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-00bf1a92-1f0a-4feb-87c2-d8d5d50135dd tempest-VolumesGetTest-1431096848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-3336e9fb-63da-4942-ba65-86eb70a0a3fd 1073741824" returned: 0 in 0.488s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:29:43 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-00bf1a92-1f0a-4feb-87c2-d8d5d50135dd tempest-VolumesGetTest-1431096848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-3336e9fb-63da-4942-ba65-86eb70a0a3fd {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:29:43 devstack sudo[99753]: pam_unix(sudo:session): session closed for user root Sep 16 20:29:43 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-4d6e8647-593a-4a27-a0bb-3c4b5d39220a tempest-VolumesListTestJSON-1015418202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d8a997cf-36b4-4340-bbb3-c5bb00a506e2" returned: 0 in 0.429s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:29:43 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-4d6e8647-593a-4a27-a0bb-3c4b5d39220a tempest-VolumesListTestJSON-1015418202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d8a997cf-36b4-4340-bbb3-c5bb00a506e2 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:29:43 devstack sudo[99762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-3336e9fb-63da-4942-ba65-86eb70a0a3fd Sep 16 20:29:43 devstack sudo[99762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:29:43 devstack sudo[99763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d8a997cf-36b4-4340-bbb3-c5bb00a506e2 Sep 16 20:29:43 devstack sudo[99763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:29:44 devstack sudo[99762]: pam_unix(sudo:session): session closed for user root Sep 16 20:29:44 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-00bf1a92-1f0a-4feb-87c2-d8d5d50135dd tempest-VolumesGetTest-1431096848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-3336e9fb-63da-4942-ba65-86eb70a0a3fd" returned: 0 in 0.244s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:29:44 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-00bf1a92-1f0a-4feb-87c2-d8d5d50135dd tempest-VolumesGetTest-1431096848 None] <== create_volume: return (781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:29:44 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-00bf1a92-1f0a-4feb-87c2-d8d5d50135dd tempest-VolumesGetTest-1431096848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.784s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:29:44 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-00bf1a92-1f0a-4feb-87c2-d8d5d50135dd tempest-VolumesGetTest-1431096848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d60368f4-35ea-4914-be26-47e5737f9639) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3336e9fb-63da-4942-ba65-86eb70a0a3fd', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:29:44 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-00bf1a92-1f0a-4feb-87c2-d8d5d50135dd tempest-VolumesGetTest-1431096848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b83ff51-1ecf-4e0e-90ec-071a5ca4e468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:29:44 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-00bf1a92-1f0a-4feb-87c2-d8d5d50135dd tempest-VolumesGetTest-1431096848 None] Volume volume-3336e9fb-63da-4942-ba65-86eb70a0a3fd (3336e9fb-63da-4942-ba65-86eb70a0a3fd): created successfully Sep 16 20:29:44 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-00bf1a92-1f0a-4feb-87c2-d8d5d50135dd tempest-VolumesGetTest-1431096848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b83ff51-1ecf-4e0e-90ec-071a5ca4e468) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:29:44 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-00bf1a92-1f0a-4feb-87c2-d8d5d50135dd tempest-VolumesGetTest-1431096848 None] Flow 'volume_create_manager' (a24d2ac9-2321-4959-bd04-7feace15efec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:29:44 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-00bf1a92-1f0a-4feb-87c2-d8d5d50135dd tempest-VolumesGetTest-1431096848 None] Created volume successfully. Sep 16 20:29:44 devstack sudo[99763]: pam_unix(sudo:session): session closed for user root Sep 16 20:29:44 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-4d6e8647-593a-4a27-a0bb-3c4b5d39220a tempest-VolumesListTestJSON-1015418202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d8a997cf-36b4-4340-bbb3-c5bb00a506e2" returned: 0 in 0.296s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:29:44 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-4d6e8647-593a-4a27-a0bb-3c4b5d39220a tempest-VolumesListTestJSON-1015418202 None] Lock "cinder-quobyte-d8a997cf-36b4-4340-bbb3-c5bb00a506e2" released by "delete_volume" :: held 0.768s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:29:44 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-4d6e8647-593a-4a27-a0bb-3c4b5d39220a tempest-VolumesListTestJSON-1015418202 None] Created reservations ['c4698c38-54aa-4350-87e2-6069c2fd50e8', '660ee53c-8549-4f40-86cb-2c33461af706', '58dbbacd-6bcb-4b56-82b6-4fb67f2de9e9', '5908fb6d-a641-4076-af8d-7f80b38b3d0c'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:29:44 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-4d6e8647-593a-4a27-a0bb-3c4b5d39220a tempest-VolumesListTestJSON-1015418202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:29:44 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-4d6e8647-593a-4a27-a0bb-3c4b5d39220a tempest-VolumesListTestJSON-1015418202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:29:44 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-4d6e8647-593a-4a27-a0bb-3c4b5d39220a tempest-VolumesListTestJSON-1015418202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:29:44 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-4d6e8647-593a-4a27-a0bb-3c4b5d39220a tempest-VolumesListTestJSON-1015418202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:29:44 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-4d6e8647-593a-4a27-a0bb-3c4b5d39220a tempest-VolumesListTestJSON-1015418202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:29:44 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-4d6e8647-593a-4a27-a0bb-3c4b5d39220a tempest-VolumesListTestJSON-1015418202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:29:44 devstack sudo[99768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:29:44 devstack sudo[99768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:29:44 devstack sudo[99768]: pam_unix(sudo:session): session closed for user root Sep 16 20:29:44 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-4d6e8647-593a-4a27-a0bb-3c4b5d39220a tempest-VolumesListTestJSON-1015418202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.277s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:29:44 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-4d6e8647-593a-4a27-a0bb-3c4b5d39220a tempest-VolumesListTestJSON-1015418202 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:29:44 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-4d6e8647-593a-4a27-a0bb-3c4b5d39220a tempest-VolumesListTestJSON-1015418202 None] Deleted volume successfully. Sep 16 20:29:44 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-4d6e8647-593a-4a27-a0bb-3c4b5d39220a tempest-VolumesListTestJSON-1015418202 None] Lock "cinder-d8a997cf-36b4-4340-bbb3-c5bb00a506e2-delete_volume" released by "delete_volume" :: held 1.252s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:29:46 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-9603c9aa-b53a-48d1-92e3-0386f01fa9fd tempest-VolumesGetTest-1431096848 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:29:46 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-9603c9aa-b53a-48d1-92e3-0386f01fa9fd tempest-VolumesGetTest-1431096848 None] Flow 'volume_create_manager' (770e2af7-9bf6-4654-889f-9b3ccded40f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:29:46 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-9603c9aa-b53a-48d1-92e3-0386f01fa9fd tempest-VolumesGetTest-1431096848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9b72cd3-14ac-40c4-b44d-c1556ae4621d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:29:46 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-9603c9aa-b53a-48d1-92e3-0386f01fa9fd tempest-VolumesGetTest-1431096848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9b72cd3-14ac-40c4-b44d-c1556ae4621d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:29:46Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-932351412',display_name='tempest-VolumesGetTest-Volume-1467213641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0ee7931-d6d1-46b0-8a03-805753f8b357,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f71bf8bb99894f1d87c310177b239798',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:29:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:29:46Z,use_quota=True,user_id='1e0a03b0f86d497299b719cf3b8e51bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:29:46 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-9603c9aa-b53a-48d1-92e3-0386f01fa9fd tempest-VolumesGetTest-1431096848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ef00e10-444c-418d-b41d-b98c848b9b8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:29:46 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-9603c9aa-b53a-48d1-92e3-0386f01fa9fd tempest-VolumesGetTest-1431096848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ef00e10-444c-418d-b41d-b98c848b9b8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:29:46 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-9603c9aa-b53a-48d1-92e3-0386f01fa9fd tempest-VolumesGetTest-1431096848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb877f70-fa59-43de-987f-5fb124ed9a90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:29:46 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-9603c9aa-b53a-48d1-92e3-0386f01fa9fd tempest-VolumesGetTest-1431096848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb877f70-fa59-43de-987f-5fb124ed9a90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0ee7931-d6d1-46b0-8a03-805753f8b357', 'volume_name': 'volume-b0ee7931-d6d1-46b0-8a03-805753f8b357', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:29:46 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-9603c9aa-b53a-48d1-92e3-0386f01fa9fd tempest-VolumesGetTest-1431096848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bd4913f-29f3-4c94-8c6a-f2f6732e423f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:29:46 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-9603c9aa-b53a-48d1-92e3-0386f01fa9fd tempest-VolumesGetTest-1431096848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bd4913f-29f3-4c94-8c6a-f2f6732e423f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:29:46 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-9603c9aa-b53a-48d1-92e3-0386f01fa9fd tempest-VolumesGetTest-1431096848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b4d4bb0-2373-4ef4-a24a-7f88a10ae9db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:29:46 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-9603c9aa-b53a-48d1-92e3-0386f01fa9fd tempest-VolumesGetTest-1431096848 None] Volume b0ee7931-d6d1-46b0-8a03-805753f8b357: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0ee7931-d6d1-46b0-8a03-805753f8b357', 'volume_size': 1} Sep 16 20:29:46 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-9603c9aa-b53a-48d1-92e3-0386f01fa9fd tempest-VolumesGetTest-1431096848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:29:46 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-9603c9aa-b53a-48d1-92e3-0386f01fa9fd tempest-VolumesGetTest-1431096848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:29:46 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-9603c9aa-b53a-48d1-92e3-0386f01fa9fd tempest-VolumesGetTest-1431096848 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:29:46Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-932351412',display_name='tempest-VolumesGetTest-Volume-1467213641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0ee7931-d6d1-46b0-8a03-805753f8b357,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f71bf8bb99894f1d87c310177b239798',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:29:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:29:46Z,use_quota=True,user_id='1e0a03b0f86d497299b719cf3b8e51bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:29:46 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-9603c9aa-b53a-48d1-92e3-0386f01fa9fd tempest-VolumesGetTest-1431096848 None] Creating volume b0ee7931-d6d1-46b0-8a03-805753f8b357 {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:29:46 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-9603c9aa-b53a-48d1-92e3-0386f01fa9fd tempest-VolumesGetTest-1431096848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:29:46 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-9603c9aa-b53a-48d1-92e3-0386f01fa9fd tempest-VolumesGetTest-1431096848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:29:46 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-9603c9aa-b53a-48d1-92e3-0386f01fa9fd tempest-VolumesGetTest-1431096848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:29:46 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-9603c9aa-b53a-48d1-92e3-0386f01fa9fd tempest-VolumesGetTest-1431096848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:29:46 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-9603c9aa-b53a-48d1-92e3-0386f01fa9fd tempest-VolumesGetTest-1431096848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:29:46 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-9603c9aa-b53a-48d1-92e3-0386f01fa9fd tempest-VolumesGetTest-1431096848 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:29:46 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-9603c9aa-b53a-48d1-92e3-0386f01fa9fd tempest-VolumesGetTest-1431096848 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:29:46 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-9603c9aa-b53a-48d1-92e3-0386f01fa9fd tempest-VolumesGetTest-1431096848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b0ee7931-d6d1-46b0-8a03-805753f8b357 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:29:46 devstack sudo[99771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b0ee7931-d6d1-46b0-8a03-805753f8b357 1073741824 Sep 16 20:29:46 devstack sudo[99771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:29:47 devstack sudo[99771]: pam_unix(sudo:session): session closed for user root Sep 16 20:29:47 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-9603c9aa-b53a-48d1-92e3-0386f01fa9fd tempest-VolumesGetTest-1431096848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b0ee7931-d6d1-46b0-8a03-805753f8b357 1073741824" returned: 0 in 0.464s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:29:47 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-9603c9aa-b53a-48d1-92e3-0386f01fa9fd tempest-VolumesGetTest-1431096848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b0ee7931-d6d1-46b0-8a03-805753f8b357 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:29:47 devstack sudo[99776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b0ee7931-d6d1-46b0-8a03-805753f8b357 Sep 16 20:29:47 devstack sudo[99776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:29:47 devstack sudo[99776]: pam_unix(sudo:session): session closed for user root Sep 16 20:29:47 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-9603c9aa-b53a-48d1-92e3-0386f01fa9fd tempest-VolumesGetTest-1431096848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b0ee7931-d6d1-46b0-8a03-805753f8b357" returned: 0 in 0.250s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:29:47 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-9603c9aa-b53a-48d1-92e3-0386f01fa9fd tempest-VolumesGetTest-1431096848 None] <== create_volume: return (760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:29:47 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-9603c9aa-b53a-48d1-92e3-0386f01fa9fd tempest-VolumesGetTest-1431096848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.762s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:29:47 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-9603c9aa-b53a-48d1-92e3-0386f01fa9fd tempest-VolumesGetTest-1431096848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b4d4bb0-2373-4ef4-a24a-7f88a10ae9db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0ee7931-d6d1-46b0-8a03-805753f8b357', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:29:47 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-9603c9aa-b53a-48d1-92e3-0386f01fa9fd tempest-VolumesGetTest-1431096848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ad7935b-840a-4aa5-a4d1-2da42a33d167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:29:47 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-9603c9aa-b53a-48d1-92e3-0386f01fa9fd tempest-VolumesGetTest-1431096848 None] Volume volume-b0ee7931-d6d1-46b0-8a03-805753f8b357 (b0ee7931-d6d1-46b0-8a03-805753f8b357): created successfully Sep 16 20:29:47 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-9603c9aa-b53a-48d1-92e3-0386f01fa9fd tempest-VolumesGetTest-1431096848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ad7935b-840a-4aa5-a4d1-2da42a33d167) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:29:47 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-9603c9aa-b53a-48d1-92e3-0386f01fa9fd tempest-VolumesGetTest-1431096848 None] Flow 'volume_create_manager' (770e2af7-9bf6-4654-889f-9b3ccded40f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:29:47 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-9603c9aa-b53a-48d1-92e3-0386f01fa9fd tempest-VolumesGetTest-1431096848 None] Created volume successfully. Sep 16 20:29:48 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-0fb59605-59a3-44d1-8b3e-1adb7d208a83 tempest-VolumesGetTest-1431096848 None] Acquiring lock "cinder-b0ee7931-d6d1-46b0-8a03-805753f8b357-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:29:48 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-0fb59605-59a3-44d1-8b3e-1adb7d208a83 tempest-VolumesGetTest-1431096848 None] Lock "cinder-b0ee7931-d6d1-46b0-8a03-805753f8b357-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:29:48 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-0fb59605-59a3-44d1-8b3e-1adb7d208a83 tempest-VolumesGetTest-1431096848 None] Acquiring lock "cinder-quobyte-b0ee7931-d6d1-46b0-8a03-805753f8b357" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:29:48 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-0fb59605-59a3-44d1-8b3e-1adb7d208a83 tempest-VolumesGetTest-1431096848 None] Lock "cinder-quobyte-b0ee7931-d6d1-46b0-8a03-805753f8b357" acquired by "delete_volume" :: waited 0.016s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:29:48 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[f487a421-ad8d-46ae-ab86-b942dfdf3ef8]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:29:48 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-0fb59605-59a3-44d1-8b3e-1adb7d208a83 tempest-VolumesGetTest-1431096848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b0ee7931-d6d1-46b0-8a03-805753f8b357 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:29:49 devstack sudo[99782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b0ee7931-d6d1-46b0-8a03-805753f8b357 Sep 16 20:29:49 devstack sudo[99782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:29:49 devstack sudo[99782]: pam_unix(sudo:session): session closed for user root Sep 16 20:29:49 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-0fb59605-59a3-44d1-8b3e-1adb7d208a83 tempest-VolumesGetTest-1431096848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b0ee7931-d6d1-46b0-8a03-805753f8b357" returned: 0 in 0.440s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:29:49 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-0fb59605-59a3-44d1-8b3e-1adb7d208a83 tempest-VolumesGetTest-1431096848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b0ee7931-d6d1-46b0-8a03-805753f8b357 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:29:49 devstack sudo[99790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b0ee7931-d6d1-46b0-8a03-805753f8b357 Sep 16 20:29:49 devstack sudo[99790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:29:49 devstack sudo[99790]: pam_unix(sudo:session): session closed for user root Sep 16 20:29:49 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-0fb59605-59a3-44d1-8b3e-1adb7d208a83 tempest-VolumesGetTest-1431096848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b0ee7931-d6d1-46b0-8a03-805753f8b357" returned: 0 in 0.325s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:29:49 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-0fb59605-59a3-44d1-8b3e-1adb7d208a83 tempest-VolumesGetTest-1431096848 None] Lock "cinder-quobyte-b0ee7931-d6d1-46b0-8a03-805753f8b357" released by "delete_volume" :: held 0.818s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:29:49 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-0fb59605-59a3-44d1-8b3e-1adb7d208a83 tempest-VolumesGetTest-1431096848 None] Created reservations ['8771b23a-1ecc-446c-9420-03a22f0b7928', '9fd18c62-ecaf-4b47-b360-c22394eb83e8', '3dcc0da2-465d-4116-859a-09d913d1b01c', '1cf06f6d-6871-428e-b4d2-69bb53f1c744'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:29:49 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-0fb59605-59a3-44d1-8b3e-1adb7d208a83 tempest-VolumesGetTest-1431096848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:29:49 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-0fb59605-59a3-44d1-8b3e-1adb7d208a83 tempest-VolumesGetTest-1431096848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:29:49 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-0fb59605-59a3-44d1-8b3e-1adb7d208a83 tempest-VolumesGetTest-1431096848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:29:49 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-0fb59605-59a3-44d1-8b3e-1adb7d208a83 tempest-VolumesGetTest-1431096848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:29:49 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-0fb59605-59a3-44d1-8b3e-1adb7d208a83 tempest-VolumesGetTest-1431096848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:29:49 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-0fb59605-59a3-44d1-8b3e-1adb7d208a83 tempest-VolumesGetTest-1431096848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:29:49 devstack sudo[99803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:29:49 devstack sudo[99803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:29:50 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-0085d05a-a406-41cc-9ebb-646be21414fb tempest-VolumesGetTest-1431096848 None] Acquiring lock "cinder-3336e9fb-63da-4942-ba65-86eb70a0a3fd-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:29:50 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-0085d05a-a406-41cc-9ebb-646be21414fb tempest-VolumesGetTest-1431096848 None] Lock "cinder-3336e9fb-63da-4942-ba65-86eb70a0a3fd-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:29:50 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-0085d05a-a406-41cc-9ebb-646be21414fb tempest-VolumesGetTest-1431096848 None] Acquiring lock "cinder-quobyte-3336e9fb-63da-4942-ba65-86eb70a0a3fd" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:29:50 devstack sudo[99803]: pam_unix(sudo:session): session closed for user root Sep 16 20:29:50 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-0fb59605-59a3-44d1-8b3e-1adb7d208a83 tempest-VolumesGetTest-1431096848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.344s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:29:50 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-0fb59605-59a3-44d1-8b3e-1adb7d208a83 tempest-VolumesGetTest-1431096848 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:29:50 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-0085d05a-a406-41cc-9ebb-646be21414fb tempest-VolumesGetTest-1431096848 None] Lock "cinder-quobyte-3336e9fb-63da-4942-ba65-86eb70a0a3fd" acquired by "delete_volume" :: waited 0.021s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:29:50 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-0fb59605-59a3-44d1-8b3e-1adb7d208a83 tempest-VolumesGetTest-1431096848 None] Deleted volume successfully. Sep 16 20:29:50 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-0fb59605-59a3-44d1-8b3e-1adb7d208a83 tempest-VolumesGetTest-1431096848 None] Lock "cinder-b0ee7931-d6d1-46b0-8a03-805753f8b357-delete_volume" released by "delete_volume" :: held 1.425s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:29:50 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6f2b497-e3bf-484e-ac7f-8689a6d2993f]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:29:50 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-0085d05a-a406-41cc-9ebb-646be21414fb tempest-VolumesGetTest-1431096848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-3336e9fb-63da-4942-ba65-86eb70a0a3fd {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:29:50 devstack sudo[99806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-3336e9fb-63da-4942-ba65-86eb70a0a3fd Sep 16 20:29:50 devstack sudo[99806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:29:50 devstack sudo[99806]: pam_unix(sudo:session): session closed for user root Sep 16 20:29:50 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-0085d05a-a406-41cc-9ebb-646be21414fb tempest-VolumesGetTest-1431096848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-3336e9fb-63da-4942-ba65-86eb70a0a3fd" returned: 0 in 0.390s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:29:50 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-0085d05a-a406-41cc-9ebb-646be21414fb tempest-VolumesGetTest-1431096848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-3336e9fb-63da-4942-ba65-86eb70a0a3fd {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:29:50 devstack sudo[99835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-3336e9fb-63da-4942-ba65-86eb70a0a3fd Sep 16 20:29:50 devstack sudo[99835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:29:50 devstack sudo[99835]: pam_unix(sudo:session): session closed for user root Sep 16 20:29:50 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-0085d05a-a406-41cc-9ebb-646be21414fb tempest-VolumesGetTest-1431096848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-3336e9fb-63da-4942-ba65-86eb70a0a3fd" returned: 0 in 0.293s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:29:50 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-0085d05a-a406-41cc-9ebb-646be21414fb tempest-VolumesGetTest-1431096848 None] Lock "cinder-quobyte-3336e9fb-63da-4942-ba65-86eb70a0a3fd" released by "delete_volume" :: held 0.755s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:29:50 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-0085d05a-a406-41cc-9ebb-646be21414fb tempest-VolumesGetTest-1431096848 None] Created reservations ['fbd748c1-357b-41a9-964d-99ef257a6650', 'dac45441-b33c-45d7-b360-af1c1235f54d', 'f2551b75-fc5f-4760-89ca-d0a8bbd2b9f5', '972c0058-2045-489b-ba09-68b10e10ff10'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:29:51 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-0085d05a-a406-41cc-9ebb-646be21414fb tempest-VolumesGetTest-1431096848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:29:51 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-0085d05a-a406-41cc-9ebb-646be21414fb tempest-VolumesGetTest-1431096848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:29:51 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-0085d05a-a406-41cc-9ebb-646be21414fb tempest-VolumesGetTest-1431096848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:29:51 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-0085d05a-a406-41cc-9ebb-646be21414fb tempest-VolumesGetTest-1431096848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:29:51 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-0085d05a-a406-41cc-9ebb-646be21414fb tempest-VolumesGetTest-1431096848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:29:51 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-0085d05a-a406-41cc-9ebb-646be21414fb tempest-VolumesGetTest-1431096848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:29:51 devstack sudo[99838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:29:51 devstack sudo[99838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:29:51 devstack sudo[99838]: pam_unix(sudo:session): session closed for user root Sep 16 20:29:51 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-0085d05a-a406-41cc-9ebb-646be21414fb tempest-VolumesGetTest-1431096848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.249s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:29:51 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-0085d05a-a406-41cc-9ebb-646be21414fb tempest-VolumesGetTest-1431096848 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:29:51 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-0085d05a-a406-41cc-9ebb-646be21414fb tempest-VolumesGetTest-1431096848 None] Deleted volume successfully. Sep 16 20:29:51 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-0085d05a-a406-41cc-9ebb-646be21414fb tempest-VolumesGetTest-1431096848 None] Lock "cinder-3336e9fb-63da-4942-ba65-86eb70a0a3fd-delete_volume" released by "delete_volume" :: held 1.256s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:29:51 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b76d843-dbdf-40c3-be2b-92b7759fc4b9 tempest-VolumesGetTest-1431096848 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:29:51 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-2b76d843-dbdf-40c3-be2b-92b7759fc4b9 tempest-VolumesGetTest-1431096848 None] Flow 'volume_create_manager' (ca0d9c0e-ca99-4f4d-9a6e-72d3420e978d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:29:51 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-2b76d843-dbdf-40c3-be2b-92b7759fc4b9 tempest-VolumesGetTest-1431096848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e83f7844-ee13-4e23-8594-770bc7719704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:29:51 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-2b76d843-dbdf-40c3-be2b-92b7759fc4b9 tempest-VolumesGetTest-1431096848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e83f7844-ee13-4e23-8594-770bc7719704) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:29:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-648004049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a212e3b8-b8ec-455f-a5ca-3a2229830050,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f71bf8bb99894f1d87c310177b239798',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:29:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:29:52Z,use_quota=True,user_id='1e0a03b0f86d497299b719cf3b8e51bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:29:51 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-2b76d843-dbdf-40c3-be2b-92b7759fc4b9 tempest-VolumesGetTest-1431096848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37ba2f3a-d13d-43c6-a193-ba46bf555d8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:29:51 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-2b76d843-dbdf-40c3-be2b-92b7759fc4b9 tempest-VolumesGetTest-1431096848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37ba2f3a-d13d-43c6-a193-ba46bf555d8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:29:51 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-2b76d843-dbdf-40c3-be2b-92b7759fc4b9 tempest-VolumesGetTest-1431096848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (471e31ab-a018-4879-ab0c-c6fbfa8f6849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:29:51 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-2b76d843-dbdf-40c3-be2b-92b7759fc4b9 tempest-VolumesGetTest-1431096848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (471e31ab-a018-4879-ab0c-c6fbfa8f6849) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a212e3b8-b8ec-455f-a5ca-3a2229830050', 'volume_name': 'volume-a212e3b8-b8ec-455f-a5ca-3a2229830050', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:29:51 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-2b76d843-dbdf-40c3-be2b-92b7759fc4b9 tempest-VolumesGetTest-1431096848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bcf2fd4-2457-420b-bb41-b6dad4fb54e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:29:51 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-2b76d843-dbdf-40c3-be2b-92b7759fc4b9 tempest-VolumesGetTest-1431096848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bcf2fd4-2457-420b-bb41-b6dad4fb54e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:29:51 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-2b76d843-dbdf-40c3-be2b-92b7759fc4b9 tempest-VolumesGetTest-1431096848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba5c3462-16be-401d-a8f5-31af9492deba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:29:51 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-2b76d843-dbdf-40c3-be2b-92b7759fc4b9 tempest-VolumesGetTest-1431096848 None] Volume a212e3b8-b8ec-455f-a5ca-3a2229830050: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a212e3b8-b8ec-455f-a5ca-3a2229830050', 'volume_size': 1} Sep 16 20:29:51 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-2b76d843-dbdf-40c3-be2b-92b7759fc4b9 tempest-VolumesGetTest-1431096848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:29:51 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-2b76d843-dbdf-40c3-be2b-92b7759fc4b9 tempest-VolumesGetTest-1431096848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:29:51 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-2b76d843-dbdf-40c3-be2b-92b7759fc4b9 tempest-VolumesGetTest-1431096848 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:29:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-648004049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a212e3b8-b8ec-455f-a5ca-3a2229830050,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f71bf8bb99894f1d87c310177b239798',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:29:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:29:52Z,use_quota=True,user_id='1e0a03b0f86d497299b719cf3b8e51bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:29:51 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-2b76d843-dbdf-40c3-be2b-92b7759fc4b9 tempest-VolumesGetTest-1431096848 None] Creating volume a212e3b8-b8ec-455f-a5ca-3a2229830050 {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:29:51 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-2b76d843-dbdf-40c3-be2b-92b7759fc4b9 tempest-VolumesGetTest-1431096848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:29:51 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-2b76d843-dbdf-40c3-be2b-92b7759fc4b9 tempest-VolumesGetTest-1431096848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:29:51 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-2b76d843-dbdf-40c3-be2b-92b7759fc4b9 tempest-VolumesGetTest-1431096848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:29:51 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-2b76d843-dbdf-40c3-be2b-92b7759fc4b9 tempest-VolumesGetTest-1431096848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:29:51 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-2b76d843-dbdf-40c3-be2b-92b7759fc4b9 tempest-VolumesGetTest-1431096848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:29:51 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-2b76d843-dbdf-40c3-be2b-92b7759fc4b9 tempest-VolumesGetTest-1431096848 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:29:51 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-2b76d843-dbdf-40c3-be2b-92b7759fc4b9 tempest-VolumesGetTest-1431096848 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:29:51 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-2b76d843-dbdf-40c3-be2b-92b7759fc4b9 tempest-VolumesGetTest-1431096848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a212e3b8-b8ec-455f-a5ca-3a2229830050 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:29:51 devstack sudo[99841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a212e3b8-b8ec-455f-a5ca-3a2229830050 1073741824 Sep 16 20:29:51 devstack sudo[99841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:29:52 devstack sudo[99841]: pam_unix(sudo:session): session closed for user root Sep 16 20:29:52 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-2b76d843-dbdf-40c3-be2b-92b7759fc4b9 tempest-VolumesGetTest-1431096848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a212e3b8-b8ec-455f-a5ca-3a2229830050 1073741824" returned: 0 in 0.516s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:29:52 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-2b76d843-dbdf-40c3-be2b-92b7759fc4b9 tempest-VolumesGetTest-1431096848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a212e3b8-b8ec-455f-a5ca-3a2229830050 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:29:52 devstack sudo[99847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a212e3b8-b8ec-455f-a5ca-3a2229830050 Sep 16 20:29:52 devstack sudo[99847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:29:52 devstack sudo[99847]: pam_unix(sudo:session): session closed for user root Sep 16 20:29:52 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-2b76d843-dbdf-40c3-be2b-92b7759fc4b9 tempest-VolumesGetTest-1431096848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a212e3b8-b8ec-455f-a5ca-3a2229830050" returned: 0 in 0.276s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:29:52 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-2b76d843-dbdf-40c3-be2b-92b7759fc4b9 tempest-VolumesGetTest-1431096848 None] <== create_volume: return (839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:29:52 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-2b76d843-dbdf-40c3-be2b-92b7759fc4b9 tempest-VolumesGetTest-1431096848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.843s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:29:52 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-2b76d843-dbdf-40c3-be2b-92b7759fc4b9 tempest-VolumesGetTest-1431096848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba5c3462-16be-401d-a8f5-31af9492deba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a212e3b8-b8ec-455f-a5ca-3a2229830050', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:29:52 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-2b76d843-dbdf-40c3-be2b-92b7759fc4b9 tempest-VolumesGetTest-1431096848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86e5ac03-9934-4db2-a56a-5a68278c64a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:29:52 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-2b76d843-dbdf-40c3-be2b-92b7759fc4b9 tempest-VolumesGetTest-1431096848 None] Volume volume-a212e3b8-b8ec-455f-a5ca-3a2229830050 (a212e3b8-b8ec-455f-a5ca-3a2229830050): created successfully Sep 16 20:29:52 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-2b76d843-dbdf-40c3-be2b-92b7759fc4b9 tempest-VolumesGetTest-1431096848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86e5ac03-9934-4db2-a56a-5a68278c64a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:29:52 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-2b76d843-dbdf-40c3-be2b-92b7759fc4b9 tempest-VolumesGetTest-1431096848 None] Flow 'volume_create_manager' (ca0d9c0e-ca99-4f4d-9a6e-72d3420e978d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:29:52 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-2b76d843-dbdf-40c3-be2b-92b7759fc4b9 tempest-VolumesGetTest-1431096848 None] Created volume successfully. Sep 16 20:29:53 devstack cinder-volume[86188]: DEBUG oslo_service.periodic_task [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86188) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 20:29:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:29:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:29:53 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:29:53 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:29:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:29:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:29:53 devstack sudo[99850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:29:53 devstack sudo[99850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:29:53 devstack sudo[99850]: pam_unix(sudo:session): session closed for user root Sep 16 20:29:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.260s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:29:53 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:29:53 devstack cinder-volume[86188]: DEBUG oslo_service.periodic_task [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Running periodic task VolumeManager._thread_info {{(pid=86188) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 20:29:53 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] thread count: 28 {{(pid=86188) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 16 20:29:53 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] thread info: [<_MainThread(MainThread, started 139858124406912)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86188) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 16 20:29:54 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6198191-1bbb-440e-8028-29b4ce17e4ff tempest-VolumesGetTest-1431096848 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:29:54 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a6198191-1bbb-440e-8028-29b4ce17e4ff tempest-VolumesGetTest-1431096848 None] Flow 'volume_create_manager' (53528f9f-bd70-4818-88f0-bf269967a09b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:29:54 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a6198191-1bbb-440e-8028-29b4ce17e4ff tempest-VolumesGetTest-1431096848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb74c98c-4048-46d5-95cc-309549350a26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:29:54 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a6198191-1bbb-440e-8028-29b4ce17e4ff tempest-VolumesGetTest-1431096848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb74c98c-4048-46d5-95cc-309549350a26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:29:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1906941311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c624a00e-f46b-4cdc-846c-3aa56bc972b4,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f71bf8bb99894f1d87c310177b239798',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:29:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=a212e3b8-b8ec-455f-a5ca-3a2229830050,status='creating',terminated_at=None,updated_at=2026-09-16T18:29:54Z,use_quota=True,user_id='1e0a03b0f86d497299b719cf3b8e51bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:29:54 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a6198191-1bbb-440e-8028-29b4ce17e4ff tempest-VolumesGetTest-1431096848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3074a51a-2f9c-4d72-b908-f739aa69d75b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:29:54 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a6198191-1bbb-440e-8028-29b4ce17e4ff tempest-VolumesGetTest-1431096848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3074a51a-2f9c-4d72-b908-f739aa69d75b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:29:54 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a6198191-1bbb-440e-8028-29b4ce17e4ff tempest-VolumesGetTest-1431096848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfa84851-7251-4360-aade-f153d0a768f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:29:54 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a6198191-1bbb-440e-8028-29b4ce17e4ff tempest-VolumesGetTest-1431096848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfa84851-7251-4360-aade-f153d0a768f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'c624a00e-f46b-4cdc-846c-3aa56bc972b4', 'volume_name': 'volume-c624a00e-f46b-4cdc-846c-3aa56bc972b4', 'volume_size': 1, 'source_volid': 'a212e3b8-b8ec-455f-a5ca-3a2229830050', 'source_volstatus': 'available'}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:29:54 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a6198191-1bbb-440e-8028-29b4ce17e4ff tempest-VolumesGetTest-1431096848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74af6fdb-7930-48ea-991c-8d7b92600f56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:29:54 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a6198191-1bbb-440e-8028-29b4ce17e4ff tempest-VolumesGetTest-1431096848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74af6fdb-7930-48ea-991c-8d7b92600f56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:29:54 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a6198191-1bbb-440e-8028-29b4ce17e4ff tempest-VolumesGetTest-1431096848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13c0cf11-2a08-49b5-a63c-f54aa3d0e413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:29:54 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-a6198191-1bbb-440e-8028-29b4ce17e4ff tempest-VolumesGetTest-1431096848 None] Volume c624a00e-f46b-4cdc-846c-3aa56bc972b4: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-c624a00e-f46b-4cdc-846c-3aa56bc972b4', 'volume_size': 1, 'source_volid': 'a212e3b8-b8ec-455f-a5ca-3a2229830050', 'source_volstatus': 'available'} Sep 16 20:29:54 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a6198191-1bbb-440e-8028-29b4ce17e4ff tempest-VolumesGetTest-1431096848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:29:54 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a6198191-1bbb-440e-8028-29b4ce17e4ff tempest-VolumesGetTest-1431096848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:29:54 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-a6198191-1bbb-440e-8028-29b4ce17e4ff tempest-VolumesGetTest-1431096848 None] Cloning volume a212e3b8-b8ec-455f-a5ca-3a2229830050 to volume c624a00e-f46b-4cdc-846c-3aa56bc972b4 Sep 16 20:29:54 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-a6198191-1bbb-440e-8028-29b4ce17e4ff tempest-VolumesGetTest-1431096848 None] Creating offline snapshot b56b4720-ae51-4b78-b60b-c898560964ab of volume a212e3b8-b8ec-455f-a5ca-3a2229830050 {{(pid=86188) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 20:29:54 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[9783887d-4459-4dff-8e45-ab761261d0b3]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:29:54 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a6198191-1bbb-440e-8028-29b4ce17e4ff tempest-VolumesGetTest-1431096848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a212e3b8-b8ec-455f-a5ca-3a2229830050 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:29:54 devstack sudo[99853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a212e3b8-b8ec-455f-a5ca-3a2229830050 Sep 16 20:29:54 devstack sudo[99853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:29:55 devstack sudo[99853]: pam_unix(sudo:session): session closed for user root Sep 16 20:29:55 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a6198191-1bbb-440e-8028-29b4ce17e4ff tempest-VolumesGetTest-1431096848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a212e3b8-b8ec-455f-a5ca-3a2229830050" returned: 0 in 0.380s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:29:55 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a6198191-1bbb-440e-8028-29b4ce17e4ff tempest-VolumesGetTest-1431096848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a212e3b8-b8ec-455f-a5ca-3a2229830050,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a212e3b8-b8ec-455f-a5ca-3a2229830050.b56b4720-ae51-4b78-b60b-c898560964ab 1G {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:29:55 devstack sudo[99858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a212e3b8-b8ec-455f-a5ca-3a2229830050,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a212e3b8-b8ec-455f-a5ca-3a2229830050.b56b4720-ae51-4b78-b60b-c898560964ab 1G Sep 16 20:29:55 devstack sudo[99858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:29:55 devstack sudo[99858]: pam_unix(sudo:session): session closed for user root Sep 16 20:29:55 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a6198191-1bbb-440e-8028-29b4ce17e4ff tempest-VolumesGetTest-1431096848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a212e3b8-b8ec-455f-a5ca-3a2229830050,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a212e3b8-b8ec-455f-a5ca-3a2229830050.b56b4720-ae51-4b78-b60b-c898560964ab 1G" returned: 0 in 0.566s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:29:55 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a6198191-1bbb-440e-8028-29b4ce17e4ff tempest-VolumesGetTest-1431096848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a212e3b8-b8ec-455f-a5ca-3a2229830050 -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a212e3b8-b8ec-455f-a5ca-3a2229830050.b56b4720-ae51-4b78-b60b-c898560964ab {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:29:55 devstack sudo[99864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a212e3b8-b8ec-455f-a5ca-3a2229830050 -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a212e3b8-b8ec-455f-a5ca-3a2229830050.b56b4720-ae51-4b78-b60b-c898560964ab Sep 16 20:29:55 devstack sudo[99864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:29:55 devstack sudo[99864]: pam_unix(sudo:session): session closed for user root Sep 16 20:29:55 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a6198191-1bbb-440e-8028-29b4ce17e4ff tempest-VolumesGetTest-1431096848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a212e3b8-b8ec-455f-a5ca-3a2229830050 -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a212e3b8-b8ec-455f-a5ca-3a2229830050.b56b4720-ae51-4b78-b60b-c898560964ab" returned: 0 in 0.388s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:29:55 devstack cinder-volume[86188]: WARNING cinder.volume.drivers.remotefs [None req-a6198191-1bbb-440e-8028-29b4ce17e4ff tempest-VolumesGetTest-1431096848 None] /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a212e3b8-b8ec-455f-a5ca-3a2229830050.b56b4720-ae51-4b78-b60b-c898560964ab is being set with open permissions: ugo+rw Sep 16 20:29:55 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a6198191-1bbb-440e-8028-29b4ce17e4ff tempest-VolumesGetTest-1431096848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a212e3b8-b8ec-455f-a5ca-3a2229830050.b56b4720-ae51-4b78-b60b-c898560964ab {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:29:56 devstack sudo[99870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a212e3b8-b8ec-455f-a5ca-3a2229830050.b56b4720-ae51-4b78-b60b-c898560964ab Sep 16 20:29:56 devstack sudo[99870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:29:56 devstack sudo[99870]: pam_unix(sudo:session): session closed for user root Sep 16 20:29:56 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a6198191-1bbb-440e-8028-29b4ce17e4ff tempest-VolumesGetTest-1431096848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a212e3b8-b8ec-455f-a5ca-3a2229830050.b56b4720-ae51-4b78-b60b-c898560964ab" returned: 0 in 0.277s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:29:56 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a6198191-1bbb-440e-8028-29b4ce17e4ff tempest-VolumesGetTest-1431096848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a212e3b8-b8ec-455f-a5ca-3a2229830050.info {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:29:56 devstack sudo[99873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a212e3b8-b8ec-455f-a5ca-3a2229830050.info Sep 16 20:29:56 devstack sudo[99873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:29:56 devstack sudo[99873]: pam_unix(sudo:session): session closed for user root Sep 16 20:29:56 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a6198191-1bbb-440e-8028-29b4ce17e4ff tempest-VolumesGetTest-1431096848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a212e3b8-b8ec-455f-a5ca-3a2229830050.info" returned: 0 in 0.261s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:29:56 devstack cinder-volume[86188]: WARNING cinder.volume.drivers.remotefs [None req-a6198191-1bbb-440e-8028-29b4ce17e4ff tempest-VolumesGetTest-1431096848 None] /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a212e3b8-b8ec-455f-a5ca-3a2229830050.info is being set with open permissions: ugo+rw Sep 16 20:29:56 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a6198191-1bbb-440e-8028-29b4ce17e4ff tempest-VolumesGetTest-1431096848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a212e3b8-b8ec-455f-a5ca-3a2229830050.info {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:29:56 devstack sudo[99881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a212e3b8-b8ec-455f-a5ca-3a2229830050.info Sep 16 20:29:56 devstack sudo[99881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:29:56 devstack sudo[99881]: pam_unix(sudo:session): session closed for user root Sep 16 20:29:56 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a6198191-1bbb-440e-8028-29b4ce17e4ff tempest-VolumesGetTest-1431096848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a212e3b8-b8ec-455f-a5ca-3a2229830050.info" returned: 0 in 0.316s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:29:56 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-a6198191-1bbb-440e-8028-29b4ce17e4ff tempest-VolumesGetTest-1431096848 None] Acquiring lock "cinder-quobyte-c624a00e-f46b-4cdc-846c-3aa56bc972b4" by "_copy_volume_from_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:29:56 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-a6198191-1bbb-440e-8028-29b4ce17e4ff tempest-VolumesGetTest-1431096848 None] Lock "cinder-quobyte-c624a00e-f46b-4cdc-846c-3aa56bc972b4" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:29:56 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-a6198191-1bbb-440e-8028-29b4ce17e4ff tempest-VolumesGetTest-1431096848 None] snapshot: b56b4720-ae51-4b78-b60b-c898560964ab, volume: c624a00e-f46b-4cdc-846c-3aa56bc972b4, {{(pid=86188) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 16 20:29:56 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a6198191-1bbb-440e-8028-29b4ce17e4ff tempest-VolumesGetTest-1431096848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:29:56 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a6198191-1bbb-440e-8028-29b4ce17e4ff tempest-VolumesGetTest-1431096848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:29:56 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-a6198191-1bbb-440e-8028-29b4ce17e4ff tempest-VolumesGetTest-1431096848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:29:56 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-a6198191-1bbb-440e-8028-29b4ce17e4ff tempest-VolumesGetTest-1431096848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:29:56 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a6198191-1bbb-440e-8028-29b4ce17e4ff tempest-VolumesGetTest-1431096848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:29:56 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[99808f38-5427-4fbb-ad29-1ff02d6a4e50]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:29:56 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a6198191-1bbb-440e-8028-29b4ce17e4ff tempest-VolumesGetTest-1431096848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a212e3b8-b8ec-455f-a5ca-3a2229830050.b56b4720-ae51-4b78-b60b-c898560964ab {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:29:57 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0b7bca2-51d8-40a0-832e-7ce2abaf2269 tempest-VolumesSnapshotTestJSON-982820329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:29:57 devstack sudo[99913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a212e3b8-b8ec-455f-a5ca-3a2229830050.b56b4720-ae51-4b78-b60b-c898560964ab Sep 16 20:29:57 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f0b7bca2-51d8-40a0-832e-7ce2abaf2269 tempest-VolumesSnapshotTestJSON-982820329 None] Flow 'volume_create_manager' (4045ebfe-898f-449f-9bb8-eacc9c53373f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:29:57 devstack sudo[99913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:29:57 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f0b7bca2-51d8-40a0-832e-7ce2abaf2269 tempest-VolumesSnapshotTestJSON-982820329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba04fa64-c603-40fb-b2ec-f0cc5b9ac37b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:29:57 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f0b7bca2-51d8-40a0-832e-7ce2abaf2269 tempest-VolumesSnapshotTestJSON-982820329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba04fa64-c603-40fb-b2ec-f0cc5b9ac37b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:29:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-306008941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=189aa1f5-b1d4-4b5e-a266-32b37558f6f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b14473e8191340baa0f17e6030fae9fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:29:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:29:57Z,use_quota=True,user_id='02d8e75db6aa44c9b5660aa9226f8e20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:29:57 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f0b7bca2-51d8-40a0-832e-7ce2abaf2269 tempest-VolumesSnapshotTestJSON-982820329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff80f27a-5ae6-46b7-97e8-603e91a70666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:29:57 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f0b7bca2-51d8-40a0-832e-7ce2abaf2269 tempest-VolumesSnapshotTestJSON-982820329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff80f27a-5ae6-46b7-97e8-603e91a70666) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:29:57 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f0b7bca2-51d8-40a0-832e-7ce2abaf2269 tempest-VolumesSnapshotTestJSON-982820329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dc957a5-6dd9-4802-acca-a816e1e7c6ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:29:57 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f0b7bca2-51d8-40a0-832e-7ce2abaf2269 tempest-VolumesSnapshotTestJSON-982820329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dc957a5-6dd9-4802-acca-a816e1e7c6ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '189aa1f5-b1d4-4b5e-a266-32b37558f6f1', 'volume_name': 'volume-189aa1f5-b1d4-4b5e-a266-32b37558f6f1', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:29:57 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f0b7bca2-51d8-40a0-832e-7ce2abaf2269 tempest-VolumesSnapshotTestJSON-982820329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20b8bdac-a1c1-4c3a-b187-c7746b468a3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:29:57 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f0b7bca2-51d8-40a0-832e-7ce2abaf2269 tempest-VolumesSnapshotTestJSON-982820329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20b8bdac-a1c1-4c3a-b187-c7746b468a3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:29:57 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f0b7bca2-51d8-40a0-832e-7ce2abaf2269 tempest-VolumesSnapshotTestJSON-982820329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2f724a5-0d6d-4f06-8add-a8148e2137dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:29:57 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-f0b7bca2-51d8-40a0-832e-7ce2abaf2269 tempest-VolumesSnapshotTestJSON-982820329 None] Volume 189aa1f5-b1d4-4b5e-a266-32b37558f6f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-189aa1f5-b1d4-4b5e-a266-32b37558f6f1', 'volume_size': 1} Sep 16 20:29:57 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-f0b7bca2-51d8-40a0-832e-7ce2abaf2269 tempest-VolumesSnapshotTestJSON-982820329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:29:57 devstack sudo[99913]: pam_unix(sudo:session): session closed for user root Sep 16 20:29:57 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a6198191-1bbb-440e-8028-29b4ce17e4ff tempest-VolumesGetTest-1431096848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a212e3b8-b8ec-455f-a5ca-3a2229830050.b56b4720-ae51-4b78-b60b-c898560964ab" returned: 0 in 0.419s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:29:57 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-a6198191-1bbb-440e-8028-29b4ce17e4ff tempest-VolumesGetTest-1431096848 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a212e3b8-b8ec-455f-a5ca-3a2229830050(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86188) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 20:29:57 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[392968ed-2a6b-466c-ab0f-87acaeb257e1]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:29:57 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a6198191-1bbb-440e-8028-29b4ce17e4ff tempest-VolumesGetTest-1431096848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a212e3b8-b8ec-455f-a5ca-3a2229830050 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:29:57 devstack sudo[99920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a212e3b8-b8ec-455f-a5ca-3a2229830050 Sep 16 20:29:57 devstack sudo[99920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:29:57 devstack sudo[99920]: pam_unix(sudo:session): session closed for user root Sep 16 20:29:57 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a6198191-1bbb-440e-8028-29b4ce17e4ff tempest-VolumesGetTest-1431096848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a212e3b8-b8ec-455f-a5ca-3a2229830050" returned: 0 in 0.372s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:29:57 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-a6198191-1bbb-440e-8028-29b4ce17e4ff tempest-VolumesGetTest-1431096848 None] will copy from snapshot at /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a212e3b8-b8ec-455f-a5ca-3a2229830050 {{(pid=86188) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 16 20:29:57 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-a6198191-1bbb-440e-8028-29b4ce17e4ff tempest-VolumesGetTest-1431096848 None] Creating direct copy from snapshot {{(pid=86188) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 16 20:29:57 devstack cinder-volume[86188]: DEBUG cinder.utils [None req-a6198191-1bbb-440e-8028-29b4ce17e4ff tempest-VolumesGetTest-1431096848 None] Path /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c624a00e-f46b-4cdc-846c-3aa56bc972b4 not found in is_blk_device check {{(pid=86188) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 16 20:29:57 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a6198191-1bbb-440e-8028-29b4ce17e4ff tempest-VolumesGetTest-1431096848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a212e3b8-b8ec-455f-a5ca-3a2229830050 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c624a00e-f46b-4cdc-846c-3aa56bc972b4 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:29:57 devstack sudo[99931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a212e3b8-b8ec-455f-a5ca-3a2229830050 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c624a00e-f46b-4cdc-846c-3aa56bc972b4 Sep 16 20:29:57 devstack sudo[99931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:30:02 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [req-3a60aabf-c016-447a-bffd-0b9462b33b30 req-66a57e7b-0bec-460e-aac2-7aa2ed65adfd tempest-TestInstancesWithCinderVolumes-1553461958 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:30:04 devstack sudo[99931]: pam_unix(sudo:session): session closed for user root Sep 16 20:30:04 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a6198191-1bbb-440e-8028-29b4ce17e4ff tempest-VolumesGetTest-1431096848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a212e3b8-b8ec-455f-a5ca-3a2229830050 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c624a00e-f46b-4cdc-846c-3aa56bc972b4" returned: 0 in 6.241s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:30:04 devstack cinder-volume[86188]: DEBUG cinder.image.image_utils [None req-a6198191-1bbb-440e-8028-29b4ce17e4ff tempest-VolumesGetTest-1431096848 None] Image conversion details: src /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a212e3b8-b8ec-455f-a5ca-3a2229830050, size 1024.00 MB, duration 6.24 sec, destination /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c624a00e-f46b-4cdc-846c-3aa56bc972b4 {{(pid=86188) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 16 20:30:04 devstack cinder-volume[86188]: INFO cinder.image.image_utils [None req-a6198191-1bbb-440e-8028-29b4ce17e4ff tempest-VolumesGetTest-1431096848 None] Converted 1024.00 MB image at 164.06 MB/s Sep 16 20:30:04 devstack cinder-volume[86188]: WARNING cinder.volume.drivers.remotefs [None req-a6198191-1bbb-440e-8028-29b4ce17e4ff tempest-VolumesGetTest-1431096848 None] /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c624a00e-f46b-4cdc-846c-3aa56bc972b4 is being set with open permissions: ugo+rw Sep 16 20:30:04 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a6198191-1bbb-440e-8028-29b4ce17e4ff tempest-VolumesGetTest-1431096848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c624a00e-f46b-4cdc-846c-3aa56bc972b4 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:30:04 devstack sudo[99962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c624a00e-f46b-4cdc-846c-3aa56bc972b4 Sep 16 20:30:04 devstack sudo[99962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:30:04 devstack sudo[99962]: pam_unix(sudo:session): session closed for user root Sep 16 20:30:04 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a6198191-1bbb-440e-8028-29b4ce17e4ff tempest-VolumesGetTest-1431096848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c624a00e-f46b-4cdc-846c-3aa56bc972b4" returned: 0 in 0.235s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:30:04 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-a6198191-1bbb-440e-8028-29b4ce17e4ff tempest-VolumesGetTest-1431096848 None] Lock "cinder-quobyte-c624a00e-f46b-4cdc-846c-3aa56bc972b4" released by "_copy_volume_from_snapshot" :: held 7.345s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:30:04 devstack cinder-volume[86188]: DEBUG dbcounter [-] [86188] Writing DB stats cinder:UPDATE=96,cinder:SELECT=81,cinder:DELETE=9,cinder:INSERT=26 {{(pid=86188) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 20:30:04 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-a6198191-1bbb-440e-8028-29b4ce17e4ff tempest-VolumesGetTest-1431096848 None] Acquiring lock "cinder-quobyte-b56b4720-ae51-4b78-b60b-c898560964ab" by "_delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:30:04 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-a6198191-1bbb-440e-8028-29b4ce17e4ff tempest-VolumesGetTest-1431096848 None] Lock "cinder-quobyte-b56b4720-ae51-4b78-b60b-c898560964ab" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:30:04 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-a6198191-1bbb-440e-8028-29b4ce17e4ff tempest-VolumesGetTest-1431096848 None] Deleting offline snapshot b56b4720-ae51-4b78-b60b-c898560964ab of volume a212e3b8-b8ec-455f-a5ca-3a2229830050 {{(pid=86188) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 20:30:04 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-a6198191-1bbb-440e-8028-29b4ce17e4ff tempest-VolumesGetTest-1431096848 None] snapshot_file for this snap is: volume-a212e3b8-b8ec-455f-a5ca-3a2229830050.b56b4720-ae51-4b78-b60b-c898560964ab {{(pid=86188) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 20:30:04 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[2927a9cd-071e-48a6-a635-dd2edef84bc8]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:30:04 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a6198191-1bbb-440e-8028-29b4ce17e4ff tempest-VolumesGetTest-1431096848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a212e3b8-b8ec-455f-a5ca-3a2229830050.b56b4720-ae51-4b78-b60b-c898560964ab {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:30:04 devstack sudo[99965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a212e3b8-b8ec-455f-a5ca-3a2229830050.b56b4720-ae51-4b78-b60b-c898560964ab Sep 16 20:30:04 devstack sudo[99965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:30:04 devstack sudo[99965]: pam_unix(sudo:session): session closed for user root Sep 16 20:30:04 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a6198191-1bbb-440e-8028-29b4ce17e4ff tempest-VolumesGetTest-1431096848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a212e3b8-b8ec-455f-a5ca-3a2229830050.b56b4720-ae51-4b78-b60b-c898560964ab" returned: 0 in 0.363s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:30:04 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-a6198191-1bbb-440e-8028-29b4ce17e4ff tempest-VolumesGetTest-1431096848 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a212e3b8-b8ec-455f-a5ca-3a2229830050(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86188) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 20:30:04 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ca42a7a-d42f-40b5-92d0-7544a8b2c31b]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:30:04 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a6198191-1bbb-440e-8028-29b4ce17e4ff tempest-VolumesGetTest-1431096848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a212e3b8-b8ec-455f-a5ca-3a2229830050 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:30:04 devstack sudo[99977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a212e3b8-b8ec-455f-a5ca-3a2229830050 Sep 16 20:30:04 devstack sudo[99977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:30:05 devstack sudo[99977]: pam_unix(sudo:session): session closed for user root Sep 16 20:30:05 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a6198191-1bbb-440e-8028-29b4ce17e4ff tempest-VolumesGetTest-1431096848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a212e3b8-b8ec-455f-a5ca-3a2229830050" returned: 0 in 0.509s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:30:05 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a6198191-1bbb-440e-8028-29b4ce17e4ff tempest-VolumesGetTest-1431096848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a212e3b8-b8ec-455f-a5ca-3a2229830050.b56b4720-ae51-4b78-b60b-c898560964ab {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:30:05 devstack sudo[99982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a212e3b8-b8ec-455f-a5ca-3a2229830050.b56b4720-ae51-4b78-b60b-c898560964ab Sep 16 20:30:05 devstack sudo[99982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:30:05 devstack sudo[99982]: pam_unix(sudo:session): session closed for user root Sep 16 20:30:05 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a6198191-1bbb-440e-8028-29b4ce17e4ff tempest-VolumesGetTest-1431096848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a212e3b8-b8ec-455f-a5ca-3a2229830050.b56b4720-ae51-4b78-b60b-c898560964ab" returned: 0 in 0.320s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:30:05 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a6198191-1bbb-440e-8028-29b4ce17e4ff tempest-VolumesGetTest-1431096848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a212e3b8-b8ec-455f-a5ca-3a2229830050.b56b4720-ae51-4b78-b60b-c898560964ab {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:30:05 devstack sudo[99988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a212e3b8-b8ec-455f-a5ca-3a2229830050.b56b4720-ae51-4b78-b60b-c898560964ab Sep 16 20:30:05 devstack sudo[99988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:30:05 devstack sudo[99988]: pam_unix(sudo:session): session closed for user root Sep 16 20:30:05 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a6198191-1bbb-440e-8028-29b4ce17e4ff tempest-VolumesGetTest-1431096848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a212e3b8-b8ec-455f-a5ca-3a2229830050.b56b4720-ae51-4b78-b60b-c898560964ab" returned: 0 in 0.236s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:30:05 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-a6198191-1bbb-440e-8028-29b4ce17e4ff tempest-VolumesGetTest-1431096848 None] Lock "cinder-quobyte-b56b4720-ae51-4b78-b60b-c898560964ab" released by "_delete_snapshot" :: held 1.515s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:30:05 devstack cinder-volume[86188]: DEBUG dbcounter [-] [86188] Writing DB stats cinder:SELECT=84,cinder:UPDATE=113,cinder:INSERT=30,cinder:DELETE=9 {{(pid=86188) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 20:30:05 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a6198191-1bbb-440e-8028-29b4ce17e4ff tempest-VolumesGetTest-1431096848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.285s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:30:05 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-f0b7bca2-51d8-40a0-832e-7ce2abaf2269 tempest-VolumesSnapshotTestJSON-982820329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.657s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:30:05 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-f0b7bca2-51d8-40a0-832e-7ce2abaf2269 tempest-VolumesSnapshotTestJSON-982820329 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:29:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-306008941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=189aa1f5-b1d4-4b5e-a266-32b37558f6f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b14473e8191340baa0f17e6030fae9fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:29:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:29:57Z,use_quota=True,user_id='02d8e75db6aa44c9b5660aa9226f8e20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:30:05 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-f0b7bca2-51d8-40a0-832e-7ce2abaf2269 tempest-VolumesSnapshotTestJSON-982820329 None] Creating volume 189aa1f5-b1d4-4b5e-a266-32b37558f6f1 {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:30:05 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-f0b7bca2-51d8-40a0-832e-7ce2abaf2269 tempest-VolumesSnapshotTestJSON-982820329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:30:05 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-f0b7bca2-51d8-40a0-832e-7ce2abaf2269 tempest-VolumesSnapshotTestJSON-982820329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:30:05 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-f0b7bca2-51d8-40a0-832e-7ce2abaf2269 tempest-VolumesSnapshotTestJSON-982820329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:30:05 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-f0b7bca2-51d8-40a0-832e-7ce2abaf2269 tempest-VolumesSnapshotTestJSON-982820329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:30:05 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-f0b7bca2-51d8-40a0-832e-7ce2abaf2269 tempest-VolumesSnapshotTestJSON-982820329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:30:05 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-f0b7bca2-51d8-40a0-832e-7ce2abaf2269 tempest-VolumesSnapshotTestJSON-982820329 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:30:05 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-f0b7bca2-51d8-40a0-832e-7ce2abaf2269 tempest-VolumesSnapshotTestJSON-982820329 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:30:05 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f0b7bca2-51d8-40a0-832e-7ce2abaf2269 tempest-VolumesSnapshotTestJSON-982820329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-189aa1f5-b1d4-4b5e-a266-32b37558f6f1 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:30:05 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a6198191-1bbb-440e-8028-29b4ce17e4ff tempest-VolumesGetTest-1431096848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13c0cf11-2a08-49b5-a63c-f54aa3d0e413) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c624a00e-f46b-4cdc-846c-3aa56bc972b4', 'volume_size': 1, 'source_volid': 'a212e3b8-b8ec-455f-a5ca-3a2229830050', 'source_volstatus': 'available'}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:30:05 devstack sudo[99991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-189aa1f5-b1d4-4b5e-a266-32b37558f6f1 1073741824 Sep 16 20:30:05 devstack sudo[99991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:30:05 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a6198191-1bbb-440e-8028-29b4ce17e4ff tempest-VolumesGetTest-1431096848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0adbed06-d546-4387-bdd2-8b9297b6051f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:30:05 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-a6198191-1bbb-440e-8028-29b4ce17e4ff tempest-VolumesGetTest-1431096848 None] Volume volume-c624a00e-f46b-4cdc-846c-3aa56bc972b4 (c624a00e-f46b-4cdc-846c-3aa56bc972b4): created successfully Sep 16 20:30:05 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a6198191-1bbb-440e-8028-29b4ce17e4ff tempest-VolumesGetTest-1431096848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0adbed06-d546-4387-bdd2-8b9297b6051f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:30:05 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a6198191-1bbb-440e-8028-29b4ce17e4ff tempest-VolumesGetTest-1431096848 None] Flow 'volume_create_manager' (53528f9f-bd70-4818-88f0-bf269967a09b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:30:05 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-a6198191-1bbb-440e-8028-29b4ce17e4ff tempest-VolumesGetTest-1431096848 None] Created volume successfully. Sep 16 20:30:06 devstack sudo[99991]: pam_unix(sudo:session): session closed for user root Sep 16 20:30:06 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f0b7bca2-51d8-40a0-832e-7ce2abaf2269 tempest-VolumesSnapshotTestJSON-982820329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-189aa1f5-b1d4-4b5e-a266-32b37558f6f1 1073741824" returned: 0 in 0.417s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:30:06 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f0b7bca2-51d8-40a0-832e-7ce2abaf2269 tempest-VolumesSnapshotTestJSON-982820329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-189aa1f5-b1d4-4b5e-a266-32b37558f6f1 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:30:06 devstack sudo[99997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-189aa1f5-b1d4-4b5e-a266-32b37558f6f1 Sep 16 20:30:06 devstack sudo[99997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:30:06 devstack sudo[99997]: pam_unix(sudo:session): session closed for user root Sep 16 20:30:06 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f0b7bca2-51d8-40a0-832e-7ce2abaf2269 tempest-VolumesSnapshotTestJSON-982820329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-189aa1f5-b1d4-4b5e-a266-32b37558f6f1" returned: 0 in 0.248s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:30:06 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-f0b7bca2-51d8-40a0-832e-7ce2abaf2269 tempest-VolumesSnapshotTestJSON-982820329 None] <== create_volume: return (705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:30:06 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-f0b7bca2-51d8-40a0-832e-7ce2abaf2269 tempest-VolumesSnapshotTestJSON-982820329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.707s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:30:06 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [req-3a60aabf-c016-447a-bffd-0b9462b33b30 req-66a57e7b-0bec-460e-aac2-7aa2ed65adfd tempest-TestInstancesWithCinderVolumes-1553461958 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.705s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:30:06 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [req-3a60aabf-c016-447a-bffd-0b9462b33b30 req-66a57e7b-0bec-460e-aac2-7aa2ed65adfd tempest-TestInstancesWithCinderVolumes-1553461958 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:30:06 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f0b7bca2-51d8-40a0-832e-7ce2abaf2269 tempest-VolumesSnapshotTestJSON-982820329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2f724a5-0d6d-4f06-8add-a8148e2137dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-189aa1f5-b1d4-4b5e-a266-32b37558f6f1', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:30:06 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f0b7bca2-51d8-40a0-832e-7ce2abaf2269 tempest-VolumesSnapshotTestJSON-982820329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f3cc866-5655-41b5-b6d6-7f3b98e55676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:30:06 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-f0b7bca2-51d8-40a0-832e-7ce2abaf2269 tempest-VolumesSnapshotTestJSON-982820329 None] Volume volume-189aa1f5-b1d4-4b5e-a266-32b37558f6f1 (189aa1f5-b1d4-4b5e-a266-32b37558f6f1): created successfully Sep 16 20:30:06 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f0b7bca2-51d8-40a0-832e-7ce2abaf2269 tempest-VolumesSnapshotTestJSON-982820329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f3cc866-5655-41b5-b6d6-7f3b98e55676) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:30:06 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f0b7bca2-51d8-40a0-832e-7ce2abaf2269 tempest-VolumesSnapshotTestJSON-982820329 None] Flow 'volume_create_manager' (4045ebfe-898f-449f-9bb8-eacc9c53373f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:30:06 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-f0b7bca2-51d8-40a0-832e-7ce2abaf2269 tempest-VolumesSnapshotTestJSON-982820329 None] Created volume successfully. Sep 16 20:30:06 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [req-3a60aabf-c016-447a-bffd-0b9462b33b30 req-66a57e7b-0bec-460e-aac2-7aa2ed65adfd tempest-TestInstancesWithCinderVolumes-1553461958 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81', 'name': 'volume-3b0f4d04-de77-46dd-b428-982c9e7d7f82', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b08a8e7b-50b7-42db-a85c-4da394549e3e', 'enforce_multipath': True} {{(pid=86188) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 16 20:30:06 devstack cinder-volume[86188]: INFO cinder.volume.manager [req-3a60aabf-c016-447a-bffd-0b9462b33b30 req-66a57e7b-0bec-460e-aac2-7aa2ed65adfd tempest-TestInstancesWithCinderVolumes-1553461958 None] attachment_update completed successfully. Sep 16 20:30:07 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-24b106e6-feee-433c-bb25-36b68f72f157 tempest-VolumesGetTest-1431096848 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:30:07 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-24b106e6-feee-433c-bb25-36b68f72f157 tempest-VolumesGetTest-1431096848 None] Flow 'volume_create_manager' (08f27425-7677-409d-acdb-eb2134dc7427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:30:07 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-24b106e6-feee-433c-bb25-36b68f72f157 tempest-VolumesGetTest-1431096848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eef049ba-c35b-47ef-8c3c-9bdad4c13959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:30:07 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-24b106e6-feee-433c-bb25-36b68f72f157 tempest-VolumesGetTest-1431096848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eef049ba-c35b-47ef-8c3c-9bdad4c13959) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:30:07Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1174040430',display_name='tempest-VolumesGetTest-Volume-622779925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=506558ec-c24c-42be-8a8b-1a91bdf8c431,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f71bf8bb99894f1d87c310177b239798',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:30:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:30:07Z,use_quota=True,user_id='1e0a03b0f86d497299b719cf3b8e51bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:30:07 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-24b106e6-feee-433c-bb25-36b68f72f157 tempest-VolumesGetTest-1431096848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2776ba66-94a6-49fd-9d99-0a2b587a762b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:30:07 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-24b106e6-feee-433c-bb25-36b68f72f157 tempest-VolumesGetTest-1431096848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2776ba66-94a6-49fd-9d99-0a2b587a762b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:30:07 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-24b106e6-feee-433c-bb25-36b68f72f157 tempest-VolumesGetTest-1431096848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (457ad7a0-b412-4322-97c3-2a6878b904fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:30:07 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-24b106e6-feee-433c-bb25-36b68f72f157 tempest-VolumesGetTest-1431096848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (457ad7a0-b412-4322-97c3-2a6878b904fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '506558ec-c24c-42be-8a8b-1a91bdf8c431', 'volume_name': 'volume-506558ec-c24c-42be-8a8b-1a91bdf8c431', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:30:07 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-24b106e6-feee-433c-bb25-36b68f72f157 tempest-VolumesGetTest-1431096848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d691518d-634c-499c-b7c1-19a2b6306968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:30:07 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-24b106e6-feee-433c-bb25-36b68f72f157 tempest-VolumesGetTest-1431096848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d691518d-634c-499c-b7c1-19a2b6306968) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:30:07 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-24b106e6-feee-433c-bb25-36b68f72f157 tempest-VolumesGetTest-1431096848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be921294-0d93-4df1-90fb-4db2928d99db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:30:07 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-24b106e6-feee-433c-bb25-36b68f72f157 tempest-VolumesGetTest-1431096848 None] Volume 506558ec-c24c-42be-8a8b-1a91bdf8c431: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-506558ec-c24c-42be-8a8b-1a91bdf8c431', 'volume_size': 1} Sep 16 20:30:07 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-24b106e6-feee-433c-bb25-36b68f72f157 tempest-VolumesGetTest-1431096848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:30:07 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-24b106e6-feee-433c-bb25-36b68f72f157 tempest-VolumesGetTest-1431096848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:30:07 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-24b106e6-feee-433c-bb25-36b68f72f157 tempest-VolumesGetTest-1431096848 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:30:07Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1174040430',display_name='tempest-VolumesGetTest-Volume-622779925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=506558ec-c24c-42be-8a8b-1a91bdf8c431,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f71bf8bb99894f1d87c310177b239798',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:30:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:30:07Z,use_quota=True,user_id='1e0a03b0f86d497299b719cf3b8e51bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:30:07 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-24b106e6-feee-433c-bb25-36b68f72f157 tempest-VolumesGetTest-1431096848 None] Creating volume 506558ec-c24c-42be-8a8b-1a91bdf8c431 {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:30:07 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-24b106e6-feee-433c-bb25-36b68f72f157 tempest-VolumesGetTest-1431096848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:30:07 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-24b106e6-feee-433c-bb25-36b68f72f157 tempest-VolumesGetTest-1431096848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:30:07 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-24b106e6-feee-433c-bb25-36b68f72f157 tempest-VolumesGetTest-1431096848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:30:07 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-24b106e6-feee-433c-bb25-36b68f72f157 tempest-VolumesGetTest-1431096848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:30:07 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-24b106e6-feee-433c-bb25-36b68f72f157 tempest-VolumesGetTest-1431096848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:30:07 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-24b106e6-feee-433c-bb25-36b68f72f157 tempest-VolumesGetTest-1431096848 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:30:07 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-24b106e6-feee-433c-bb25-36b68f72f157 tempest-VolumesGetTest-1431096848 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:30:07 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-24b106e6-feee-433c-bb25-36b68f72f157 tempest-VolumesGetTest-1431096848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-506558ec-c24c-42be-8a8b-1a91bdf8c431 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:30:07 devstack sudo[100004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-506558ec-c24c-42be-8a8b-1a91bdf8c431 1073741824 Sep 16 20:30:07 devstack sudo[100004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:30:07 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-ad11841c-1263-44d3-9724-ac19ed0d3248 tempest-VolumesSnapshotTestJSON-982820329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:30:07 devstack sudo[100004]: pam_unix(sudo:session): session closed for user root Sep 16 20:30:07 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-24b106e6-feee-433c-bb25-36b68f72f157 tempest-VolumesGetTest-1431096848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-506558ec-c24c-42be-8a8b-1a91bdf8c431 1073741824" returned: 0 in 0.431s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:30:07 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-24b106e6-feee-433c-bb25-36b68f72f157 tempest-VolumesGetTest-1431096848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-506558ec-c24c-42be-8a8b-1a91bdf8c431 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:30:07 devstack sudo[100010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-506558ec-c24c-42be-8a8b-1a91bdf8c431 Sep 16 20:30:07 devstack sudo[100010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:30:07 devstack sudo[100010]: pam_unix(sudo:session): session closed for user root Sep 16 20:30:07 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-24b106e6-feee-433c-bb25-36b68f72f157 tempest-VolumesGetTest-1431096848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-506558ec-c24c-42be-8a8b-1a91bdf8c431" returned: 0 in 0.249s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:30:07 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-24b106e6-feee-433c-bb25-36b68f72f157 tempest-VolumesGetTest-1431096848 None] <== create_volume: return (737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:30:07 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-24b106e6-feee-433c-bb25-36b68f72f157 tempest-VolumesGetTest-1431096848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.740s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:30:07 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-ad11841c-1263-44d3-9724-ac19ed0d3248 tempest-VolumesSnapshotTestJSON-982820329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.574s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:30:07 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-24b106e6-feee-433c-bb25-36b68f72f157 tempest-VolumesGetTest-1431096848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be921294-0d93-4df1-90fb-4db2928d99db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-506558ec-c24c-42be-8a8b-1a91bdf8c431', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:30:07 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-24b106e6-feee-433c-bb25-36b68f72f157 tempest-VolumesGetTest-1431096848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d7b1dbb-3af6-49e0-ad27-44044a323ffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:30:07 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-ad11841c-1263-44d3-9724-ac19ed0d3248 tempest-VolumesSnapshotTestJSON-982820329 None] Creating offline snapshot f7376d4e-7879-44e8-9d22-c219309cdc4d of volume 189aa1f5-b1d4-4b5e-a266-32b37558f6f1 {{(pid=86188) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 20:30:07 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-24b106e6-feee-433c-bb25-36b68f72f157 tempest-VolumesGetTest-1431096848 None] Volume volume-506558ec-c24c-42be-8a8b-1a91bdf8c431 (506558ec-c24c-42be-8a8b-1a91bdf8c431): created successfully Sep 16 20:30:07 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-24b106e6-feee-433c-bb25-36b68f72f157 tempest-VolumesGetTest-1431096848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d7b1dbb-3af6-49e0-ad27-44044a323ffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:30:07 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-24b106e6-feee-433c-bb25-36b68f72f157 tempest-VolumesGetTest-1431096848 None] Flow 'volume_create_manager' (08f27425-7677-409d-acdb-eb2134dc7427) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:30:07 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[e36a475f-d112-4e01-a308-a3db3c658715]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:30:07 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ad11841c-1263-44d3-9724-ac19ed0d3248 tempest-VolumesSnapshotTestJSON-982820329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-189aa1f5-b1d4-4b5e-a266-32b37558f6f1 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:30:08 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-24b106e6-feee-433c-bb25-36b68f72f157 tempest-VolumesGetTest-1431096848 None] Created volume successfully. Sep 16 20:30:08 devstack sudo[100015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-189aa1f5-b1d4-4b5e-a266-32b37558f6f1 Sep 16 20:30:08 devstack sudo[100015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:30:08 devstack sudo[100015]: pam_unix(sudo:session): session closed for user root Sep 16 20:30:08 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ad11841c-1263-44d3-9724-ac19ed0d3248 tempest-VolumesSnapshotTestJSON-982820329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-189aa1f5-b1d4-4b5e-a266-32b37558f6f1" returned: 0 in 0.368s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:30:08 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ad11841c-1263-44d3-9724-ac19ed0d3248 tempest-VolumesSnapshotTestJSON-982820329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-189aa1f5-b1d4-4b5e-a266-32b37558f6f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-189aa1f5-b1d4-4b5e-a266-32b37558f6f1.f7376d4e-7879-44e8-9d22-c219309cdc4d 1G {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:30:08 devstack sudo[100024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-189aa1f5-b1d4-4b5e-a266-32b37558f6f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-189aa1f5-b1d4-4b5e-a266-32b37558f6f1.f7376d4e-7879-44e8-9d22-c219309cdc4d 1G Sep 16 20:30:08 devstack sudo[100024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:30:08 devstack sudo[100024]: pam_unix(sudo:session): session closed for user root Sep 16 20:30:08 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ad11841c-1263-44d3-9724-ac19ed0d3248 tempest-VolumesSnapshotTestJSON-982820329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-189aa1f5-b1d4-4b5e-a266-32b37558f6f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-189aa1f5-b1d4-4b5e-a266-32b37558f6f1.f7376d4e-7879-44e8-9d22-c219309cdc4d 1G" returned: 0 in 0.416s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:30:08 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ad11841c-1263-44d3-9724-ac19ed0d3248 tempest-VolumesSnapshotTestJSON-982820329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-189aa1f5-b1d4-4b5e-a266-32b37558f6f1 -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-189aa1f5-b1d4-4b5e-a266-32b37558f6f1.f7376d4e-7879-44e8-9d22-c219309cdc4d {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:30:08 devstack sudo[100033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-189aa1f5-b1d4-4b5e-a266-32b37558f6f1 -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-189aa1f5-b1d4-4b5e-a266-32b37558f6f1.f7376d4e-7879-44e8-9d22-c219309cdc4d Sep 16 20:30:08 devstack sudo[100033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:30:09 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [req-ee73fab1-94c0-4a10-a3a5-f4f289348e4e req-6d86febb-291f-484c-99dc-92a8f2c66092 tempest-TestInstancesWithCinderVolumes-1553461958 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:30:09 devstack sudo[100033]: pam_unix(sudo:session): session closed for user root Sep 16 20:30:09 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ad11841c-1263-44d3-9724-ac19ed0d3248 tempest-VolumesSnapshotTestJSON-982820329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-189aa1f5-b1d4-4b5e-a266-32b37558f6f1 -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-189aa1f5-b1d4-4b5e-a266-32b37558f6f1.f7376d4e-7879-44e8-9d22-c219309cdc4d" returned: 0 in 0.338s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:30:09 devstack cinder-volume[86188]: WARNING cinder.volume.drivers.remotefs [None req-ad11841c-1263-44d3-9724-ac19ed0d3248 tempest-VolumesSnapshotTestJSON-982820329 None] /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-189aa1f5-b1d4-4b5e-a266-32b37558f6f1.f7376d4e-7879-44e8-9d22-c219309cdc4d is being set with open permissions: ugo+rw Sep 16 20:30:09 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ad11841c-1263-44d3-9724-ac19ed0d3248 tempest-VolumesSnapshotTestJSON-982820329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-189aa1f5-b1d4-4b5e-a266-32b37558f6f1.f7376d4e-7879-44e8-9d22-c219309cdc4d {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:30:09 devstack sudo[100047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-189aa1f5-b1d4-4b5e-a266-32b37558f6f1.f7376d4e-7879-44e8-9d22-c219309cdc4d Sep 16 20:30:09 devstack sudo[100047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:30:09 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-b0b30ab1-a30f-4cc2-851d-67d556237e27 tempest-VolumesGetTest-1431096848 None] Acquiring lock "cinder-506558ec-c24c-42be-8a8b-1a91bdf8c431-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:30:09 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-b0b30ab1-a30f-4cc2-851d-67d556237e27 tempest-VolumesGetTest-1431096848 None] Lock "cinder-506558ec-c24c-42be-8a8b-1a91bdf8c431-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:30:09 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-b0b30ab1-a30f-4cc2-851d-67d556237e27 tempest-VolumesGetTest-1431096848 None] Acquiring lock "cinder-quobyte-506558ec-c24c-42be-8a8b-1a91bdf8c431" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:30:09 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-b0b30ab1-a30f-4cc2-851d-67d556237e27 tempest-VolumesGetTest-1431096848 None] Lock "cinder-quobyte-506558ec-c24c-42be-8a8b-1a91bdf8c431" acquired by "delete_volume" :: waited 0.015s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:30:09 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[12609947-c11b-40de-94e1-19070dc2833a]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:30:09 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b0b30ab1-a30f-4cc2-851d-67d556237e27 tempest-VolumesGetTest-1431096848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-506558ec-c24c-42be-8a8b-1a91bdf8c431 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:30:09 devstack sudo[100047]: pam_unix(sudo:session): session closed for user root Sep 16 20:30:09 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ad11841c-1263-44d3-9724-ac19ed0d3248 tempest-VolumesSnapshotTestJSON-982820329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-189aa1f5-b1d4-4b5e-a266-32b37558f6f1.f7376d4e-7879-44e8-9d22-c219309cdc4d" returned: 0 in 0.262s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:30:09 devstack sudo[100050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-506558ec-c24c-42be-8a8b-1a91bdf8c431 Sep 16 20:30:09 devstack sudo[100050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:30:09 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ad11841c-1263-44d3-9724-ac19ed0d3248 tempest-VolumesSnapshotTestJSON-982820329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-189aa1f5-b1d4-4b5e-a266-32b37558f6f1.info {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:30:09 devstack sudo[100052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-189aa1f5-b1d4-4b5e-a266-32b37558f6f1.info Sep 16 20:30:09 devstack sudo[100052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:30:09 devstack sudo[100052]: pam_unix(sudo:session): session closed for user root Sep 16 20:30:09 devstack sudo[100050]: pam_unix(sudo:session): session closed for user root Sep 16 20:30:09 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ad11841c-1263-44d3-9724-ac19ed0d3248 tempest-VolumesSnapshotTestJSON-982820329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-189aa1f5-b1d4-4b5e-a266-32b37558f6f1.info" returned: 0 in 0.260s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:30:09 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b0b30ab1-a30f-4cc2-851d-67d556237e27 tempest-VolumesGetTest-1431096848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-506558ec-c24c-42be-8a8b-1a91bdf8c431" returned: 0 in 0.389s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:30:09 devstack cinder-volume[86188]: WARNING cinder.volume.drivers.remotefs [None req-ad11841c-1263-44d3-9724-ac19ed0d3248 tempest-VolumesSnapshotTestJSON-982820329 None] /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-189aa1f5-b1d4-4b5e-a266-32b37558f6f1.info is being set with open permissions: ugo+rw Sep 16 20:30:09 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ad11841c-1263-44d3-9724-ac19ed0d3248 tempest-VolumesSnapshotTestJSON-982820329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-189aa1f5-b1d4-4b5e-a266-32b37558f6f1.info {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:30:09 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b0b30ab1-a30f-4cc2-851d-67d556237e27 tempest-VolumesGetTest-1431096848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-506558ec-c24c-42be-8a8b-1a91bdf8c431 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:30:09 devstack sudo[100058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-189aa1f5-b1d4-4b5e-a266-32b37558f6f1.info Sep 16 20:30:09 devstack sudo[100058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:30:09 devstack sudo[100059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-506558ec-c24c-42be-8a8b-1a91bdf8c431 Sep 16 20:30:09 devstack sudo[100059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:30:09 devstack sudo[100059]: pam_unix(sudo:session): session closed for user root Sep 16 20:30:09 devstack sudo[100058]: pam_unix(sudo:session): session closed for user root Sep 16 20:30:09 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b0b30ab1-a30f-4cc2-851d-67d556237e27 tempest-VolumesGetTest-1431096848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-506558ec-c24c-42be-8a8b-1a91bdf8c431" returned: 0 in 0.241s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:30:09 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ad11841c-1263-44d3-9724-ac19ed0d3248 tempest-VolumesSnapshotTestJSON-982820329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-189aa1f5-b1d4-4b5e-a266-32b37558f6f1.info" returned: 0 in 0.261s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:30:10 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-ad11841c-1263-44d3-9724-ac19ed0d3248 tempest-VolumesSnapshotTestJSON-982820329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.076s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:30:10 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-b0b30ab1-a30f-4cc2-851d-67d556237e27 tempest-VolumesGetTest-1431096848 None] Lock "cinder-quobyte-506558ec-c24c-42be-8a8b-1a91bdf8c431" released by "delete_volume" :: held 0.696s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:30:10 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [req-ee73fab1-94c0-4a10-a3a5-f4f289348e4e req-6d86febb-291f-484c-99dc-92a8f2c66092 tempest-TestInstancesWithCinderVolumes-1553461958 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.916s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:30:10 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [req-ee73fab1-94c0-4a10-a3a5-f4f289348e4e req-6d86febb-291f-484c-99dc-92a8f2c66092 tempest-TestInstancesWithCinderVolumes-1553461958 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:30:10 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [req-ee73fab1-94c0-4a10-a3a5-f4f289348e4e req-6d86febb-291f-484c-99dc-92a8f2c66092 tempest-TestInstancesWithCinderVolumes-1553461958 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81', 'name': 'volume-808d0b31-b417-4b34-9976-d150b62aeb2a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2c3e3018-cca8-45d1-9f82-9ad108d02af4', 'enforce_multipath': True} {{(pid=86188) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 16 20:30:10 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-ad11841c-1263-44d3-9724-ac19ed0d3248 tempest-VolumesSnapshotTestJSON-982820329 None] Create snapshot completed successfully Sep 16 20:30:10 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-b0b30ab1-a30f-4cc2-851d-67d556237e27 tempest-VolumesGetTest-1431096848 None] Created reservations ['96f6c100-d208-4588-b84f-3d1313ee6876', 'de6e42b5-f710-43f3-899f-d2c19e052e32', '4567855c-c44c-4cd1-8e13-a872dd61767b', 'd6228294-ad76-4fe9-afd5-f8616b9fd834'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:30:10 devstack cinder-volume[86188]: INFO cinder.volume.manager [req-ee73fab1-94c0-4a10-a3a5-f4f289348e4e req-6d86febb-291f-484c-99dc-92a8f2c66092 tempest-TestInstancesWithCinderVolumes-1553461958 None] attachment_update completed successfully. Sep 16 20:30:10 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-b0b30ab1-a30f-4cc2-851d-67d556237e27 tempest-VolumesGetTest-1431096848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:30:10 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-b0b30ab1-a30f-4cc2-851d-67d556237e27 tempest-VolumesGetTest-1431096848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:30:10 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-b0b30ab1-a30f-4cc2-851d-67d556237e27 tempest-VolumesGetTest-1431096848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:30:10 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-b0b30ab1-a30f-4cc2-851d-67d556237e27 tempest-VolumesGetTest-1431096848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:30:10 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-b0b30ab1-a30f-4cc2-851d-67d556237e27 tempest-VolumesGetTest-1431096848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:30:10 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b0b30ab1-a30f-4cc2-851d-67d556237e27 tempest-VolumesGetTest-1431096848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:30:10 devstack sudo[100064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:30:10 devstack sudo[100064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:30:10 devstack sudo[100064]: pam_unix(sudo:session): session closed for user root Sep 16 20:30:10 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b0b30ab1-a30f-4cc2-851d-67d556237e27 tempest-VolumesGetTest-1431096848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.283s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:30:10 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-b0b30ab1-a30f-4cc2-851d-67d556237e27 tempest-VolumesGetTest-1431096848 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:30:10 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-b0b30ab1-a30f-4cc2-851d-67d556237e27 tempest-VolumesGetTest-1431096848 None] Deleted volume successfully. Sep 16 20:30:10 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-41cab13d-33ab-4559-aee1-d9b987868232 tempest-VolumesGetTest-1431096848 None] Acquiring lock "cinder-c624a00e-f46b-4cdc-846c-3aa56bc972b4-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:30:10 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-b0b30ab1-a30f-4cc2-851d-67d556237e27 tempest-VolumesGetTest-1431096848 None] Lock "cinder-506558ec-c24c-42be-8a8b-1a91bdf8c431-delete_volume" released by "delete_volume" :: held 1.307s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:30:10 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-41cab13d-33ab-4559-aee1-d9b987868232 tempest-VolumesGetTest-1431096848 None] Lock "cinder-c624a00e-f46b-4cdc-846c-3aa56bc972b4-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:30:10 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-41cab13d-33ab-4559-aee1-d9b987868232 tempest-VolumesGetTest-1431096848 None] Acquiring lock "cinder-quobyte-c624a00e-f46b-4cdc-846c-3aa56bc972b4" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:30:10 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-41cab13d-33ab-4559-aee1-d9b987868232 tempest-VolumesGetTest-1431096848 None] Lock "cinder-quobyte-c624a00e-f46b-4cdc-846c-3aa56bc972b4" acquired by "delete_volume" :: waited 0.025s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:30:10 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[82f4878e-0681-47b9-a6b5-ab7746031b63]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:30:10 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-41cab13d-33ab-4559-aee1-d9b987868232 tempest-VolumesGetTest-1431096848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c624a00e-f46b-4cdc-846c-3aa56bc972b4 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:30:10 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-3a0454a4-5a01-4bdb-ad33-cb6d9d2189f0 tempest-VolumesSnapshotTestJSON-982820329 None] Acquiring lock "cinder-f7376d4e-7879-44e8-9d22-c219309cdc4d-delete_snapshot" by "delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:30:10 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-3a0454a4-5a01-4bdb-ad33-cb6d9d2189f0 tempest-VolumesSnapshotTestJSON-982820329 None] Lock "cinder-f7376d4e-7879-44e8-9d22-c219309cdc4d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:30:10 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-3a0454a4-5a01-4bdb-ad33-cb6d9d2189f0 tempest-VolumesSnapshotTestJSON-982820329 None] Acquiring lock "cinder-quobyte-189aa1f5-b1d4-4b5e-a266-32b37558f6f1" by "delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:30:10 devstack sudo[100069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c624a00e-f46b-4cdc-846c-3aa56bc972b4 Sep 16 20:30:10 devstack sudo[100069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:30:10 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-3a0454a4-5a01-4bdb-ad33-cb6d9d2189f0 tempest-VolumesSnapshotTestJSON-982820329 None] Lock "cinder-quobyte-189aa1f5-b1d4-4b5e-a266-32b37558f6f1" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:30:10 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-3a0454a4-5a01-4bdb-ad33-cb6d9d2189f0 tempest-VolumesSnapshotTestJSON-982820329 None] Acquiring lock "cinder-quobyte-f7376d4e-7879-44e8-9d22-c219309cdc4d" by "_delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:30:10 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-3a0454a4-5a01-4bdb-ad33-cb6d9d2189f0 tempest-VolumesSnapshotTestJSON-982820329 None] Lock "cinder-quobyte-f7376d4e-7879-44e8-9d22-c219309cdc4d" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:30:10 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-3a0454a4-5a01-4bdb-ad33-cb6d9d2189f0 tempest-VolumesSnapshotTestJSON-982820329 None] Deleting offline snapshot f7376d4e-7879-44e8-9d22-c219309cdc4d of volume 189aa1f5-b1d4-4b5e-a266-32b37558f6f1 {{(pid=86188) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 20:30:10 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-3a0454a4-5a01-4bdb-ad33-cb6d9d2189f0 tempest-VolumesSnapshotTestJSON-982820329 None] snapshot_file for this snap is: volume-189aa1f5-b1d4-4b5e-a266-32b37558f6f1.f7376d4e-7879-44e8-9d22-c219309cdc4d {{(pid=86188) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 20:30:10 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[f444fd7d-8f7f-4867-aed0-fd93191f2c20]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:30:10 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-3a0454a4-5a01-4bdb-ad33-cb6d9d2189f0 tempest-VolumesSnapshotTestJSON-982820329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-189aa1f5-b1d4-4b5e-a266-32b37558f6f1.f7376d4e-7879-44e8-9d22-c219309cdc4d {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:30:10 devstack sudo[100071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-189aa1f5-b1d4-4b5e-a266-32b37558f6f1.f7376d4e-7879-44e8-9d22-c219309cdc4d Sep 16 20:30:10 devstack sudo[100071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:30:11 devstack sudo[100069]: pam_unix(sudo:session): session closed for user root Sep 16 20:30:11 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-41cab13d-33ab-4559-aee1-d9b987868232 tempest-VolumesGetTest-1431096848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c624a00e-f46b-4cdc-846c-3aa56bc972b4" returned: 0 in 0.395s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:30:11 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-41cab13d-33ab-4559-aee1-d9b987868232 tempest-VolumesGetTest-1431096848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c624a00e-f46b-4cdc-846c-3aa56bc972b4 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:30:11 devstack sudo[100078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c624a00e-f46b-4cdc-846c-3aa56bc972b4 Sep 16 20:30:11 devstack sudo[100078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:30:11 devstack sudo[100071]: pam_unix(sudo:session): session closed for user root Sep 16 20:30:11 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-3a0454a4-5a01-4bdb-ad33-cb6d9d2189f0 tempest-VolumesSnapshotTestJSON-982820329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-189aa1f5-b1d4-4b5e-a266-32b37558f6f1.f7376d4e-7879-44e8-9d22-c219309cdc4d" returned: 0 in 0.383s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:30:11 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-3a0454a4-5a01-4bdb-ad33-cb6d9d2189f0 tempest-VolumesSnapshotTestJSON-982820329 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-189aa1f5-b1d4-4b5e-a266-32b37558f6f1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86188) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 20:30:11 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[14c44176-c1ed-44c0-a2b5-8b17071b71a4]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:30:11 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-3a0454a4-5a01-4bdb-ad33-cb6d9d2189f0 tempest-VolumesSnapshotTestJSON-982820329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-189aa1f5-b1d4-4b5e-a266-32b37558f6f1 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:30:11 devstack sudo[100078]: pam_unix(sudo:session): session closed for user root Sep 16 20:30:11 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-41cab13d-33ab-4559-aee1-d9b987868232 tempest-VolumesGetTest-1431096848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c624a00e-f46b-4cdc-846c-3aa56bc972b4" returned: 0 in 0.262s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:30:11 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-41cab13d-33ab-4559-aee1-d9b987868232 tempest-VolumesGetTest-1431096848 None] Lock "cinder-quobyte-c624a00e-f46b-4cdc-846c-3aa56bc972b4" released by "delete_volume" :: held 0.718s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:30:11 devstack sudo[100087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-189aa1f5-b1d4-4b5e-a266-32b37558f6f1 Sep 16 20:30:11 devstack sudo[100087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:30:11 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-41cab13d-33ab-4559-aee1-d9b987868232 tempest-VolumesGetTest-1431096848 None] Created reservations ['0c68d39c-c91f-4dee-ad0d-5cae42103a29', '3cc39b58-647f-402f-9879-970a8c445af8', '5d0c6aeb-b469-43c2-a5f9-66f8c328fab6', '89b10857-689e-43cf-9cd4-8be14b4084fa'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:30:11 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-41cab13d-33ab-4559-aee1-d9b987868232 tempest-VolumesGetTest-1431096848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:30:11 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-41cab13d-33ab-4559-aee1-d9b987868232 tempest-VolumesGetTest-1431096848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:30:11 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-41cab13d-33ab-4559-aee1-d9b987868232 tempest-VolumesGetTest-1431096848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:30:11 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-41cab13d-33ab-4559-aee1-d9b987868232 tempest-VolumesGetTest-1431096848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:30:11 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-41cab13d-33ab-4559-aee1-d9b987868232 tempest-VolumesGetTest-1431096848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:30:11 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-41cab13d-33ab-4559-aee1-d9b987868232 tempest-VolumesGetTest-1431096848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:30:11 devstack sudo[100092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:30:11 devstack sudo[100092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:30:11 devstack sudo[100087]: pam_unix(sudo:session): session closed for user root Sep 16 20:30:11 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-3a0454a4-5a01-4bdb-ad33-cb6d9d2189f0 tempest-VolumesSnapshotTestJSON-982820329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-189aa1f5-b1d4-4b5e-a266-32b37558f6f1" returned: 0 in 0.423s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:30:11 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-3a0454a4-5a01-4bdb-ad33-cb6d9d2189f0 tempest-VolumesSnapshotTestJSON-982820329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-189aa1f5-b1d4-4b5e-a266-32b37558f6f1.f7376d4e-7879-44e8-9d22-c219309cdc4d {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:30:11 devstack sudo[100097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-189aa1f5-b1d4-4b5e-a266-32b37558f6f1.f7376d4e-7879-44e8-9d22-c219309cdc4d Sep 16 20:30:11 devstack sudo[100097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:30:11 devstack sudo[100092]: pam_unix(sudo:session): session closed for user root Sep 16 20:30:11 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-51e41d98-0eb2-4a8c-ab0a-393889c9cc05 tempest-VolumesGetTest-1431096848 None] Acquiring lock "cinder-a212e3b8-b8ec-455f-a5ca-3a2229830050-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:30:11 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-41cab13d-33ab-4559-aee1-d9b987868232 tempest-VolumesGetTest-1431096848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.328s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:30:11 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-41cab13d-33ab-4559-aee1-d9b987868232 tempest-VolumesGetTest-1431096848 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:30:11 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-41cab13d-33ab-4559-aee1-d9b987868232 tempest-VolumesGetTest-1431096848 None] Deleted volume successfully. Sep 16 20:30:11 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-51e41d98-0eb2-4a8c-ab0a-393889c9cc05 tempest-VolumesGetTest-1431096848 None] Lock "cinder-a212e3b8-b8ec-455f-a5ca-3a2229830050-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:30:11 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-41cab13d-33ab-4559-aee1-d9b987868232 tempest-VolumesGetTest-1431096848 None] Lock "cinder-c624a00e-f46b-4cdc-846c-3aa56bc972b4-delete_volume" released by "delete_volume" :: held 1.297s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:30:11 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-51e41d98-0eb2-4a8c-ab0a-393889c9cc05 tempest-VolumesGetTest-1431096848 None] Acquiring lock "cinder-quobyte-a212e3b8-b8ec-455f-a5ca-3a2229830050" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:30:11 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-51e41d98-0eb2-4a8c-ab0a-393889c9cc05 tempest-VolumesGetTest-1431096848 None] Lock "cinder-quobyte-a212e3b8-b8ec-455f-a5ca-3a2229830050" acquired by "delete_volume" :: waited 0.020s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:30:11 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7287361-0ca5-4ed2-8c6d-ba42a00934a4]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:30:11 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-51e41d98-0eb2-4a8c-ab0a-393889c9cc05 tempest-VolumesGetTest-1431096848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a212e3b8-b8ec-455f-a5ca-3a2229830050 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:30:12 devstack sudo[100104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a212e3b8-b8ec-455f-a5ca-3a2229830050 Sep 16 20:30:12 devstack sudo[100104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:30:12 devstack sudo[100097]: pam_unix(sudo:session): session closed for user root Sep 16 20:30:12 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-3a0454a4-5a01-4bdb-ad33-cb6d9d2189f0 tempest-VolumesSnapshotTestJSON-982820329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-189aa1f5-b1d4-4b5e-a266-32b37558f6f1.f7376d4e-7879-44e8-9d22-c219309cdc4d" returned: 0 in 0.466s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:30:12 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-3a0454a4-5a01-4bdb-ad33-cb6d9d2189f0 tempest-VolumesSnapshotTestJSON-982820329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-189aa1f5-b1d4-4b5e-a266-32b37558f6f1.f7376d4e-7879-44e8-9d22-c219309cdc4d {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:30:12 devstack sudo[100107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-189aa1f5-b1d4-4b5e-a266-32b37558f6f1.f7376d4e-7879-44e8-9d22-c219309cdc4d Sep 16 20:30:12 devstack sudo[100107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:30:12 devstack sudo[100104]: pam_unix(sudo:session): session closed for user root Sep 16 20:30:12 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-51e41d98-0eb2-4a8c-ab0a-393889c9cc05 tempest-VolumesGetTest-1431096848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a212e3b8-b8ec-455f-a5ca-3a2229830050" returned: 0 in 0.440s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:30:12 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-51e41d98-0eb2-4a8c-ab0a-393889c9cc05 tempest-VolumesGetTest-1431096848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a212e3b8-b8ec-455f-a5ca-3a2229830050 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:30:12 devstack sudo[100114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a212e3b8-b8ec-455f-a5ca-3a2229830050 Sep 16 20:30:12 devstack sudo[100107]: pam_unix(sudo:session): session closed for user root Sep 16 20:30:12 devstack sudo[100114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:30:12 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-3a0454a4-5a01-4bdb-ad33-cb6d9d2189f0 tempest-VolumesSnapshotTestJSON-982820329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-189aa1f5-b1d4-4b5e-a266-32b37558f6f1.f7376d4e-7879-44e8-9d22-c219309cdc4d" returned: 0 in 0.295s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:30:12 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-3a0454a4-5a01-4bdb-ad33-cb6d9d2189f0 tempest-VolumesSnapshotTestJSON-982820329 None] Lock "cinder-quobyte-f7376d4e-7879-44e8-9d22-c219309cdc4d" released by "_delete_snapshot" :: held 1.687s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:30:12 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-3a0454a4-5a01-4bdb-ad33-cb6d9d2189f0 tempest-VolumesSnapshotTestJSON-982820329 None] Lock "cinder-quobyte-189aa1f5-b1d4-4b5e-a266-32b37558f6f1" released by "delete_snapshot" :: held 1.711s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:30:12 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-3a0454a4-5a01-4bdb-ad33-cb6d9d2189f0 tempest-VolumesSnapshotTestJSON-982820329 None] Created reservations ['84380fd1-25e0-42d3-aca7-f67beb210085', 'daa45be3-b009-46d5-95cf-5e6889b513f9', '7894ee1b-559b-46ef-893e-ff2b55cca0f0', '8b68b1fd-7d36-49e2-a4c5-fbde809433fc'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:30:12 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-3a0454a4-5a01-4bdb-ad33-cb6d9d2189f0 tempest-VolumesSnapshotTestJSON-982820329 None] Delete snapshot completed successfully. Sep 16 20:30:12 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-3a0454a4-5a01-4bdb-ad33-cb6d9d2189f0 tempest-VolumesSnapshotTestJSON-982820329 None] Lock "cinder-f7376d4e-7879-44e8-9d22-c219309cdc4d-delete_snapshot" released by "delete_snapshot" :: held 1.921s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:30:12 devstack sudo[100114]: pam_unix(sudo:session): session closed for user root Sep 16 20:30:12 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-51e41d98-0eb2-4a8c-ab0a-393889c9cc05 tempest-VolumesGetTest-1431096848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a212e3b8-b8ec-455f-a5ca-3a2229830050" returned: 0 in 0.270s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:30:12 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-51e41d98-0eb2-4a8c-ab0a-393889c9cc05 tempest-VolumesGetTest-1431096848 None] Lock "cinder-quobyte-a212e3b8-b8ec-455f-a5ca-3a2229830050" released by "delete_volume" :: held 0.795s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:30:12 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-51e41d98-0eb2-4a8c-ab0a-393889c9cc05 tempest-VolumesGetTest-1431096848 None] Created reservations ['bc152d7d-2830-43d5-8191-8ec8eb2eedff', '0d3872cd-20c2-4f51-ad53-a8513f9518c3', '630df02f-1424-45d6-bb0f-b1fdd56baea3', '62a37559-a57e-4055-9bf4-c34386bd40b2'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:30:12 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-51e41d98-0eb2-4a8c-ab0a-393889c9cc05 tempest-VolumesGetTest-1431096848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:30:12 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-51e41d98-0eb2-4a8c-ab0a-393889c9cc05 tempest-VolumesGetTest-1431096848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:30:12 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-51e41d98-0eb2-4a8c-ab0a-393889c9cc05 tempest-VolumesGetTest-1431096848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:30:12 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-51e41d98-0eb2-4a8c-ab0a-393889c9cc05 tempest-VolumesGetTest-1431096848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:30:12 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-51e41d98-0eb2-4a8c-ab0a-393889c9cc05 tempest-VolumesGetTest-1431096848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:30:12 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-51e41d98-0eb2-4a8c-ab0a-393889c9cc05 tempest-VolumesGetTest-1431096848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:30:12 devstack sudo[100117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:30:12 devstack sudo[100117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:30:13 devstack sudo[100117]: pam_unix(sudo:session): session closed for user root Sep 16 20:30:13 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-51e41d98-0eb2-4a8c-ab0a-393889c9cc05 tempest-VolumesGetTest-1431096848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.335s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:30:13 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-51e41d98-0eb2-4a8c-ab0a-393889c9cc05 tempest-VolumesGetTest-1431096848 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:30:13 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-51e41d98-0eb2-4a8c-ab0a-393889c9cc05 tempest-VolumesGetTest-1431096848 None] Deleted volume successfully. Sep 16 20:30:13 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-51e41d98-0eb2-4a8c-ab0a-393889c9cc05 tempest-VolumesGetTest-1431096848 None] Lock "cinder-a212e3b8-b8ec-455f-a5ca-3a2229830050-delete_volume" released by "delete_volume" :: held 1.373s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:30:13 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-030d88cb-035b-4ff0-be2e-2c3e0da6273c tempest-VolumesSnapshotTestJSON-982820329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:30:13 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-030d88cb-035b-4ff0-be2e-2c3e0da6273c tempest-VolumesSnapshotTestJSON-982820329 None] Flow 'volume_create_manager' (74713f70-8600-41fc-a5f0-afc27f6f95c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:30:13 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-030d88cb-035b-4ff0-be2e-2c3e0da6273c tempest-VolumesSnapshotTestJSON-982820329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a13b45b-f3d9-41a8-af9a-ed07429dee15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:30:13 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-030d88cb-035b-4ff0-be2e-2c3e0da6273c tempest-VolumesSnapshotTestJSON-982820329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a13b45b-f3d9-41a8-af9a-ed07429dee15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:30:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1226514765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=252cf731-7631-4458-9f0c-d82d236a3026,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b14473e8191340baa0f17e6030fae9fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:30:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:30:14Z,use_quota=True,user_id='02d8e75db6aa44c9b5660aa9226f8e20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:30:13 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-030d88cb-035b-4ff0-be2e-2c3e0da6273c tempest-VolumesSnapshotTestJSON-982820329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2f1d4fc-6c51-4f06-87e8-d58e9cce80d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:30:13 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-030d88cb-035b-4ff0-be2e-2c3e0da6273c tempest-VolumesSnapshotTestJSON-982820329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2f1d4fc-6c51-4f06-87e8-d58e9cce80d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:30:13 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-030d88cb-035b-4ff0-be2e-2c3e0da6273c tempest-VolumesSnapshotTestJSON-982820329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73f32681-c523-4656-887b-617b80b3ea25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:30:13 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-030d88cb-035b-4ff0-be2e-2c3e0da6273c tempest-VolumesSnapshotTestJSON-982820329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73f32681-c523-4656-887b-617b80b3ea25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '252cf731-7631-4458-9f0c-d82d236a3026', 'volume_name': 'volume-252cf731-7631-4458-9f0c-d82d236a3026', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:30:13 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-030d88cb-035b-4ff0-be2e-2c3e0da6273c tempest-VolumesSnapshotTestJSON-982820329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e32470e6-41e8-4695-9657-0e9b83043c3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:30:13 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-030d88cb-035b-4ff0-be2e-2c3e0da6273c tempest-VolumesSnapshotTestJSON-982820329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e32470e6-41e8-4695-9657-0e9b83043c3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:30:13 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-030d88cb-035b-4ff0-be2e-2c3e0da6273c tempest-VolumesSnapshotTestJSON-982820329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fbb2e75-cb18-4811-9839-ba6e124dda79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:30:13 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-030d88cb-035b-4ff0-be2e-2c3e0da6273c tempest-VolumesSnapshotTestJSON-982820329 None] Volume 252cf731-7631-4458-9f0c-d82d236a3026: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-252cf731-7631-4458-9f0c-d82d236a3026', 'volume_size': 1} Sep 16 20:30:13 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-030d88cb-035b-4ff0-be2e-2c3e0da6273c tempest-VolumesSnapshotTestJSON-982820329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:30:13 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-030d88cb-035b-4ff0-be2e-2c3e0da6273c tempest-VolumesSnapshotTestJSON-982820329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:30:13 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-030d88cb-035b-4ff0-be2e-2c3e0da6273c tempest-VolumesSnapshotTestJSON-982820329 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:30:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1226514765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=252cf731-7631-4458-9f0c-d82d236a3026,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b14473e8191340baa0f17e6030fae9fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:30:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:30:14Z,use_quota=True,user_id='02d8e75db6aa44c9b5660aa9226f8e20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:30:13 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-030d88cb-035b-4ff0-be2e-2c3e0da6273c tempest-VolumesSnapshotTestJSON-982820329 None] Creating volume 252cf731-7631-4458-9f0c-d82d236a3026 {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:30:13 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-030d88cb-035b-4ff0-be2e-2c3e0da6273c tempest-VolumesSnapshotTestJSON-982820329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:30:13 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-030d88cb-035b-4ff0-be2e-2c3e0da6273c tempest-VolumesSnapshotTestJSON-982820329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:30:13 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-030d88cb-035b-4ff0-be2e-2c3e0da6273c tempest-VolumesSnapshotTestJSON-982820329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:30:13 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-030d88cb-035b-4ff0-be2e-2c3e0da6273c tempest-VolumesSnapshotTestJSON-982820329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:30:13 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-030d88cb-035b-4ff0-be2e-2c3e0da6273c tempest-VolumesSnapshotTestJSON-982820329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:30:13 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-030d88cb-035b-4ff0-be2e-2c3e0da6273c tempest-VolumesSnapshotTestJSON-982820329 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:30:13 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-030d88cb-035b-4ff0-be2e-2c3e0da6273c tempest-VolumesSnapshotTestJSON-982820329 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:30:13 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-030d88cb-035b-4ff0-be2e-2c3e0da6273c tempest-VolumesSnapshotTestJSON-982820329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-252cf731-7631-4458-9f0c-d82d236a3026 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:30:13 devstack sudo[100124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-252cf731-7631-4458-9f0c-d82d236a3026 1073741824 Sep 16 20:30:13 devstack sudo[100124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:30:13 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-6315b75c-cdab-4c96-ab1b-7a78d3972c8d tempest-VolumesGetTest-1431096848 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:30:13 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-6315b75c-cdab-4c96-ab1b-7a78d3972c8d tempest-VolumesGetTest-1431096848 None] Flow 'volume_create_manager' (e7a35d22-ee86-457a-b563-19b6c908fad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:30:13 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-6315b75c-cdab-4c96-ab1b-7a78d3972c8d tempest-VolumesGetTest-1431096848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cce0291e-cda8-4265-ad0a-4c9c5ea06b85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:30:13 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-6315b75c-cdab-4c96-ab1b-7a78d3972c8d tempest-VolumesGetTest-1431096848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cce0291e-cda8-4265-ad0a-4c9c5ea06b85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:30:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-69907948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87144b85-b957-4dbe-861b-b6914a97a185,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f71bf8bb99894f1d87c310177b239798',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:30:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:30:14Z,use_quota=True,user_id='1e0a03b0f86d497299b719cf3b8e51bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:30:13 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-6315b75c-cdab-4c96-ab1b-7a78d3972c8d tempest-VolumesGetTest-1431096848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbad40ff-2ab5-4a6b-a596-71bdbf73b730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:30:13 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-6315b75c-cdab-4c96-ab1b-7a78d3972c8d tempest-VolumesGetTest-1431096848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbad40ff-2ab5-4a6b-a596-71bdbf73b730) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:30:14 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-6315b75c-cdab-4c96-ab1b-7a78d3972c8d tempest-VolumesGetTest-1431096848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3036d3c5-ebfe-4226-950f-ea4d48bb21a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:30:14 devstack cinder-volume[86188]: DEBUG cinder.image.glance [None req-6315b75c-cdab-4c96-ab1b-7a78d3972c8d tempest-VolumesGetTest-1431096848 None] Creating Keystone auth plugin from conf {{(pid=86188) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 16 20:30:14 devstack sudo[100124]: pam_unix(sudo:session): session closed for user root Sep 16 20:30:14 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-030d88cb-035b-4ff0-be2e-2c3e0da6273c tempest-VolumesSnapshotTestJSON-982820329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-252cf731-7631-4458-9f0c-d82d236a3026 1073741824" returned: 0 in 0.528s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:30:14 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-030d88cb-035b-4ff0-be2e-2c3e0da6273c tempest-VolumesSnapshotTestJSON-982820329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-252cf731-7631-4458-9f0c-d82d236a3026 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:30:14 devstack sudo[100138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-252cf731-7631-4458-9f0c-d82d236a3026 Sep 16 20:30:14 devstack sudo[100138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:30:14 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-6315b75c-cdab-4c96-ab1b-7a78d3972c8d tempest-VolumesGetTest-1431096848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3036d3c5-ebfe-4226-950f-ea4d48bb21a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '87144b85-b957-4dbe-861b-b6914a97a185', 'volume_name': 'volume-87144b85-b957-4dbe-861b-b6914a97a185', 'volume_size': 1, 'image_id': 'b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5c9c8eab814247029b6d508a74a1d19e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e', 'created_at': datetime.datetime(2026, 9, 16, 18, 12, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 18, 12, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:30:14 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-6315b75c-cdab-4c96-ab1b-7a78d3972c8d tempest-VolumesGetTest-1431096848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d356a8ab-6d3a-4f61-b24a-6e4c6a943ce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:30:14 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-6315b75c-cdab-4c96-ab1b-7a78d3972c8d tempest-VolumesGetTest-1431096848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d356a8ab-6d3a-4f61-b24a-6e4c6a943ce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:30:14 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-6315b75c-cdab-4c96-ab1b-7a78d3972c8d tempest-VolumesGetTest-1431096848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e018af0e-7309-4126-b6f6-45fa7213fb5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:30:14 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-6315b75c-cdab-4c96-ab1b-7a78d3972c8d tempest-VolumesGetTest-1431096848 None] Volume 87144b85-b957-4dbe-861b-b6914a97a185: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-87144b85-b957-4dbe-861b-b6914a97a185', 'volume_size': 1, 'image_id': 'b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5c9c8eab814247029b6d508a74a1d19e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e', 'created_at': datetime.datetime(2026, 9, 16, 18, 12, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 18, 12, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 16 20:30:14 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-6315b75c-cdab-4c96-ab1b-7a78d3972c8d tempest-VolumesGetTest-1431096848 None] Trying to clone 87144b85-b957-4dbe-861b-b6914a97a185 from image b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e at location (None, [{'url': 'file:///opt/stack/data/glance/images/b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e', 'metadata': {}}]). {{(pid=86188) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 16 20:30:14 devstack sudo[100138]: pam_unix(sudo:session): session closed for user root Sep 16 20:30:14 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-030d88cb-035b-4ff0-be2e-2c3e0da6273c tempest-VolumesSnapshotTestJSON-982820329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-252cf731-7631-4458-9f0c-d82d236a3026" returned: 0 in 0.285s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:30:14 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-030d88cb-035b-4ff0-be2e-2c3e0da6273c tempest-VolumesSnapshotTestJSON-982820329 None] <== create_volume: return (864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:30:14 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-030d88cb-035b-4ff0-be2e-2c3e0da6273c tempest-VolumesSnapshotTestJSON-982820329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.867s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:30:14 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-030d88cb-035b-4ff0-be2e-2c3e0da6273c tempest-VolumesSnapshotTestJSON-982820329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fbb2e75-cb18-4811-9839-ba6e124dda79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-252cf731-7631-4458-9f0c-d82d236a3026', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:30:14 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-030d88cb-035b-4ff0-be2e-2c3e0da6273c tempest-VolumesSnapshotTestJSON-982820329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21fa4bf9-15d7-4d88-ad53-af204b68994a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:30:14 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-030d88cb-035b-4ff0-be2e-2c3e0da6273c tempest-VolumesSnapshotTestJSON-982820329 None] Volume volume-252cf731-7631-4458-9f0c-d82d236a3026 (252cf731-7631-4458-9f0c-d82d236a3026): created successfully Sep 16 20:30:14 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-030d88cb-035b-4ff0-be2e-2c3e0da6273c tempest-VolumesSnapshotTestJSON-982820329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21fa4bf9-15d7-4d88-ad53-af204b68994a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:30:14 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-030d88cb-035b-4ff0-be2e-2c3e0da6273c tempest-VolumesSnapshotTestJSON-982820329 None] Flow 'volume_create_manager' (74713f70-8600-41fc-a5f0-afc27f6f95c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:30:14 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-030d88cb-035b-4ff0-be2e-2c3e0da6273c tempest-VolumesSnapshotTestJSON-982820329 None] Created volume successfully. Sep 16 20:30:14 devstack cinder-volume[86188]: DEBUG cinder.image.image_utils [None req-6315b75c-cdab-4c96-ab1b-7a78d3972c8d tempest-VolumesGetTest-1431096848 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e_8g70_l_ddevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86188) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 16 20:30:14 devstack cinder-volume[86188]: INFO cinder.image.image_utils [None req-6315b75c-cdab-4c96-ab1b-7a78d3972c8d tempest-VolumesGetTest-1431096848 None] Image download 20.69 MB at 20.69 MB/s Sep 16 20:30:14 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[582872e6-d457-4cfd-b572-7ccaa59165d0]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:30:14 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-6315b75c-cdab-4c96-ab1b-7a78d3972c8d tempest-VolumesGetTest-1431096848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e_8g70_l_ddevstack@QuobyteHD {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:30:14 devstack sudo[100152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e_8g70_l_ddevstack@QuobyteHD Sep 16 20:30:14 devstack sudo[100152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:30:15 devstack sudo[100152]: pam_unix(sudo:session): session closed for user root Sep 16 20:30:15 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-6315b75c-cdab-4c96-ab1b-7a78d3972c8d tempest-VolumesGetTest-1431096848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e_8g70_l_ddevstack@QuobyteHD" returned: 0 in 0.362s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:30:15 devstack cinder-volume[86188]: DEBUG cinder.image.image_utils [None req-6315b75c-cdab-4c96-ab1b-7a78d3972c8d tempest-VolumesGetTest-1431096848 None] Temporary image b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e is fetched for user 1e0a03b0f86d497299b719cf3b8e51bc. {{(pid=86188) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 16 20:30:15 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[25dc6b06-7019-45bc-8b02-1f919f57f23e]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:30:15 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-6315b75c-cdab-4c96-ab1b-7a78d3972c8d tempest-VolumesGetTest-1431096848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e_8g70_l_ddevstack@QuobyteHD {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:30:15 devstack sudo[100158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e_8g70_l_ddevstack@QuobyteHD Sep 16 20:30:15 devstack sudo[100158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:30:15 devstack cinder-volume[86188]: INFO cinder.volume.manager [req-24cbb3b8-ee56-45a2-8950-493bba1b4a0a req-7413edee-aed8-462b-a723-805ab3094588 tempest-TestInstancesWithCinderVolumes-1553461958 None] Terminate volume connection completed successfully. Sep 16 20:30:15 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [req-24cbb3b8-ee56-45a2-8950-493bba1b4a0a req-7413edee-aed8-462b-a723-805ab3094588 tempest-TestInstancesWithCinderVolumes-1553461958 None] Deleting attachment b08a8e7b-50b7-42db-a85c-4da394549e3e. {{(pid=86188) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 16 20:30:15 devstack sudo[100158]: pam_unix(sudo:session): session closed for user root Sep 16 20:30:15 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-6315b75c-cdab-4c96-ab1b-7a78d3972c8d tempest-VolumesGetTest-1431096848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e_8g70_l_ddevstack@QuobyteHD" returned: 0 in 0.353s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:30:15 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-6315b75c-cdab-4c96-ab1b-7a78d3972c8d tempest-VolumesGetTest-1431096848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:30:15 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-6315b75c-cdab-4c96-ab1b-7a78d3972c8d tempest-VolumesGetTest-1431096848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:30:15 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-6315b75c-cdab-4c96-ab1b-7a78d3972c8d tempest-VolumesGetTest-1431096848 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:30:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-69907948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87144b85-b957-4dbe-861b-b6914a97a185,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f71bf8bb99894f1d87c310177b239798',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:30:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:30:14Z,use_quota=True,user_id='1e0a03b0f86d497299b719cf3b8e51bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:30:15 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-6315b75c-cdab-4c96-ab1b-7a78d3972c8d tempest-VolumesGetTest-1431096848 None] Creating volume 87144b85-b957-4dbe-861b-b6914a97a185 {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:30:15 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-6315b75c-cdab-4c96-ab1b-7a78d3972c8d tempest-VolumesGetTest-1431096848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:30:15 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-6315b75c-cdab-4c96-ab1b-7a78d3972c8d tempest-VolumesGetTest-1431096848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:30:15 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-6315b75c-cdab-4c96-ab1b-7a78d3972c8d tempest-VolumesGetTest-1431096848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:30:15 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-6315b75c-cdab-4c96-ab1b-7a78d3972c8d tempest-VolumesGetTest-1431096848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:30:15 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-6315b75c-cdab-4c96-ab1b-7a78d3972c8d tempest-VolumesGetTest-1431096848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:30:15 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-6315b75c-cdab-4c96-ab1b-7a78d3972c8d tempest-VolumesGetTest-1431096848 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:30:15 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-6315b75c-cdab-4c96-ab1b-7a78d3972c8d tempest-VolumesGetTest-1431096848 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:30:15 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-6315b75c-cdab-4c96-ab1b-7a78d3972c8d tempest-VolumesGetTest-1431096848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-87144b85-b957-4dbe-861b-b6914a97a185 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:30:15 devstack sudo[100165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-87144b85-b957-4dbe-861b-b6914a97a185 1073741824 Sep 16 20:30:15 devstack sudo[100165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:30:15 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-40802e59-f833-4f99-a6ab-bba583b10853 tempest-VolumesSnapshotTestJSON-982820329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:30:16 devstack sudo[100165]: pam_unix(sudo:session): session closed for user root Sep 16 20:30:16 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-6315b75c-cdab-4c96-ab1b-7a78d3972c8d tempest-VolumesGetTest-1431096848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-87144b85-b957-4dbe-861b-b6914a97a185 1073741824" returned: 0 in 0.453s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:30:16 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-6315b75c-cdab-4c96-ab1b-7a78d3972c8d tempest-VolumesGetTest-1431096848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-87144b85-b957-4dbe-861b-b6914a97a185 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:30:16 devstack sudo[100171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-87144b85-b957-4dbe-861b-b6914a97a185 Sep 16 20:30:16 devstack sudo[100171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:30:16 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-82221b4a-b919-4187-9007-254a068a245b tempest-TestInstancesWithCinderVolumes-1553461958 None] Acquiring lock "cinder-3b0f4d04-de77-46dd-b428-982c9e7d7f82-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:30:16 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-82221b4a-b919-4187-9007-254a068a245b tempest-TestInstancesWithCinderVolumes-1553461958 None] Lock "cinder-3b0f4d04-de77-46dd-b428-982c9e7d7f82-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:30:16 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-82221b4a-b919-4187-9007-254a068a245b tempest-TestInstancesWithCinderVolumes-1553461958 None] Acquiring lock "cinder-quobyte-3b0f4d04-de77-46dd-b428-982c9e7d7f82" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:30:16 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-82221b4a-b919-4187-9007-254a068a245b tempest-TestInstancesWithCinderVolumes-1553461958 None] Lock "cinder-quobyte-3b0f4d04-de77-46dd-b428-982c9e7d7f82" acquired by "delete_volume" :: waited 0.014s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:30:16 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9f9ae09-4ef8-48a5-b009-1042160f81b9]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:30:16 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-82221b4a-b919-4187-9007-254a068a245b tempest-TestInstancesWithCinderVolumes-1553461958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-3b0f4d04-de77-46dd-b428-982c9e7d7f82 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:30:16 devstack sudo[100171]: pam_unix(sudo:session): session closed for user root Sep 16 20:30:16 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-6315b75c-cdab-4c96-ab1b-7a78d3972c8d tempest-VolumesGetTest-1431096848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-87144b85-b957-4dbe-861b-b6914a97a185" returned: 0 in 0.275s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:30:16 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-6315b75c-cdab-4c96-ab1b-7a78d3972c8d tempest-VolumesGetTest-1431096848 None] <== create_volume: return (772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:30:16 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-6315b75c-cdab-4c96-ab1b-7a78d3972c8d tempest-VolumesGetTest-1431096848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.777s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:30:16 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-40802e59-f833-4f99-a6ab-bba583b10853 tempest-VolumesSnapshotTestJSON-982820329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.518s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:30:16 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-40802e59-f833-4f99-a6ab-bba583b10853 tempest-VolumesSnapshotTestJSON-982820329 None] Creating offline snapshot 8c6605e9-fd84-49da-b43b-8b7dff088f5d of volume 252cf731-7631-4458-9f0c-d82d236a3026 {{(pid=86188) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 20:30:16 devstack cinder-volume[86188]: DEBUG cinder.volume.volume_utils [None req-6315b75c-cdab-4c96-ab1b-7a78d3972c8d tempest-VolumesGetTest-1431096848 None] Attempting download of b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e ((None, [{'url': 'file:///opt/stack/data/glance/images/b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e', 'metadata': {}}])) to volume 87144b85-b957-4dbe-861b-b6914a97a185. {{(pid=86188) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 16 20:30:16 devstack sudo[100177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-3b0f4d04-de77-46dd-b428-982c9e7d7f82 Sep 16 20:30:16 devstack sudo[100177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:30:16 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea3c9d76-5367-4e71-9e08-f9e8c3fb4570]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:30:16 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-40802e59-f833-4f99-a6ab-bba583b10853 tempest-VolumesSnapshotTestJSON-982820329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-252cf731-7631-4458-9f0c-d82d236a3026 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:30:16 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec193485-3a38-4b12-9b41-e7da9a8de74c]: (4, 'raw') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:30:16 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-6315b75c-cdab-4c96-ab1b-7a78d3972c8d tempest-VolumesGetTest-1431096848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e_j4x1z77g {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:30:16 devstack sudo[100180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-252cf731-7631-4458-9f0c-d82d236a3026 Sep 16 20:30:16 devstack sudo[100180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:30:16 devstack sudo[100181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e_j4x1z77g Sep 16 20:30:16 devstack sudo[100181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:30:16 devstack sudo[100177]: pam_unix(sudo:session): session closed for user root Sep 16 20:30:16 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-82221b4a-b919-4187-9007-254a068a245b tempest-TestInstancesWithCinderVolumes-1553461958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-3b0f4d04-de77-46dd-b428-982c9e7d7f82" returned: 0 in 0.412s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:30:16 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-82221b4a-b919-4187-9007-254a068a245b tempest-TestInstancesWithCinderVolumes-1553461958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-3b0f4d04-de77-46dd-b428-982c9e7d7f82 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:30:16 devstack sudo[100187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-3b0f4d04-de77-46dd-b428-982c9e7d7f82 Sep 16 20:30:16 devstack sudo[100187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:30:16 devstack sudo[100180]: pam_unix(sudo:session): session closed for user root Sep 16 20:30:16 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-40802e59-f833-4f99-a6ab-bba583b10853 tempest-VolumesSnapshotTestJSON-982820329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-252cf731-7631-4458-9f0c-d82d236a3026" returned: 0 in 0.411s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:30:16 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-40802e59-f833-4f99-a6ab-bba583b10853 tempest-VolumesSnapshotTestJSON-982820329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-252cf731-7631-4458-9f0c-d82d236a3026,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-252cf731-7631-4458-9f0c-d82d236a3026.8c6605e9-fd84-49da-b43b-8b7dff088f5d 1G {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:30:16 devstack sudo[100194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-252cf731-7631-4458-9f0c-d82d236a3026,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-252cf731-7631-4458-9f0c-d82d236a3026.8c6605e9-fd84-49da-b43b-8b7dff088f5d 1G Sep 16 20:30:16 devstack sudo[100194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:30:16 devstack sudo[100181]: pam_unix(sudo:session): session closed for user root Sep 16 20:30:16 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-6315b75c-cdab-4c96-ab1b-7a78d3972c8d tempest-VolumesGetTest-1431096848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e_j4x1z77g" returned: 0 in 0.411s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:30:16 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-6315b75c-cdab-4c96-ab1b-7a78d3972c8d tempest-VolumesGetTest-1431096848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e_j4x1z77g {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:30:17 devstack sudo[100197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e_j4x1z77g Sep 16 20:30:17 devstack sudo[100197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:30:17 devstack sudo[100187]: pam_unix(sudo:session): session closed for user root Sep 16 20:30:17 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-82221b4a-b919-4187-9007-254a068a245b tempest-TestInstancesWithCinderVolumes-1553461958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-3b0f4d04-de77-46dd-b428-982c9e7d7f82" returned: 0 in 0.347s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:30:17 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-82221b4a-b919-4187-9007-254a068a245b tempest-TestInstancesWithCinderVolumes-1553461958 None] Lock "cinder-quobyte-3b0f4d04-de77-46dd-b428-982c9e7d7f82" released by "delete_volume" :: held 0.815s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:30:17 devstack cinder-volume[86188]: WARNING cinder.quota [None req-82221b4a-b919-4187-9007-254a068a245b tempest-TestInstancesWithCinderVolumes-1553461958 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1239930081-2116017416 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1239930081-2116017416, it is now deprecated. Please use the default quota class for default quota. Sep 16 20:30:17 devstack cinder-volume[86188]: WARNING cinder.quota [None req-82221b4a-b919-4187-9007-254a068a245b tempest-TestInstancesWithCinderVolumes-1553461958 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1239930081-2116017416 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1239930081-2116017416, it is now deprecated. Please use the default quota class for default quota. Sep 16 20:30:17 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-82221b4a-b919-4187-9007-254a068a245b tempest-TestInstancesWithCinderVolumes-1553461958 None] Created reservations ['f6502324-31b4-4bca-84c6-addd07619a49', 'e070c2ab-f438-4237-9bdf-8e7c43e9964e', '55536991-7e04-4fe1-be3b-6c10d8534f68', 'b1cd5ba2-5c56-40f0-a133-0cedc82fbbff'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:30:17 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-82221b4a-b919-4187-9007-254a068a245b tempest-TestInstancesWithCinderVolumes-1553461958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:30:17 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-82221b4a-b919-4187-9007-254a068a245b tempest-TestInstancesWithCinderVolumes-1553461958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:30:17 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-82221b4a-b919-4187-9007-254a068a245b tempest-TestInstancesWithCinderVolumes-1553461958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:30:17 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-82221b4a-b919-4187-9007-254a068a245b tempest-TestInstancesWithCinderVolumes-1553461958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:30:17 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-82221b4a-b919-4187-9007-254a068a245b tempest-TestInstancesWithCinderVolumes-1553461958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:30:17 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-82221b4a-b919-4187-9007-254a068a245b tempest-TestInstancesWithCinderVolumes-1553461958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:30:17 devstack sudo[100203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:30:17 devstack sudo[100203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:30:17 devstack sudo[100197]: pam_unix(sudo:session): session closed for user root Sep 16 20:30:17 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-6315b75c-cdab-4c96-ab1b-7a78d3972c8d tempest-VolumesGetTest-1431096848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e_j4x1z77g" returned: 1 in 0.399s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:30:17 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-6315b75c-cdab-4c96-ab1b-7a78d3972c8d tempest-VolumesGetTest-1431096848 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e_j4x1z77g' failed. Not Retrying. {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 16 20:30:17 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[477e09a7-9943-4ae9-aef0-fb358eb460e6]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:30:17 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-6315b75c-cdab-4c96-ab1b-7a78d3972c8d tempest-VolumesGetTest-1431096848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e_8g70_l_ddevstack@QuobyteHD {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:30:17 devstack sudo[100194]: pam_unix(sudo:session): session closed for user root Sep 16 20:30:17 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-40802e59-f833-4f99-a6ab-bba583b10853 tempest-VolumesSnapshotTestJSON-982820329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-252cf731-7631-4458-9f0c-d82d236a3026,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-252cf731-7631-4458-9f0c-d82d236a3026.8c6605e9-fd84-49da-b43b-8b7dff088f5d 1G" returned: 0 in 0.494s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:30:17 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-40802e59-f833-4f99-a6ab-bba583b10853 tempest-VolumesSnapshotTestJSON-982820329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-252cf731-7631-4458-9f0c-d82d236a3026 -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-252cf731-7631-4458-9f0c-d82d236a3026.8c6605e9-fd84-49da-b43b-8b7dff088f5d {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:30:17 devstack sudo[100209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-252cf731-7631-4458-9f0c-d82d236a3026 -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-252cf731-7631-4458-9f0c-d82d236a3026.8c6605e9-fd84-49da-b43b-8b7dff088f5d Sep 16 20:30:17 devstack sudo[100209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:30:17 devstack sudo[100208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e_8g70_l_ddevstack@QuobyteHD Sep 16 20:30:17 devstack sudo[100208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:30:17 devstack sudo[100203]: pam_unix(sudo:session): session closed for user root Sep 16 20:30:17 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-82221b4a-b919-4187-9007-254a068a245b tempest-TestInstancesWithCinderVolumes-1553461958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.287s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:30:17 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-82221b4a-b919-4187-9007-254a068a245b tempest-TestInstancesWithCinderVolumes-1553461958 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:30:17 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-82221b4a-b919-4187-9007-254a068a245b tempest-TestInstancesWithCinderVolumes-1553461958 None] Deleted volume successfully. Sep 16 20:30:17 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-82221b4a-b919-4187-9007-254a068a245b tempest-TestInstancesWithCinderVolumes-1553461958 None] Lock "cinder-3b0f4d04-de77-46dd-b428-982c9e7d7f82-delete_volume" released by "delete_volume" :: held 1.337s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:30:17 devstack sudo[100209]: pam_unix(sudo:session): session closed for user root Sep 16 20:30:17 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-40802e59-f833-4f99-a6ab-bba583b10853 tempest-VolumesSnapshotTestJSON-982820329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-252cf731-7631-4458-9f0c-d82d236a3026 -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-252cf731-7631-4458-9f0c-d82d236a3026.8c6605e9-fd84-49da-b43b-8b7dff088f5d" returned: 0 in 0.311s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:30:17 devstack cinder-volume[86188]: WARNING cinder.volume.drivers.remotefs [None req-40802e59-f833-4f99-a6ab-bba583b10853 tempest-VolumesSnapshotTestJSON-982820329 None] /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-252cf731-7631-4458-9f0c-d82d236a3026.8c6605e9-fd84-49da-b43b-8b7dff088f5d is being set with open permissions: ugo+rw Sep 16 20:30:17 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-40802e59-f833-4f99-a6ab-bba583b10853 tempest-VolumesSnapshotTestJSON-982820329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-252cf731-7631-4458-9f0c-d82d236a3026.8c6605e9-fd84-49da-b43b-8b7dff088f5d {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:30:17 devstack sudo[100208]: pam_unix(sudo:session): session closed for user root Sep 16 20:30:17 devstack sudo[100219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-252cf731-7631-4458-9f0c-d82d236a3026.8c6605e9-fd84-49da-b43b-8b7dff088f5d Sep 16 20:30:17 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-6315b75c-cdab-4c96-ab1b-7a78d3972c8d tempest-VolumesGetTest-1431096848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e_8g70_l_ddevstack@QuobyteHD" returned: 0 in 0.389s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:30:17 devstack cinder-volume[86188]: DEBUG cinder.image.image_utils [None req-6315b75c-cdab-4c96-ab1b-7a78d3972c8d tempest-VolumesGetTest-1431096848 None] b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e was qcow2, converting to qcow2 {{(pid=86188) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 16 20:30:17 devstack sudo[100219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:30:17 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-6315b75c-cdab-4c96-ab1b-7a78d3972c8d tempest-VolumesGetTest-1431096848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e_8g70_l_ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-87144b85-b957-4dbe-861b-b6914a97a185 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:30:17 devstack sudo[100221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e_8g70_l_ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-87144b85-b957-4dbe-861b-b6914a97a185 Sep 16 20:30:17 devstack sudo[100221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:30:17 devstack sudo[100219]: pam_unix(sudo:session): session closed for user root Sep 16 20:30:17 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-40802e59-f833-4f99-a6ab-bba583b10853 tempest-VolumesSnapshotTestJSON-982820329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-252cf731-7631-4458-9f0c-d82d236a3026.8c6605e9-fd84-49da-b43b-8b7dff088f5d" returned: 0 in 0.259s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:30:17 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-40802e59-f833-4f99-a6ab-bba583b10853 tempest-VolumesSnapshotTestJSON-982820329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-252cf731-7631-4458-9f0c-d82d236a3026.info {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:30:17 devstack sudo[100227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-252cf731-7631-4458-9f0c-d82d236a3026.info Sep 16 20:30:17 devstack sudo[100227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:30:18 devstack sudo[100227]: pam_unix(sudo:session): session closed for user root Sep 16 20:30:18 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-40802e59-f833-4f99-a6ab-bba583b10853 tempest-VolumesSnapshotTestJSON-982820329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-252cf731-7631-4458-9f0c-d82d236a3026.info" returned: 0 in 0.293s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:30:18 devstack cinder-volume[86188]: WARNING cinder.volume.drivers.remotefs [None req-40802e59-f833-4f99-a6ab-bba583b10853 tempest-VolumesSnapshotTestJSON-982820329 None] /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-252cf731-7631-4458-9f0c-d82d236a3026.info is being set with open permissions: ugo+rw Sep 16 20:30:18 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-40802e59-f833-4f99-a6ab-bba583b10853 tempest-VolumesSnapshotTestJSON-982820329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-252cf731-7631-4458-9f0c-d82d236a3026.info {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:30:18 devstack sudo[100236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-252cf731-7631-4458-9f0c-d82d236a3026.info Sep 16 20:30:18 devstack sudo[100236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:30:18 devstack sudo[100236]: pam_unix(sudo:session): session closed for user root Sep 16 20:30:18 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-40802e59-f833-4f99-a6ab-bba583b10853 tempest-VolumesSnapshotTestJSON-982820329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-252cf731-7631-4458-9f0c-d82d236a3026.info" returned: 0 in 0.303s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:30:18 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-40802e59-f833-4f99-a6ab-bba583b10853 tempest-VolumesSnapshotTestJSON-982820329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.258s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:30:18 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-40802e59-f833-4f99-a6ab-bba583b10853 tempest-VolumesSnapshotTestJSON-982820329 None] Create snapshot completed successfully Sep 16 20:30:19 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cf344bd-08a8-46c1-89ea-885fc9b7d7ba tempest-VolumesSnapshotTestJSON-982820329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:30:19 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-7cf344bd-08a8-46c1-89ea-885fc9b7d7ba tempest-VolumesSnapshotTestJSON-982820329 None] Flow 'volume_create_manager' (378325e1-a746-4f5a-9162-e7e703c2f2e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:30:19 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-7cf344bd-08a8-46c1-89ea-885fc9b7d7ba tempest-VolumesSnapshotTestJSON-982820329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0071731a-8b20-4783-86c4-026d6d07aa0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:30:19 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-7cf344bd-08a8-46c1-89ea-885fc9b7d7ba tempest-VolumesSnapshotTestJSON-982820329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0071731a-8b20-4783-86c4-026d6d07aa0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:30:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-620870933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f6f727b-6ef1-4af0-bd2f-85071589a0cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b14473e8191340baa0f17e6030fae9fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:30:19Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=8c6605e9-fd84-49da-b43b-8b7dff088f5d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:30:19Z,use_quota=True,user_id='02d8e75db6aa44c9b5660aa9226f8e20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:30:19 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-7cf344bd-08a8-46c1-89ea-885fc9b7d7ba tempest-VolumesSnapshotTestJSON-982820329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e29ec1d8-2a97-47d7-8ddf-bf7d240aa496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:30:19 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-7cf344bd-08a8-46c1-89ea-885fc9b7d7ba tempest-VolumesSnapshotTestJSON-982820329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e29ec1d8-2a97-47d7-8ddf-bf7d240aa496) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:30:19 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-7cf344bd-08a8-46c1-89ea-885fc9b7d7ba tempest-VolumesSnapshotTestJSON-982820329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e04952c6-8839-4329-8b1b-93ab8191e21b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:30:19 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-7cf344bd-08a8-46c1-89ea-885fc9b7d7ba tempest-VolumesSnapshotTestJSON-982820329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e04952c6-8839-4329-8b1b-93ab8191e21b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8f6f727b-6ef1-4af0-bd2f-85071589a0cd', 'volume_name': 'volume-8f6f727b-6ef1-4af0-bd2f-85071589a0cd', 'volume_size': 2, 'snapshot_id': '8c6605e9-fd84-49da-b43b-8b7dff088f5d'}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:30:19 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-7cf344bd-08a8-46c1-89ea-885fc9b7d7ba tempest-VolumesSnapshotTestJSON-982820329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a12b268-3254-4116-8ff1-9423ae7a1ff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:30:19 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-7cf344bd-08a8-46c1-89ea-885fc9b7d7ba tempest-VolumesSnapshotTestJSON-982820329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a12b268-3254-4116-8ff1-9423ae7a1ff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:30:19 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-7cf344bd-08a8-46c1-89ea-885fc9b7d7ba tempest-VolumesSnapshotTestJSON-982820329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ba163f2-18af-4fcd-844b-7067417cf20a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:30:19 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-7cf344bd-08a8-46c1-89ea-885fc9b7d7ba tempest-VolumesSnapshotTestJSON-982820329 None] Volume 8f6f727b-6ef1-4af0-bd2f-85071589a0cd: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8f6f727b-6ef1-4af0-bd2f-85071589a0cd', 'volume_size': 2, 'snapshot_id': '8c6605e9-fd84-49da-b43b-8b7dff088f5d'} Sep 16 20:30:19 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-7cf344bd-08a8-46c1-89ea-885fc9b7d7ba tempest-VolumesSnapshotTestJSON-982820329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:30:19 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-7cf344bd-08a8-46c1-89ea-885fc9b7d7ba tempest-VolumesSnapshotTestJSON-982820329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:30:19 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-7cf344bd-08a8-46c1-89ea-885fc9b7d7ba tempest-VolumesSnapshotTestJSON-982820329 None] Acquiring lock "cinder-quobyte-8c6605e9-fd84-49da-b43b-8b7dff088f5d-8f6f727b-6ef1-4af0-bd2f-85071589a0cd" by "_create_volume_from_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:30:19 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-7cf344bd-08a8-46c1-89ea-885fc9b7d7ba tempest-VolumesSnapshotTestJSON-982820329 None] Lock "cinder-quobyte-8c6605e9-fd84-49da-b43b-8b7dff088f5d-8f6f727b-6ef1-4af0-bd2f-85071589a0cd" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:30:19 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-7cf344bd-08a8-46c1-89ea-885fc9b7d7ba tempest-VolumesSnapshotTestJSON-982820329 None] Creating volume 8f6f727b-6ef1-4af0-bd2f-85071589a0cd from snapshot 8c6605e9-fd84-49da-b43b-8b7dff088f5d {{(pid=86188) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 16 20:30:19 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-7cf344bd-08a8-46c1-89ea-885fc9b7d7ba tempest-VolumesSnapshotTestJSON-982820329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:30:19 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-7cf344bd-08a8-46c1-89ea-885fc9b7d7ba tempest-VolumesSnapshotTestJSON-982820329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:30:19 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-7cf344bd-08a8-46c1-89ea-885fc9b7d7ba tempest-VolumesSnapshotTestJSON-982820329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:30:19 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-7cf344bd-08a8-46c1-89ea-885fc9b7d7ba tempest-VolumesSnapshotTestJSON-982820329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:30:19 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-7cf344bd-08a8-46c1-89ea-885fc9b7d7ba tempest-VolumesSnapshotTestJSON-982820329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:30:19 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-7cf344bd-08a8-46c1-89ea-885fc9b7d7ba tempest-VolumesSnapshotTestJSON-982820329 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:30:19 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-7cf344bd-08a8-46c1-89ea-885fc9b7d7ba tempest-VolumesSnapshotTestJSON-982820329 None] Acquiring lock "cinder-quobyte-8f6f727b-6ef1-4af0-bd2f-85071589a0cd" by "_copy_volume_from_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:30:19 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-7cf344bd-08a8-46c1-89ea-885fc9b7d7ba tempest-VolumesSnapshotTestJSON-982820329 None] Lock "cinder-quobyte-8f6f727b-6ef1-4af0-bd2f-85071589a0cd" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:30:19 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-7cf344bd-08a8-46c1-89ea-885fc9b7d7ba tempest-VolumesSnapshotTestJSON-982820329 None] snapshot: 8c6605e9-fd84-49da-b43b-8b7dff088f5d, volume: 8f6f727b-6ef1-4af0-bd2f-85071589a0cd, {{(pid=86188) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 16 20:30:19 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-7cf344bd-08a8-46c1-89ea-885fc9b7d7ba tempest-VolumesSnapshotTestJSON-982820329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:30:19 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-7cf344bd-08a8-46c1-89ea-885fc9b7d7ba tempest-VolumesSnapshotTestJSON-982820329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:30:19 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-7cf344bd-08a8-46c1-89ea-885fc9b7d7ba tempest-VolumesSnapshotTestJSON-982820329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:30:19 devstack sudo[100221]: pam_unix(sudo:session): session closed for user root Sep 16 20:30:19 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-7cf344bd-08a8-46c1-89ea-885fc9b7d7ba tempest-VolumesSnapshotTestJSON-982820329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:30:19 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-7cf344bd-08a8-46c1-89ea-885fc9b7d7ba tempest-VolumesSnapshotTestJSON-982820329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:30:19 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-6315b75c-cdab-4c96-ab1b-7a78d3972c8d tempest-VolumesGetTest-1431096848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e_8g70_l_ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-87144b85-b957-4dbe-861b-b6914a97a185" returned: 0 in 2.086s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:30:19 devstack cinder-volume[86188]: DEBUG cinder.image.image_utils [None req-6315b75c-cdab-4c96-ab1b-7a78d3972c8d tempest-VolumesGetTest-1431096848 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e_8g70_l_ddevstack@QuobyteHD, size 112.00 MB, duration 2.09 sec, destination /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-87144b85-b957-4dbe-861b-b6914a97a185 {{(pid=86188) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 16 20:30:19 devstack cinder-volume[86188]: INFO cinder.image.image_utils [None req-6315b75c-cdab-4c96-ab1b-7a78d3972c8d tempest-VolumesGetTest-1431096848 None] Converted 112.00 MB image at 53.67 MB/s Sep 16 20:30:19 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-6315b75c-cdab-4c96-ab1b-7a78d3972c8d tempest-VolumesGetTest-1431096848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-87144b85-b957-4dbe-861b-b6914a97a185 1G {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:30:19 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[94d56fb0-58a5-4898-bbe9-4a356c262781]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:30:19 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-7cf344bd-08a8-46c1-89ea-885fc9b7d7ba tempest-VolumesSnapshotTestJSON-982820329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-252cf731-7631-4458-9f0c-d82d236a3026.8c6605e9-fd84-49da-b43b-8b7dff088f5d {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:30:19 devstack sudo[100262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-87144b85-b957-4dbe-861b-b6914a97a185 1G Sep 16 20:30:19 devstack sudo[100262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:30:19 devstack sudo[100263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-252cf731-7631-4458-9f0c-d82d236a3026.8c6605e9-fd84-49da-b43b-8b7dff088f5d Sep 16 20:30:19 devstack sudo[100263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:30:20 devstack sudo[100262]: pam_unix(sudo:session): session closed for user root Sep 16 20:30:20 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-6315b75c-cdab-4c96-ab1b-7a78d3972c8d tempest-VolumesGetTest-1431096848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-87144b85-b957-4dbe-861b-b6914a97a185 1G" returned: 0 in 0.378s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:30:20 devstack cinder-volume[86188]: DEBUG cinder.volume.volume_utils [None req-6315b75c-cdab-4c96-ab1b-7a78d3972c8d tempest-VolumesGetTest-1431096848 None] Downloaded image b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e ((None, [{'url': 'file:///opt/stack/data/glance/images/b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e', 'metadata': {}}])) to volume 87144b85-b957-4dbe-861b-b6914a97a185 successfully. {{(pid=86188) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 16 20:30:20 devstack cinder-volume[86188]: DEBUG cinder.image.image_utils [None req-6315b75c-cdab-4c96-ab1b-7a78d3972c8d tempest-VolumesGetTest-1431096848 None] Temporary image b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e for user 1e0a03b0f86d497299b719cf3b8e51bc is deleted. {{(pid=86188) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 16 20:30:20 devstack cinder-volume[86188]: DEBUG cinder.volume.volume_utils [None req-6315b75c-cdab-4c96-ab1b-7a78d3972c8d tempest-VolumesGetTest-1431096848 None] Marking volume 87144b85-b957-4dbe-861b-b6914a97a185 as bootable. {{(pid=86188) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 16 20:30:20 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-6315b75c-cdab-4c96-ab1b-7a78d3972c8d tempest-VolumesGetTest-1431096848 None] Copying metadata from image b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e to 87144b85-b957-4dbe-861b-b6914a97a185. {{(pid=86188) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 16 20:30:20 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-6315b75c-cdab-4c96-ab1b-7a78d3972c8d tempest-VolumesGetTest-1431096848 None] Creating volume glance metadata for volume 87144b85-b957-4dbe-861b-b6914a97a185 backed by image b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86188) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 16 20:30:20 devstack sudo[100263]: pam_unix(sudo:session): session closed for user root Sep 16 20:30:20 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-7cf344bd-08a8-46c1-89ea-885fc9b7d7ba tempest-VolumesSnapshotTestJSON-982820329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-252cf731-7631-4458-9f0c-d82d236a3026.8c6605e9-fd84-49da-b43b-8b7dff088f5d" returned: 0 in 0.469s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:30:20 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-7cf344bd-08a8-46c1-89ea-885fc9b7d7ba tempest-VolumesSnapshotTestJSON-982820329 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-252cf731-7631-4458-9f0c-d82d236a3026(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86188) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 20:30:20 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[37468a32-c173-4ecf-9678-94459611f2f3]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:30:20 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-7cf344bd-08a8-46c1-89ea-885fc9b7d7ba tempest-VolumesSnapshotTestJSON-982820329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-252cf731-7631-4458-9f0c-d82d236a3026 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:30:20 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-6315b75c-cdab-4c96-ab1b-7a78d3972c8d tempest-VolumesGetTest-1431096848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e018af0e-7309-4126-b6f6-45fa7213fb5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87144b85-b957-4dbe-861b-b6914a97a185', 'volume_size': 1, 'image_id': 'b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5c9c8eab814247029b6d508a74a1d19e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e', 'created_at': datetime.datetime(2026, 9, 16, 18, 12, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 18, 12, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:30:20 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-6315b75c-cdab-4c96-ab1b-7a78d3972c8d tempest-VolumesGetTest-1431096848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (390f41ef-eb2f-4fa8-9fa9-ddbfbe8c2cf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:30:20 devstack cinder-volume[86188]: INFO cinder.volume.manager [req-d88e1e61-c70e-4846-9c88-eda5b7273004 req-b7c631ae-6524-4bbb-a242-0619b4e399a7 tempest-TestInstancesWithCinderVolumes-1553461958 None] Terminate volume connection completed successfully. Sep 16 20:30:20 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [req-d88e1e61-c70e-4846-9c88-eda5b7273004 req-b7c631ae-6524-4bbb-a242-0619b4e399a7 tempest-TestInstancesWithCinderVolumes-1553461958 None] Deleting attachment 2c3e3018-cca8-45d1-9f82-9ad108d02af4. {{(pid=86188) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 16 20:30:20 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-6315b75c-cdab-4c96-ab1b-7a78d3972c8d tempest-VolumesGetTest-1431096848 None] Volume volume-87144b85-b957-4dbe-861b-b6914a97a185 (87144b85-b957-4dbe-861b-b6914a97a185): created successfully Sep 16 20:30:20 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-6315b75c-cdab-4c96-ab1b-7a78d3972c8d tempest-VolumesGetTest-1431096848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (390f41ef-eb2f-4fa8-9fa9-ddbfbe8c2cf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:30:20 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-6315b75c-cdab-4c96-ab1b-7a78d3972c8d tempest-VolumesGetTest-1431096848 None] Flow 'volume_create_manager' (e7a35d22-ee86-457a-b563-19b6c908fad9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:30:20 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-6315b75c-cdab-4c96-ab1b-7a78d3972c8d tempest-VolumesGetTest-1431096848 None] Created volume successfully. Sep 16 20:30:20 devstack sudo[100276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-252cf731-7631-4458-9f0c-d82d236a3026 Sep 16 20:30:20 devstack sudo[100276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:30:20 devstack sudo[100276]: pam_unix(sudo:session): session closed for user root Sep 16 20:30:20 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-7cf344bd-08a8-46c1-89ea-885fc9b7d7ba tempest-VolumesSnapshotTestJSON-982820329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-252cf731-7631-4458-9f0c-d82d236a3026" returned: 0 in 0.370s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:30:20 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-7cf344bd-08a8-46c1-89ea-885fc9b7d7ba tempest-VolumesSnapshotTestJSON-982820329 None] will copy from snapshot at /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-252cf731-7631-4458-9f0c-d82d236a3026 {{(pid=86188) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 16 20:30:20 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-7cf344bd-08a8-46c1-89ea-885fc9b7d7ba tempest-VolumesSnapshotTestJSON-982820329 None] Creating direct copy from snapshot {{(pid=86188) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 16 20:30:20 devstack cinder-volume[86188]: DEBUG cinder.utils [None req-7cf344bd-08a8-46c1-89ea-885fc9b7d7ba tempest-VolumesSnapshotTestJSON-982820329 None] Path /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-8f6f727b-6ef1-4af0-bd2f-85071589a0cd not found in is_blk_device check {{(pid=86188) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 16 20:30:20 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-7cf344bd-08a8-46c1-89ea-885fc9b7d7ba tempest-VolumesSnapshotTestJSON-982820329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-252cf731-7631-4458-9f0c-d82d236a3026 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-8f6f727b-6ef1-4af0-bd2f-85071589a0cd {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:30:20 devstack sudo[100281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-252cf731-7631-4458-9f0c-d82d236a3026 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-8f6f727b-6ef1-4af0-bd2f-85071589a0cd Sep 16 20:30:20 devstack sudo[100281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:30:21 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-92de1c41-e0ae-45d8-9918-3d1bcef502b3 tempest-TestInstancesWithCinderVolumes-1553461958 None] Acquiring lock "cinder-808d0b31-b417-4b34-9976-d150b62aeb2a-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:30:21 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-92de1c41-e0ae-45d8-9918-3d1bcef502b3 tempest-TestInstancesWithCinderVolumes-1553461958 None] Lock "cinder-808d0b31-b417-4b34-9976-d150b62aeb2a-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:30:21 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-92de1c41-e0ae-45d8-9918-3d1bcef502b3 tempest-TestInstancesWithCinderVolumes-1553461958 None] Acquiring lock "cinder-quobyte-808d0b31-b417-4b34-9976-d150b62aeb2a" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:30:21 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-92de1c41-e0ae-45d8-9918-3d1bcef502b3 tempest-TestInstancesWithCinderVolumes-1553461958 None] Lock "cinder-quobyte-808d0b31-b417-4b34-9976-d150b62aeb2a" acquired by "delete_volume" :: waited 0.032s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:30:21 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fa40534-2381-4cb3-9d5c-3f15df610a00]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:30:21 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-92de1c41-e0ae-45d8-9918-3d1bcef502b3 tempest-TestInstancesWithCinderVolumes-1553461958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-808d0b31-b417-4b34-9976-d150b62aeb2a {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:30:21 devstack sudo[100293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-808d0b31-b417-4b34-9976-d150b62aeb2a Sep 16 20:30:21 devstack sudo[100293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:30:22 devstack sudo[100293]: pam_unix(sudo:session): session closed for user root Sep 16 20:30:22 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-92de1c41-e0ae-45d8-9918-3d1bcef502b3 tempest-TestInstancesWithCinderVolumes-1553461958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-808d0b31-b417-4b34-9976-d150b62aeb2a" returned: 0 in 0.702s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:30:22 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-92de1c41-e0ae-45d8-9918-3d1bcef502b3 tempest-TestInstancesWithCinderVolumes-1553461958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-808d0b31-b417-4b34-9976-d150b62aeb2a {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:30:22 devstack sudo[100298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-808d0b31-b417-4b34-9976-d150b62aeb2a Sep 16 20:30:22 devstack sudo[100298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:30:22 devstack sudo[100298]: pam_unix(sudo:session): session closed for user root Sep 16 20:30:22 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-92de1c41-e0ae-45d8-9918-3d1bcef502b3 tempest-TestInstancesWithCinderVolumes-1553461958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-808d0b31-b417-4b34-9976-d150b62aeb2a" returned: 0 in 0.403s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:30:22 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-92de1c41-e0ae-45d8-9918-3d1bcef502b3 tempest-TestInstancesWithCinderVolumes-1553461958 None] Lock "cinder-quobyte-808d0b31-b417-4b34-9976-d150b62aeb2a" released by "delete_volume" :: held 1.196s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:30:22 devstack cinder-volume[86188]: WARNING cinder.quota [None req-92de1c41-e0ae-45d8-9918-3d1bcef502b3 tempest-TestInstancesWithCinderVolumes-1553461958 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-697838381-1781211010 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-697838381-1781211010, it is now deprecated. Please use the default quota class for default quota. Sep 16 20:30:22 devstack cinder-volume[86188]: WARNING cinder.quota [None req-92de1c41-e0ae-45d8-9918-3d1bcef502b3 tempest-TestInstancesWithCinderVolumes-1553461958 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-697838381-1781211010 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-697838381-1781211010, it is now deprecated. Please use the default quota class for default quota. Sep 16 20:30:22 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-92de1c41-e0ae-45d8-9918-3d1bcef502b3 tempest-TestInstancesWithCinderVolumes-1553461958 None] Created reservations ['e137b7e7-2955-4bd1-9e11-7da593115621', '97226f3b-af4e-4db1-969b-efe011313b00', '2b844cea-5225-4cb2-bb49-05cd4e3f69ea', '20c1ade7-7b17-494c-be05-b51c07c74f34'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:30:22 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-92de1c41-e0ae-45d8-9918-3d1bcef502b3 tempest-TestInstancesWithCinderVolumes-1553461958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:30:22 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-92de1c41-e0ae-45d8-9918-3d1bcef502b3 tempest-TestInstancesWithCinderVolumes-1553461958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:30:22 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-92de1c41-e0ae-45d8-9918-3d1bcef502b3 tempest-TestInstancesWithCinderVolumes-1553461958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:30:22 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-92de1c41-e0ae-45d8-9918-3d1bcef502b3 tempest-TestInstancesWithCinderVolumes-1553461958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:30:22 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-92de1c41-e0ae-45d8-9918-3d1bcef502b3 tempest-TestInstancesWithCinderVolumes-1553461958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:30:22 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-92de1c41-e0ae-45d8-9918-3d1bcef502b3 tempest-TestInstancesWithCinderVolumes-1553461958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:30:22 devstack sudo[100301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:30:22 devstack sudo[100301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:30:23 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-7371ef85-d3b0-45ae-9ac5-b74f2e6b4a40 tempest-VolumesGetTest-1431096848 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:30:23 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-7371ef85-d3b0-45ae-9ac5-b74f2e6b4a40 tempest-VolumesGetTest-1431096848 None] Flow 'volume_create_manager' (ddf113a3-9750-4270-ac56-0c12eb433c69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:30:23 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-7371ef85-d3b0-45ae-9ac5-b74f2e6b4a40 tempest-VolumesGetTest-1431096848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e42f1807-a06d-4595-a7a1-daed2c8196bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:30:23 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-7371ef85-d3b0-45ae-9ac5-b74f2e6b4a40 tempest-VolumesGetTest-1431096848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e42f1807-a06d-4595-a7a1-daed2c8196bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:30:23Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-637288411',display_name='tempest-VolumesGetTest-Volume-522434529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a326d4c1-225c-4180-8da7-1eac70df3a19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f71bf8bb99894f1d87c310177b239798',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:30:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:30:23Z,use_quota=True,user_id='1e0a03b0f86d497299b719cf3b8e51bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:30:23 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-7371ef85-d3b0-45ae-9ac5-b74f2e6b4a40 tempest-VolumesGetTest-1431096848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c08118d9-cc3b-46cb-bd0a-b40eb09b4122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:30:23 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-7371ef85-d3b0-45ae-9ac5-b74f2e6b4a40 tempest-VolumesGetTest-1431096848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c08118d9-cc3b-46cb-bd0a-b40eb09b4122) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:30:23 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-7371ef85-d3b0-45ae-9ac5-b74f2e6b4a40 tempest-VolumesGetTest-1431096848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c56de17-428b-47b3-a33f-70862ab6d208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:30:23 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-7371ef85-d3b0-45ae-9ac5-b74f2e6b4a40 tempest-VolumesGetTest-1431096848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c56de17-428b-47b3-a33f-70862ab6d208) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a326d4c1-225c-4180-8da7-1eac70df3a19', 'volume_name': 'volume-a326d4c1-225c-4180-8da7-1eac70df3a19', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:30:23 devstack sudo[100301]: pam_unix(sudo:session): session closed for user root Sep 16 20:30:23 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-7371ef85-d3b0-45ae-9ac5-b74f2e6b4a40 tempest-VolumesGetTest-1431096848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a0b970b-b198-48a9-8bdd-fdbb316d946c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:30:23 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-7371ef85-d3b0-45ae-9ac5-b74f2e6b4a40 tempest-VolumesGetTest-1431096848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a0b970b-b198-48a9-8bdd-fdbb316d946c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:30:23 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-7371ef85-d3b0-45ae-9ac5-b74f2e6b4a40 tempest-VolumesGetTest-1431096848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64d429fa-f6a9-4618-800f-8cf6a7473bfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:30:23 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-7371ef85-d3b0-45ae-9ac5-b74f2e6b4a40 tempest-VolumesGetTest-1431096848 None] Volume a326d4c1-225c-4180-8da7-1eac70df3a19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a326d4c1-225c-4180-8da7-1eac70df3a19', 'volume_size': 1} Sep 16 20:30:23 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-7371ef85-d3b0-45ae-9ac5-b74f2e6b4a40 tempest-VolumesGetTest-1431096848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:30:23 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-92de1c41-e0ae-45d8-9918-3d1bcef502b3 tempest-TestInstancesWithCinderVolumes-1553461958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.819s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:30:23 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-92de1c41-e0ae-45d8-9918-3d1bcef502b3 tempest-TestInstancesWithCinderVolumes-1553461958 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:30:23 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-92de1c41-e0ae-45d8-9918-3d1bcef502b3 tempest-TestInstancesWithCinderVolumes-1553461958 None] Deleted volume successfully. Sep 16 20:30:23 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-92de1c41-e0ae-45d8-9918-3d1bcef502b3 tempest-TestInstancesWithCinderVolumes-1553461958 None] Lock "cinder-808d0b31-b417-4b34-9976-d150b62aeb2a-delete_volume" released by "delete_volume" :: held 2.473s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:30:28 devstack cinder-volume[86188]: INFO cinder.volume.manager [req-492ff6f7-34d3-4891-9ea9-629302a48813 req-7867591f-d23b-40ca-bb23-92e846774c17 tempest-TestInstancesWithCinderVolumes-1553461958 None] Terminate volume connection completed successfully. Sep 16 20:30:28 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [req-492ff6f7-34d3-4891-9ea9-629302a48813 req-7867591f-d23b-40ca-bb23-92e846774c17 tempest-TestInstancesWithCinderVolumes-1553461958 None] Deleting attachment 0872f8be-7cc5-477b-b30e-cabcfbbf279c. {{(pid=86188) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 16 20:30:28 devstack sudo[100281]: pam_unix(sudo:session): session closed for user root Sep 16 20:30:28 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-7cf344bd-08a8-46c1-89ea-885fc9b7d7ba tempest-VolumesSnapshotTestJSON-982820329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-252cf731-7631-4458-9f0c-d82d236a3026 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-8f6f727b-6ef1-4af0-bd2f-85071589a0cd" returned: 0 in 8.040s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:30:28 devstack cinder-volume[86188]: DEBUG cinder.image.image_utils [None req-7cf344bd-08a8-46c1-89ea-885fc9b7d7ba tempest-VolumesSnapshotTestJSON-982820329 None] Image conversion details: src /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-252cf731-7631-4458-9f0c-d82d236a3026, size 1024.00 MB, duration 8.04 sec, destination /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-8f6f727b-6ef1-4af0-bd2f-85071589a0cd {{(pid=86188) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 16 20:30:28 devstack cinder-volume[86188]: INFO cinder.image.image_utils [None req-7cf344bd-08a8-46c1-89ea-885fc9b7d7ba tempest-VolumesSnapshotTestJSON-982820329 None] Converted 1024.00 MB image at 127.34 MB/s Sep 16 20:30:28 devstack cinder-volume[86188]: WARNING cinder.volume.drivers.remotefs [None req-7cf344bd-08a8-46c1-89ea-885fc9b7d7ba tempest-VolumesSnapshotTestJSON-982820329 None] /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-8f6f727b-6ef1-4af0-bd2f-85071589a0cd is being set with open permissions: ugo+rw Sep 16 20:30:28 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-7cf344bd-08a8-46c1-89ea-885fc9b7d7ba tempest-VolumesSnapshotTestJSON-982820329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-8f6f727b-6ef1-4af0-bd2f-85071589a0cd {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:30:28 devstack sudo[100332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-8f6f727b-6ef1-4af0-bd2f-85071589a0cd Sep 16 20:30:28 devstack sudo[100332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:30:28 devstack sudo[100332]: pam_unix(sudo:session): session closed for user root Sep 16 20:30:28 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-7cf344bd-08a8-46c1-89ea-885fc9b7d7ba tempest-VolumesSnapshotTestJSON-982820329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-8f6f727b-6ef1-4af0-bd2f-85071589a0cd" returned: 0 in 0.247s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:30:28 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-7cf344bd-08a8-46c1-89ea-885fc9b7d7ba tempest-VolumesSnapshotTestJSON-982820329 None] Lock "cinder-quobyte-8f6f727b-6ef1-4af0-bd2f-85071589a0cd" released by "_copy_volume_from_snapshot" :: held 9.234s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:30:29 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-7cf344bd-08a8-46c1-89ea-885fc9b7d7ba tempest-VolumesSnapshotTestJSON-982820329 None] Lock "cinder-quobyte-8c6605e9-fd84-49da-b43b-8b7dff088f5d-8f6f727b-6ef1-4af0-bd2f-85071589a0cd" released by "_create_volume_from_snapshot" :: held 9.312s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:30:29 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-7cf344bd-08a8-46c1-89ea-885fc9b7d7ba tempest-VolumesSnapshotTestJSON-982820329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.334s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:30:29 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-7371ef85-d3b0-45ae-9ac5-b74f2e6b4a40 tempest-VolumesGetTest-1431096848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.427s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:30:29 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-7371ef85-d3b0-45ae-9ac5-b74f2e6b4a40 tempest-VolumesGetTest-1431096848 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:30:23Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-637288411',display_name='tempest-VolumesGetTest-Volume-522434529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a326d4c1-225c-4180-8da7-1eac70df3a19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f71bf8bb99894f1d87c310177b239798',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:30:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:30:23Z,use_quota=True,user_id='1e0a03b0f86d497299b719cf3b8e51bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:30:29 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-7371ef85-d3b0-45ae-9ac5-b74f2e6b4a40 tempest-VolumesGetTest-1431096848 None] Creating volume a326d4c1-225c-4180-8da7-1eac70df3a19 {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:30:29 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-7371ef85-d3b0-45ae-9ac5-b74f2e6b4a40 tempest-VolumesGetTest-1431096848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:30:29 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-7371ef85-d3b0-45ae-9ac5-b74f2e6b4a40 tempest-VolumesGetTest-1431096848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:30:29 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-7371ef85-d3b0-45ae-9ac5-b74f2e6b4a40 tempest-VolumesGetTest-1431096848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:30:29 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-7371ef85-d3b0-45ae-9ac5-b74f2e6b4a40 tempest-VolumesGetTest-1431096848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:30:29 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-7371ef85-d3b0-45ae-9ac5-b74f2e6b4a40 tempest-VolumesGetTest-1431096848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:30:29 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-7371ef85-d3b0-45ae-9ac5-b74f2e6b4a40 tempest-VolumesGetTest-1431096848 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:30:29 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-7371ef85-d3b0-45ae-9ac5-b74f2e6b4a40 tempest-VolumesGetTest-1431096848 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:30:29 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-7371ef85-d3b0-45ae-9ac5-b74f2e6b4a40 tempest-VolumesGetTest-1431096848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a326d4c1-225c-4180-8da7-1eac70df3a19 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:30:29 devstack sudo[100335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a326d4c1-225c-4180-8da7-1eac70df3a19 1073741824 Sep 16 20:30:29 devstack sudo[100335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:30:29 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-7cf344bd-08a8-46c1-89ea-885fc9b7d7ba tempest-VolumesSnapshotTestJSON-982820329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ba163f2-18af-4fcd-844b-7067417cf20a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f6f727b-6ef1-4af0-bd2f-85071589a0cd', 'volume_size': 2, 'snapshot_id': '8c6605e9-fd84-49da-b43b-8b7dff088f5d'}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:30:29 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-7cf344bd-08a8-46c1-89ea-885fc9b7d7ba tempest-VolumesSnapshotTestJSON-982820329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93713faa-159c-40cc-94e8-e0ed63dc461e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:30:29 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-7cf344bd-08a8-46c1-89ea-885fc9b7d7ba tempest-VolumesSnapshotTestJSON-982820329 None] Volume volume-8f6f727b-6ef1-4af0-bd2f-85071589a0cd (8f6f727b-6ef1-4af0-bd2f-85071589a0cd): created successfully Sep 16 20:30:29 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-7cf344bd-08a8-46c1-89ea-885fc9b7d7ba tempest-VolumesSnapshotTestJSON-982820329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93713faa-159c-40cc-94e8-e0ed63dc461e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:30:29 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-7cf344bd-08a8-46c1-89ea-885fc9b7d7ba tempest-VolumesSnapshotTestJSON-982820329 None] Flow 'volume_create_manager' (378325e1-a746-4f5a-9162-e7e703c2f2e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:30:29 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-7cf344bd-08a8-46c1-89ea-885fc9b7d7ba tempest-VolumesSnapshotTestJSON-982820329 None] Created volume successfully. Sep 16 20:30:29 devstack sudo[100335]: pam_unix(sudo:session): session closed for user root Sep 16 20:30:29 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-7371ef85-d3b0-45ae-9ac5-b74f2e6b4a40 tempest-VolumesGetTest-1431096848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a326d4c1-225c-4180-8da7-1eac70df3a19 1073741824" returned: 0 in 0.442s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:30:29 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-7371ef85-d3b0-45ae-9ac5-b74f2e6b4a40 tempest-VolumesGetTest-1431096848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a326d4c1-225c-4180-8da7-1eac70df3a19 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:30:29 devstack sudo[100342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a326d4c1-225c-4180-8da7-1eac70df3a19 Sep 16 20:30:29 devstack sudo[100342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:30:29 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-be7a96d2-9c2a-4cb6-96a2-c3ba6602c83d tempest-VolumesSnapshotTestJSON-982820329 None] Acquiring lock "cinder-8f6f727b-6ef1-4af0-bd2f-85071589a0cd-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:30:29 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-be7a96d2-9c2a-4cb6-96a2-c3ba6602c83d tempest-VolumesSnapshotTestJSON-982820329 None] Lock "cinder-8f6f727b-6ef1-4af0-bd2f-85071589a0cd-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:30:29 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-be7a96d2-9c2a-4cb6-96a2-c3ba6602c83d tempest-VolumesSnapshotTestJSON-982820329 None] Acquiring lock "cinder-quobyte-8f6f727b-6ef1-4af0-bd2f-85071589a0cd" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:30:29 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-be7a96d2-9c2a-4cb6-96a2-c3ba6602c83d tempest-VolumesSnapshotTestJSON-982820329 None] Lock "cinder-quobyte-8f6f727b-6ef1-4af0-bd2f-85071589a0cd" acquired by "delete_volume" :: waited 0.014s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:30:29 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c653eb6-04ce-475a-b3da-593e2990aa29]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:30:29 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-be7a96d2-9c2a-4cb6-96a2-c3ba6602c83d tempest-VolumesSnapshotTestJSON-982820329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-8f6f727b-6ef1-4af0-bd2f-85071589a0cd {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:30:29 devstack sudo[100342]: pam_unix(sudo:session): session closed for user root Sep 16 20:30:29 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-7371ef85-d3b0-45ae-9ac5-b74f2e6b4a40 tempest-VolumesGetTest-1431096848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a326d4c1-225c-4180-8da7-1eac70df3a19" returned: 0 in 0.252s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:30:29 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-7371ef85-d3b0-45ae-9ac5-b74f2e6b4a40 tempest-VolumesGetTest-1431096848 None] <== create_volume: return (730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:30:29 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-7371ef85-d3b0-45ae-9ac5-b74f2e6b4a40 tempest-VolumesGetTest-1431096848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.733s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:30:29 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-7371ef85-d3b0-45ae-9ac5-b74f2e6b4a40 tempest-VolumesGetTest-1431096848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64d429fa-f6a9-4618-800f-8cf6a7473bfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a326d4c1-225c-4180-8da7-1eac70df3a19', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:30:29 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-7371ef85-d3b0-45ae-9ac5-b74f2e6b4a40 tempest-VolumesGetTest-1431096848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5afcf97f-ea67-4abe-a5c8-1d06cf5c1dbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:30:29 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-7371ef85-d3b0-45ae-9ac5-b74f2e6b4a40 tempest-VolumesGetTest-1431096848 None] Volume volume-a326d4c1-225c-4180-8da7-1eac70df3a19 (a326d4c1-225c-4180-8da7-1eac70df3a19): created successfully Sep 16 20:30:29 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-7371ef85-d3b0-45ae-9ac5-b74f2e6b4a40 tempest-VolumesGetTest-1431096848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5afcf97f-ea67-4abe-a5c8-1d06cf5c1dbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:30:29 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-7371ef85-d3b0-45ae-9ac5-b74f2e6b4a40 tempest-VolumesGetTest-1431096848 None] Flow 'volume_create_manager' (ddf113a3-9750-4270-ac56-0c12eb433c69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:30:29 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-7371ef85-d3b0-45ae-9ac5-b74f2e6b4a40 tempest-VolumesGetTest-1431096848 None] Created volume successfully. Sep 16 20:30:29 devstack sudo[100345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-8f6f727b-6ef1-4af0-bd2f-85071589a0cd Sep 16 20:30:29 devstack sudo[100345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:30:30 devstack sudo[100345]: pam_unix(sudo:session): session closed for user root Sep 16 20:30:30 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-be7a96d2-9c2a-4cb6-96a2-c3ba6602c83d tempest-VolumesSnapshotTestJSON-982820329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-8f6f727b-6ef1-4af0-bd2f-85071589a0cd" returned: 0 in 0.361s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:30:30 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-be7a96d2-9c2a-4cb6-96a2-c3ba6602c83d tempest-VolumesSnapshotTestJSON-982820329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-8f6f727b-6ef1-4af0-bd2f-85071589a0cd {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:30:30 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-02cb58c9-7ebb-4ac9-afe5-a62202fbe015 tempest-VolumesGetTest-1431096848 None] Acquiring lock "cinder-a326d4c1-225c-4180-8da7-1eac70df3a19-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:30:30 devstack sudo[100350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-8f6f727b-6ef1-4af0-bd2f-85071589a0cd Sep 16 20:30:30 devstack sudo[100350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:30:30 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-02cb58c9-7ebb-4ac9-afe5-a62202fbe015 tempest-VolumesGetTest-1431096848 None] Lock "cinder-a326d4c1-225c-4180-8da7-1eac70df3a19-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:30:30 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-02cb58c9-7ebb-4ac9-afe5-a62202fbe015 tempest-VolumesGetTest-1431096848 None] Acquiring lock "cinder-quobyte-a326d4c1-225c-4180-8da7-1eac70df3a19" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:30:30 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-02cb58c9-7ebb-4ac9-afe5-a62202fbe015 tempest-VolumesGetTest-1431096848 None] Lock "cinder-quobyte-a326d4c1-225c-4180-8da7-1eac70df3a19" acquired by "delete_volume" :: waited 0.017s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:30:30 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c86cbcd-5160-4ca4-babe-ffe2e4bb6d15]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:30:30 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-02cb58c9-7ebb-4ac9-afe5-a62202fbe015 tempest-VolumesGetTest-1431096848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a326d4c1-225c-4180-8da7-1eac70df3a19 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:30:30 devstack sudo[100352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a326d4c1-225c-4180-8da7-1eac70df3a19 Sep 16 20:30:30 devstack sudo[100352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:30:30 devstack sudo[100350]: pam_unix(sudo:session): session closed for user root Sep 16 20:30:30 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-be7a96d2-9c2a-4cb6-96a2-c3ba6602c83d tempest-VolumesSnapshotTestJSON-982820329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-8f6f727b-6ef1-4af0-bd2f-85071589a0cd" returned: 0 in 0.252s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:30:30 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-be7a96d2-9c2a-4cb6-96a2-c3ba6602c83d tempest-VolumesSnapshotTestJSON-982820329 None] Lock "cinder-quobyte-8f6f727b-6ef1-4af0-bd2f-85071589a0cd" released by "delete_volume" :: held 0.662s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:30:30 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-fdd67a51-a9d1-4568-8d02-b9a3b66b2951 tempest-TestInstancesWithCinderVolumes-1553461958 None] Acquiring lock "cinder-ed767f87-8501-4441-b005-ce0270bb7fe7-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:30:30 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-fdd67a51-a9d1-4568-8d02-b9a3b66b2951 tempest-TestInstancesWithCinderVolumes-1553461958 None] Lock "cinder-ed767f87-8501-4441-b005-ce0270bb7fe7-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:30:30 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-be7a96d2-9c2a-4cb6-96a2-c3ba6602c83d tempest-VolumesSnapshotTestJSON-982820329 None] Created reservations ['c4e5149a-1fd6-4302-ae75-ad1be42680e1', 'cc788cf3-a487-4dfd-a3e7-2af3ed52cfb3', 'b1cbb5e2-d5ca-429d-a145-fde15cf0d4c7', 'be7c6423-5714-4200-9692-de36671214c1'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:30:30 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-fdd67a51-a9d1-4568-8d02-b9a3b66b2951 tempest-TestInstancesWithCinderVolumes-1553461958 None] Acquiring lock "cinder-quobyte-ed767f87-8501-4441-b005-ce0270bb7fe7" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:30:30 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-fdd67a51-a9d1-4568-8d02-b9a3b66b2951 tempest-TestInstancesWithCinderVolumes-1553461958 None] Lock "cinder-quobyte-ed767f87-8501-4441-b005-ce0270bb7fe7" acquired by "delete_volume" :: waited 0.025s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:30:30 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[3df531b1-9f30-42ca-ac19-530be4268759]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:30:30 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-fdd67a51-a9d1-4568-8d02-b9a3b66b2951 tempest-TestInstancesWithCinderVolumes-1553461958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ed767f87-8501-4441-b005-ce0270bb7fe7 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:30:30 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-be7a96d2-9c2a-4cb6-96a2-c3ba6602c83d tempest-VolumesSnapshotTestJSON-982820329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:30:30 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-be7a96d2-9c2a-4cb6-96a2-c3ba6602c83d tempest-VolumesSnapshotTestJSON-982820329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:30:30 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-be7a96d2-9c2a-4cb6-96a2-c3ba6602c83d tempest-VolumesSnapshotTestJSON-982820329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:30:30 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-be7a96d2-9c2a-4cb6-96a2-c3ba6602c83d tempest-VolumesSnapshotTestJSON-982820329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:30:30 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-be7a96d2-9c2a-4cb6-96a2-c3ba6602c83d tempest-VolumesSnapshotTestJSON-982820329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:30:30 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-be7a96d2-9c2a-4cb6-96a2-c3ba6602c83d tempest-VolumesSnapshotTestJSON-982820329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:30:30 devstack sudo[100360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:30:30 devstack sudo[100360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:30:30 devstack sudo[100352]: pam_unix(sudo:session): session closed for user root Sep 16 20:30:30 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-02cb58c9-7ebb-4ac9-afe5-a62202fbe015 tempest-VolumesGetTest-1431096848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a326d4c1-225c-4180-8da7-1eac70df3a19" returned: 0 in 0.411s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:30:30 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-02cb58c9-7ebb-4ac9-afe5-a62202fbe015 tempest-VolumesGetTest-1431096848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a326d4c1-225c-4180-8da7-1eac70df3a19 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:30:30 devstack sudo[100362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a326d4c1-225c-4180-8da7-1eac70df3a19 Sep 16 20:30:30 devstack sudo[100358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ed767f87-8501-4441-b005-ce0270bb7fe7 Sep 16 20:30:30 devstack sudo[100358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:30:30 devstack sudo[100362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:30:30 devstack sudo[100360]: pam_unix(sudo:session): session closed for user root Sep 16 20:30:30 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-be7a96d2-9c2a-4cb6-96a2-c3ba6602c83d tempest-VolumesSnapshotTestJSON-982820329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.292s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:30:30 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-be7a96d2-9c2a-4cb6-96a2-c3ba6602c83d tempest-VolumesSnapshotTestJSON-982820329 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:30:30 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-be7a96d2-9c2a-4cb6-96a2-c3ba6602c83d tempest-VolumesSnapshotTestJSON-982820329 None] Deleted volume successfully. Sep 16 20:30:30 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-ba2e832f-9875-4f66-a1a3-9493771d2856 tempest-VolumesSnapshotTestJSON-982820329 None] Acquiring lock "cinder-8c6605e9-fd84-49da-b43b-8b7dff088f5d-delete_snapshot" by "delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:30:30 devstack sudo[100362]: pam_unix(sudo:session): session closed for user root Sep 16 20:30:30 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-be7a96d2-9c2a-4cb6-96a2-c3ba6602c83d tempest-VolumesSnapshotTestJSON-982820329 None] Lock "cinder-8f6f727b-6ef1-4af0-bd2f-85071589a0cd-delete_volume" released by "delete_volume" :: held 1.255s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:30:30 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-ba2e832f-9875-4f66-a1a3-9493771d2856 tempest-VolumesSnapshotTestJSON-982820329 None] Lock "cinder-8c6605e9-fd84-49da-b43b-8b7dff088f5d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:30:30 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-ba2e832f-9875-4f66-a1a3-9493771d2856 tempest-VolumesSnapshotTestJSON-982820329 None] Acquiring lock "cinder-quobyte-252cf731-7631-4458-9f0c-d82d236a3026" by "delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:30:30 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-02cb58c9-7ebb-4ac9-afe5-a62202fbe015 tempest-VolumesGetTest-1431096848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a326d4c1-225c-4180-8da7-1eac70df3a19" returned: 0 in 0.300s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:30:30 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-02cb58c9-7ebb-4ac9-afe5-a62202fbe015 tempest-VolumesGetTest-1431096848 None] Lock "cinder-quobyte-a326d4c1-225c-4180-8da7-1eac70df3a19" released by "delete_volume" :: held 0.756s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:30:30 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-ba2e832f-9875-4f66-a1a3-9493771d2856 tempest-VolumesSnapshotTestJSON-982820329 None] Lock "cinder-quobyte-252cf731-7631-4458-9f0c-d82d236a3026" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:30:30 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-ba2e832f-9875-4f66-a1a3-9493771d2856 tempest-VolumesSnapshotTestJSON-982820329 None] Acquiring lock "cinder-quobyte-8c6605e9-fd84-49da-b43b-8b7dff088f5d" by "_delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:30:30 devstack sudo[100358]: pam_unix(sudo:session): session closed for user root Sep 16 20:30:30 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-ba2e832f-9875-4f66-a1a3-9493771d2856 tempest-VolumesSnapshotTestJSON-982820329 None] Lock "cinder-quobyte-8c6605e9-fd84-49da-b43b-8b7dff088f5d" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:30:30 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-ba2e832f-9875-4f66-a1a3-9493771d2856 tempest-VolumesSnapshotTestJSON-982820329 None] Deleting offline snapshot 8c6605e9-fd84-49da-b43b-8b7dff088f5d of volume 252cf731-7631-4458-9f0c-d82d236a3026 {{(pid=86188) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 20:30:30 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-ba2e832f-9875-4f66-a1a3-9493771d2856 tempest-VolumesSnapshotTestJSON-982820329 None] snapshot_file for this snap is: volume-252cf731-7631-4458-9f0c-d82d236a3026.8c6605e9-fd84-49da-b43b-8b7dff088f5d {{(pid=86188) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 20:30:30 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-fdd67a51-a9d1-4568-8d02-b9a3b66b2951 tempest-TestInstancesWithCinderVolumes-1553461958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ed767f87-8501-4441-b005-ce0270bb7fe7" returned: 0 in 0.451s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:30:30 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-fdd67a51-a9d1-4568-8d02-b9a3b66b2951 tempest-TestInstancesWithCinderVolumes-1553461958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ed767f87-8501-4441-b005-ce0270bb7fe7 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:30:30 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c29f8a8-b68c-488b-ab9e-2d054a9e845c]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:30:30 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ba2e832f-9875-4f66-a1a3-9493771d2856 tempest-VolumesSnapshotTestJSON-982820329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-252cf731-7631-4458-9f0c-d82d236a3026.8c6605e9-fd84-49da-b43b-8b7dff088f5d {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:30:30 devstack sudo[100370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ed767f87-8501-4441-b005-ce0270bb7fe7 Sep 16 20:30:30 devstack sudo[100370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:30:31 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-02cb58c9-7ebb-4ac9-afe5-a62202fbe015 tempest-VolumesGetTest-1431096848 None] Created reservations ['02009dfe-e77b-4ce6-978f-9fff88e9610f', '4d55bf3e-42e2-49e3-9ab6-519c39ed3203', 'def3774e-a6fe-41db-a4ed-b5d1ba6856b0', '8e7673a3-9a2a-46f5-a896-c4bfb3d587a8'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:30:31 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-02cb58c9-7ebb-4ac9-afe5-a62202fbe015 tempest-VolumesGetTest-1431096848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:30:31 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-02cb58c9-7ebb-4ac9-afe5-a62202fbe015 tempest-VolumesGetTest-1431096848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:30:31 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-02cb58c9-7ebb-4ac9-afe5-a62202fbe015 tempest-VolumesGetTest-1431096848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:30:31 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-02cb58c9-7ebb-4ac9-afe5-a62202fbe015 tempest-VolumesGetTest-1431096848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:30:31 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-02cb58c9-7ebb-4ac9-afe5-a62202fbe015 tempest-VolumesGetTest-1431096848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:30:31 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-02cb58c9-7ebb-4ac9-afe5-a62202fbe015 tempest-VolumesGetTest-1431096848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:30:31 devstack sudo[100371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-252cf731-7631-4458-9f0c-d82d236a3026.8c6605e9-fd84-49da-b43b-8b7dff088f5d Sep 16 20:30:31 devstack sudo[100371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:30:31 devstack sudo[100374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:30:31 devstack sudo[100374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:30:31 devstack sudo[100370]: pam_unix(sudo:session): session closed for user root Sep 16 20:30:31 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-fdd67a51-a9d1-4568-8d02-b9a3b66b2951 tempest-TestInstancesWithCinderVolumes-1553461958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ed767f87-8501-4441-b005-ce0270bb7fe7" returned: 0 in 0.277s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:30:31 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-fdd67a51-a9d1-4568-8d02-b9a3b66b2951 tempest-TestInstancesWithCinderVolumes-1553461958 None] Lock "cinder-quobyte-ed767f87-8501-4441-b005-ce0270bb7fe7" released by "delete_volume" :: held 0.775s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:30:31 devstack cinder-volume[86188]: WARNING cinder.quota [None req-fdd67a51-a9d1-4568-8d02-b9a3b66b2951 tempest-TestInstancesWithCinderVolumes-1553461958 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1499623114-481337389 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1499623114-481337389, it is now deprecated. Please use the default quota class for default quota. Sep 16 20:30:31 devstack cinder-volume[86188]: WARNING cinder.quota [None req-fdd67a51-a9d1-4568-8d02-b9a3b66b2951 tempest-TestInstancesWithCinderVolumes-1553461958 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1499623114-481337389 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1499623114-481337389, it is now deprecated. Please use the default quota class for default quota. Sep 16 20:30:31 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-fdd67a51-a9d1-4568-8d02-b9a3b66b2951 tempest-TestInstancesWithCinderVolumes-1553461958 None] Created reservations ['bd37e408-4003-44c2-b5b9-0147f150af93', '62245ba7-11a4-4d0d-9428-1fc2897c117b', '8326b7b5-bb70-4a9c-b9f7-f38cc582b9cc', '6c571a0e-f000-4288-9a3e-91920ccc2225'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:30:31 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-dd91cb0c-6bb3-40b9-8ff4-1d1ab38750bf tempest-VolumesGetTest-1431096848 None] Acquiring lock "cinder-87144b85-b957-4dbe-861b-b6914a97a185-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:30:31 devstack sudo[100374]: pam_unix(sudo:session): session closed for user root Sep 16 20:30:31 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-dd91cb0c-6bb3-40b9-8ff4-1d1ab38750bf tempest-VolumesGetTest-1431096848 None] Lock "cinder-87144b85-b957-4dbe-861b-b6914a97a185-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:30:31 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-02cb58c9-7ebb-4ac9-afe5-a62202fbe015 tempest-VolumesGetTest-1431096848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.301s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:30:31 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-02cb58c9-7ebb-4ac9-afe5-a62202fbe015 tempest-VolumesGetTest-1431096848 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:30:31 devstack sudo[100371]: pam_unix(sudo:session): session closed for user root Sep 16 20:30:31 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-02cb58c9-7ebb-4ac9-afe5-a62202fbe015 tempest-VolumesGetTest-1431096848 None] Deleted volume successfully. Sep 16 20:30:31 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ba2e832f-9875-4f66-a1a3-9493771d2856 tempest-VolumesSnapshotTestJSON-982820329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-252cf731-7631-4458-9f0c-d82d236a3026.8c6605e9-fd84-49da-b43b-8b7dff088f5d" returned: 0 in 0.448s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:30:31 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-ba2e832f-9875-4f66-a1a3-9493771d2856 tempest-VolumesSnapshotTestJSON-982820329 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-252cf731-7631-4458-9f0c-d82d236a3026(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86188) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 20:30:31 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d8bc4a6-ff0d-4439-b4e6-cb5a21e3e583]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:30:31 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ba2e832f-9875-4f66-a1a3-9493771d2856 tempest-VolumesSnapshotTestJSON-982820329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-252cf731-7631-4458-9f0c-d82d236a3026 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:30:31 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-02cb58c9-7ebb-4ac9-afe5-a62202fbe015 tempest-VolumesGetTest-1431096848 None] Lock "cinder-a326d4c1-225c-4180-8da7-1eac70df3a19-delete_volume" released by "delete_volume" :: held 1.359s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:30:31 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-fdd67a51-a9d1-4568-8d02-b9a3b66b2951 tempest-TestInstancesWithCinderVolumes-1553461958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:30:31 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-fdd67a51-a9d1-4568-8d02-b9a3b66b2951 tempest-TestInstancesWithCinderVolumes-1553461958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:30:31 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-fdd67a51-a9d1-4568-8d02-b9a3b66b2951 tempest-TestInstancesWithCinderVolumes-1553461958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:30:31 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-fdd67a51-a9d1-4568-8d02-b9a3b66b2951 tempest-TestInstancesWithCinderVolumes-1553461958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:30:31 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-fdd67a51-a9d1-4568-8d02-b9a3b66b2951 tempest-TestInstancesWithCinderVolumes-1553461958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:30:31 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-fdd67a51-a9d1-4568-8d02-b9a3b66b2951 tempest-TestInstancesWithCinderVolumes-1553461958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:30:31 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-dd91cb0c-6bb3-40b9-8ff4-1d1ab38750bf tempest-VolumesGetTest-1431096848 None] Acquiring lock "cinder-quobyte-87144b85-b957-4dbe-861b-b6914a97a185" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:30:31 devstack sudo[100382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:30:31 devstack sudo[100382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:30:31 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-dd91cb0c-6bb3-40b9-8ff4-1d1ab38750bf tempest-VolumesGetTest-1431096848 None] Lock "cinder-quobyte-87144b85-b957-4dbe-861b-b6914a97a185" acquired by "delete_volume" :: waited 0.023s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:30:31 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[c29723c8-a318-48f0-9368-bb2347186031]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:30:31 devstack sudo[100381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-252cf731-7631-4458-9f0c-d82d236a3026 Sep 16 20:30:31 devstack sudo[100381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:30:31 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-dd91cb0c-6bb3-40b9-8ff4-1d1ab38750bf tempest-VolumesGetTest-1431096848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-87144b85-b957-4dbe-861b-b6914a97a185 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:30:31 devstack sudo[100385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-87144b85-b957-4dbe-861b-b6914a97a185 Sep 16 20:30:31 devstack sudo[100385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:30:31 devstack sudo[100382]: pam_unix(sudo:session): session closed for user root Sep 16 20:30:31 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-fdd67a51-a9d1-4568-8d02-b9a3b66b2951 tempest-TestInstancesWithCinderVolumes-1553461958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.300s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:30:31 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-fdd67a51-a9d1-4568-8d02-b9a3b66b2951 tempest-TestInstancesWithCinderVolumes-1553461958 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:30:31 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-fdd67a51-a9d1-4568-8d02-b9a3b66b2951 tempest-TestInstancesWithCinderVolumes-1553461958 None] Deleted volume successfully. Sep 16 20:30:31 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-fdd67a51-a9d1-4568-8d02-b9a3b66b2951 tempest-TestInstancesWithCinderVolumes-1553461958 None] Lock "cinder-ed767f87-8501-4441-b005-ce0270bb7fe7-delete_volume" released by "delete_volume" :: held 1.407s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:30:31 devstack sudo[100385]: pam_unix(sudo:session): session closed for user root Sep 16 20:30:31 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-dd91cb0c-6bb3-40b9-8ff4-1d1ab38750bf tempest-VolumesGetTest-1431096848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-87144b85-b957-4dbe-861b-b6914a97a185" returned: 0 in 0.399s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:30:31 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-dd91cb0c-6bb3-40b9-8ff4-1d1ab38750bf tempest-VolumesGetTest-1431096848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-87144b85-b957-4dbe-861b-b6914a97a185 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:30:32 devstack sudo[100393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-87144b85-b957-4dbe-861b-b6914a97a185 Sep 16 20:30:32 devstack sudo[100393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:30:32 devstack sudo[100381]: pam_unix(sudo:session): session closed for user root Sep 16 20:30:32 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ba2e832f-9875-4f66-a1a3-9493771d2856 tempest-VolumesSnapshotTestJSON-982820329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-252cf731-7631-4458-9f0c-d82d236a3026" returned: 0 in 0.605s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:30:32 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ba2e832f-9875-4f66-a1a3-9493771d2856 tempest-VolumesSnapshotTestJSON-982820329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-252cf731-7631-4458-9f0c-d82d236a3026.8c6605e9-fd84-49da-b43b-8b7dff088f5d {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:30:32 devstack sudo[100396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-252cf731-7631-4458-9f0c-d82d236a3026.8c6605e9-fd84-49da-b43b-8b7dff088f5d Sep 16 20:30:32 devstack sudo[100396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:30:32 devstack sudo[100393]: pam_unix(sudo:session): session closed for user root Sep 16 20:30:32 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-dd91cb0c-6bb3-40b9-8ff4-1d1ab38750bf tempest-VolumesGetTest-1431096848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-87144b85-b957-4dbe-861b-b6914a97a185" returned: 0 in 0.294s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:30:32 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-dd91cb0c-6bb3-40b9-8ff4-1d1ab38750bf tempest-VolumesGetTest-1431096848 None] Lock "cinder-quobyte-87144b85-b957-4dbe-861b-b6914a97a185" released by "delete_volume" :: held 0.771s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:30:32 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-dd91cb0c-6bb3-40b9-8ff4-1d1ab38750bf tempest-VolumesGetTest-1431096848 None] Created reservations ['96bcd528-619d-4383-9649-5c490f8a2736', '03fca9b1-d96e-45f8-bb74-06dc7f58deb4', '9545e6fe-b5ea-4ab8-b553-3ecfd5f98452', '193f1bbc-1c38-422b-b2ae-8ea75d51f65a'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:30:32 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-dd91cb0c-6bb3-40b9-8ff4-1d1ab38750bf tempest-VolumesGetTest-1431096848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:30:32 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-dd91cb0c-6bb3-40b9-8ff4-1d1ab38750bf tempest-VolumesGetTest-1431096848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:30:32 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-dd91cb0c-6bb3-40b9-8ff4-1d1ab38750bf tempest-VolumesGetTest-1431096848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:30:32 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-dd91cb0c-6bb3-40b9-8ff4-1d1ab38750bf tempest-VolumesGetTest-1431096848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:30:32 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-dd91cb0c-6bb3-40b9-8ff4-1d1ab38750bf tempest-VolumesGetTest-1431096848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:30:32 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-dd91cb0c-6bb3-40b9-8ff4-1d1ab38750bf tempest-VolumesGetTest-1431096848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:30:32 devstack sudo[100403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:30:32 devstack sudo[100403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:30:32 devstack sudo[100396]: pam_unix(sudo:session): session closed for user root Sep 16 20:30:32 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ba2e832f-9875-4f66-a1a3-9493771d2856 tempest-VolumesSnapshotTestJSON-982820329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-252cf731-7631-4458-9f0c-d82d236a3026.8c6605e9-fd84-49da-b43b-8b7dff088f5d" returned: 0 in 0.409s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:30:32 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ba2e832f-9875-4f66-a1a3-9493771d2856 tempest-VolumesSnapshotTestJSON-982820329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-252cf731-7631-4458-9f0c-d82d236a3026.8c6605e9-fd84-49da-b43b-8b7dff088f5d {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:30:32 devstack sudo[100405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-252cf731-7631-4458-9f0c-d82d236a3026.8c6605e9-fd84-49da-b43b-8b7dff088f5d Sep 16 20:30:32 devstack sudo[100405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:30:32 devstack sudo[100403]: pam_unix(sudo:session): session closed for user root Sep 16 20:30:32 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-dd91cb0c-6bb3-40b9-8ff4-1d1ab38750bf tempest-VolumesGetTest-1431096848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.274s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:30:32 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-dd91cb0c-6bb3-40b9-8ff4-1d1ab38750bf tempest-VolumesGetTest-1431096848 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:30:32 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-dd91cb0c-6bb3-40b9-8ff4-1d1ab38750bf tempest-VolumesGetTest-1431096848 None] Deleted volume successfully. Sep 16 20:30:32 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-dd91cb0c-6bb3-40b9-8ff4-1d1ab38750bf tempest-VolumesGetTest-1431096848 None] Lock "cinder-87144b85-b957-4dbe-861b-b6914a97a185-delete_volume" released by "delete_volume" :: held 1.346s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:30:32 devstack sudo[100405]: pam_unix(sudo:session): session closed for user root Sep 16 20:30:32 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ba2e832f-9875-4f66-a1a3-9493771d2856 tempest-VolumesSnapshotTestJSON-982820329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-252cf731-7631-4458-9f0c-d82d236a3026.8c6605e9-fd84-49da-b43b-8b7dff088f5d" returned: 0 in 0.326s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:30:32 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-ba2e832f-9875-4f66-a1a3-9493771d2856 tempest-VolumesSnapshotTestJSON-982820329 None] Lock "cinder-quobyte-8c6605e9-fd84-49da-b43b-8b7dff088f5d" released by "_delete_snapshot" :: held 1.894s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:30:32 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-ba2e832f-9875-4f66-a1a3-9493771d2856 tempest-VolumesSnapshotTestJSON-982820329 None] Lock "cinder-quobyte-252cf731-7631-4458-9f0c-d82d236a3026" released by "delete_snapshot" :: held 1.925s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:30:32 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-ba2e832f-9875-4f66-a1a3-9493771d2856 tempest-VolumesSnapshotTestJSON-982820329 None] Created reservations ['41883c2c-2329-43dc-be55-696e564ec762', 'a4abe135-e6dd-4862-af2c-1015a9626e6e', 'bd553eff-7e82-4ca8-9d37-dee4d95230f2', 'd830c6ad-535b-40c8-8903-0a0bb285ead3'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:30:32 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-ba2e832f-9875-4f66-a1a3-9493771d2856 tempest-VolumesSnapshotTestJSON-982820329 None] Delete snapshot completed successfully. Sep 16 20:30:32 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-ba2e832f-9875-4f66-a1a3-9493771d2856 tempest-VolumesSnapshotTestJSON-982820329 None] Lock "cinder-8c6605e9-fd84-49da-b43b-8b7dff088f5d-delete_snapshot" released by "delete_snapshot" :: held 2.090s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:30:33 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-4a648a37-3fb9-4619-9068-9170cb9a5d34 tempest-VolumesSnapshotTestJSON-982820329 None] Acquiring lock "cinder-252cf731-7631-4458-9f0c-d82d236a3026-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:30:33 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-4a648a37-3fb9-4619-9068-9170cb9a5d34 tempest-VolumesSnapshotTestJSON-982820329 None] Lock "cinder-252cf731-7631-4458-9f0c-d82d236a3026-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:30:33 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-4a648a37-3fb9-4619-9068-9170cb9a5d34 tempest-VolumesSnapshotTestJSON-982820329 None] Acquiring lock "cinder-quobyte-252cf731-7631-4458-9f0c-d82d236a3026" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:30:33 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-4a648a37-3fb9-4619-9068-9170cb9a5d34 tempest-VolumesSnapshotTestJSON-982820329 None] Lock "cinder-quobyte-252cf731-7631-4458-9f0c-d82d236a3026" acquired by "delete_volume" :: waited 0.020s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:30:33 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[f92e9c1d-3888-4296-b70c-2bac98a054f5]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:30:33 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-4a648a37-3fb9-4619-9068-9170cb9a5d34 tempest-VolumesSnapshotTestJSON-982820329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-252cf731-7631-4458-9f0c-d82d236a3026 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:30:33 devstack sudo[100410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-252cf731-7631-4458-9f0c-d82d236a3026 Sep 16 20:30:33 devstack sudo[100410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:30:33 devstack sudo[100410]: pam_unix(sudo:session): session closed for user root Sep 16 20:30:33 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-4a648a37-3fb9-4619-9068-9170cb9a5d34 tempest-VolumesSnapshotTestJSON-982820329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-252cf731-7631-4458-9f0c-d82d236a3026" returned: 0 in 0.415s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:30:33 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-4a648a37-3fb9-4619-9068-9170cb9a5d34 tempest-VolumesSnapshotTestJSON-982820329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-252cf731-7631-4458-9f0c-d82d236a3026 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:30:33 devstack sudo[100415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-252cf731-7631-4458-9f0c-d82d236a3026 Sep 16 20:30:33 devstack sudo[100415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:30:33 devstack sudo[100415]: pam_unix(sudo:session): session closed for user root Sep 16 20:30:33 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-4a648a37-3fb9-4619-9068-9170cb9a5d34 tempest-VolumesSnapshotTestJSON-982820329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-252cf731-7631-4458-9f0c-d82d236a3026" returned: 0 in 0.266s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:30:34 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-4a648a37-3fb9-4619-9068-9170cb9a5d34 tempest-VolumesSnapshotTestJSON-982820329 None] Lock "cinder-quobyte-252cf731-7631-4458-9f0c-d82d236a3026" released by "delete_volume" :: held 0.757s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:30:34 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-4a648a37-3fb9-4619-9068-9170cb9a5d34 tempest-VolumesSnapshotTestJSON-982820329 None] Created reservations ['7b30fa08-a539-440a-993b-6365ac5cf41c', 'e54d2f87-1cdb-4a01-b94f-00f4543566e3', 'bdc89b56-0dea-4b00-b0c5-e5fcd99cb398', 'b7ed4e79-f372-4121-99a0-b455b3af5df1'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:30:34 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-4a648a37-3fb9-4619-9068-9170cb9a5d34 tempest-VolumesSnapshotTestJSON-982820329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:30:34 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-4a648a37-3fb9-4619-9068-9170cb9a5d34 tempest-VolumesSnapshotTestJSON-982820329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:30:34 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-4a648a37-3fb9-4619-9068-9170cb9a5d34 tempest-VolumesSnapshotTestJSON-982820329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:30:34 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-4a648a37-3fb9-4619-9068-9170cb9a5d34 tempest-VolumesSnapshotTestJSON-982820329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:30:34 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-4a648a37-3fb9-4619-9068-9170cb9a5d34 tempest-VolumesSnapshotTestJSON-982820329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:30:34 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-4a648a37-3fb9-4619-9068-9170cb9a5d34 tempest-VolumesSnapshotTestJSON-982820329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:30:34 devstack sudo[100419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:30:34 devstack sudo[100419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:30:34 devstack sudo[100419]: pam_unix(sudo:session): session closed for user root Sep 16 20:30:34 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-4a648a37-3fb9-4619-9068-9170cb9a5d34 tempest-VolumesSnapshotTestJSON-982820329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.283s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:30:34 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-4a648a37-3fb9-4619-9068-9170cb9a5d34 tempest-VolumesSnapshotTestJSON-982820329 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:30:34 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-4a648a37-3fb9-4619-9068-9170cb9a5d34 tempest-VolumesSnapshotTestJSON-982820329 None] Deleted volume successfully. Sep 16 20:30:34 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-4a648a37-3fb9-4619-9068-9170cb9a5d34 tempest-VolumesSnapshotTestJSON-982820329 None] Lock "cinder-252cf731-7631-4458-9f0c-d82d236a3026-delete_volume" released by "delete_volume" :: held 1.322s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:30:35 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f539080-b6e6-4bd2-99ba-32e5eb10af36 tempest-VolumesSnapshotTestJSON-982820329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:30:35 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-7f539080-b6e6-4bd2-99ba-32e5eb10af36 tempest-VolumesSnapshotTestJSON-982820329 None] Flow 'volume_create_manager' (171a2dcc-9f0e-4462-a216-a8be4245ade1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:30:35 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-7f539080-b6e6-4bd2-99ba-32e5eb10af36 tempest-VolumesSnapshotTestJSON-982820329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a6dd54c-4ffb-455b-ba3b-eefced050cb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:30:35 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-7f539080-b6e6-4bd2-99ba-32e5eb10af36 tempest-VolumesSnapshotTestJSON-982820329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a6dd54c-4ffb-455b-ba3b-eefced050cb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:30:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1266636410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33fb3ec9-8d21-4cf1-a746-3cc73655d4a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b14473e8191340baa0f17e6030fae9fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:30:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:30:35Z,use_quota=True,user_id='02d8e75db6aa44c9b5660aa9226f8e20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:30:35 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-7f539080-b6e6-4bd2-99ba-32e5eb10af36 tempest-VolumesSnapshotTestJSON-982820329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84bab535-943c-4ae7-b49d-5e3e82e5e36b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:30:35 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-7f539080-b6e6-4bd2-99ba-32e5eb10af36 tempest-VolumesSnapshotTestJSON-982820329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84bab535-943c-4ae7-b49d-5e3e82e5e36b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:30:35 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-7f539080-b6e6-4bd2-99ba-32e5eb10af36 tempest-VolumesSnapshotTestJSON-982820329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4c86fe6-0920-4889-b0bf-96311197f0d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:30:35 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-7f539080-b6e6-4bd2-99ba-32e5eb10af36 tempest-VolumesSnapshotTestJSON-982820329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4c86fe6-0920-4889-b0bf-96311197f0d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33fb3ec9-8d21-4cf1-a746-3cc73655d4a8', 'volume_name': 'volume-33fb3ec9-8d21-4cf1-a746-3cc73655d4a8', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:30:35 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-7f539080-b6e6-4bd2-99ba-32e5eb10af36 tempest-VolumesSnapshotTestJSON-982820329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63f778f7-4bfd-4405-a9ff-a64f16d9b2c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:30:35 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-7f539080-b6e6-4bd2-99ba-32e5eb10af36 tempest-VolumesSnapshotTestJSON-982820329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63f778f7-4bfd-4405-a9ff-a64f16d9b2c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:30:35 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-7f539080-b6e6-4bd2-99ba-32e5eb10af36 tempest-VolumesSnapshotTestJSON-982820329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dbd0680-e6e3-4548-a04e-6d2f5b47a557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:30:35 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-7f539080-b6e6-4bd2-99ba-32e5eb10af36 tempest-VolumesSnapshotTestJSON-982820329 None] Volume 33fb3ec9-8d21-4cf1-a746-3cc73655d4a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33fb3ec9-8d21-4cf1-a746-3cc73655d4a8', 'volume_size': 1} Sep 16 20:30:35 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-7f539080-b6e6-4bd2-99ba-32e5eb10af36 tempest-VolumesSnapshotTestJSON-982820329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:30:35 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-7f539080-b6e6-4bd2-99ba-32e5eb10af36 tempest-VolumesSnapshotTestJSON-982820329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:30:35 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-7f539080-b6e6-4bd2-99ba-32e5eb10af36 tempest-VolumesSnapshotTestJSON-982820329 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:30:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1266636410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33fb3ec9-8d21-4cf1-a746-3cc73655d4a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b14473e8191340baa0f17e6030fae9fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:30:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:30:35Z,use_quota=True,user_id='02d8e75db6aa44c9b5660aa9226f8e20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:30:35 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-7f539080-b6e6-4bd2-99ba-32e5eb10af36 tempest-VolumesSnapshotTestJSON-982820329 None] Creating volume 33fb3ec9-8d21-4cf1-a746-3cc73655d4a8 {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:30:35 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-7f539080-b6e6-4bd2-99ba-32e5eb10af36 tempest-VolumesSnapshotTestJSON-982820329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:30:35 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-7f539080-b6e6-4bd2-99ba-32e5eb10af36 tempest-VolumesSnapshotTestJSON-982820329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:30:35 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-7f539080-b6e6-4bd2-99ba-32e5eb10af36 tempest-VolumesSnapshotTestJSON-982820329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:30:35 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-7f539080-b6e6-4bd2-99ba-32e5eb10af36 tempest-VolumesSnapshotTestJSON-982820329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:30:35 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-7f539080-b6e6-4bd2-99ba-32e5eb10af36 tempest-VolumesSnapshotTestJSON-982820329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:30:35 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-7f539080-b6e6-4bd2-99ba-32e5eb10af36 tempest-VolumesSnapshotTestJSON-982820329 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:30:35 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-7f539080-b6e6-4bd2-99ba-32e5eb10af36 tempest-VolumesSnapshotTestJSON-982820329 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:30:35 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-7f539080-b6e6-4bd2-99ba-32e5eb10af36 tempest-VolumesSnapshotTestJSON-982820329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-33fb3ec9-8d21-4cf1-a746-3cc73655d4a8 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:30:35 devstack sudo[100422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-33fb3ec9-8d21-4cf1-a746-3cc73655d4a8 1073741824 Sep 16 20:30:35 devstack sudo[100422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:30:35 devstack sudo[100422]: pam_unix(sudo:session): session closed for user root Sep 16 20:30:35 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-7f539080-b6e6-4bd2-99ba-32e5eb10af36 tempest-VolumesSnapshotTestJSON-982820329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-33fb3ec9-8d21-4cf1-a746-3cc73655d4a8 1073741824" returned: 0 in 0.424s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:30:35 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-7f539080-b6e6-4bd2-99ba-32e5eb10af36 tempest-VolumesSnapshotTestJSON-982820329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-33fb3ec9-8d21-4cf1-a746-3cc73655d4a8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:30:35 devstack sudo[100428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-33fb3ec9-8d21-4cf1-a746-3cc73655d4a8 Sep 16 20:30:35 devstack sudo[100428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:30:35 devstack sudo[100428]: pam_unix(sudo:session): session closed for user root Sep 16 20:30:35 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-7f539080-b6e6-4bd2-99ba-32e5eb10af36 tempest-VolumesSnapshotTestJSON-982820329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-33fb3ec9-8d21-4cf1-a746-3cc73655d4a8" returned: 0 in 0.252s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:30:35 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-7f539080-b6e6-4bd2-99ba-32e5eb10af36 tempest-VolumesSnapshotTestJSON-982820329 None] <== create_volume: return (735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:30:35 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-7f539080-b6e6-4bd2-99ba-32e5eb10af36 tempest-VolumesSnapshotTestJSON-982820329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.738s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:30:35 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-7f539080-b6e6-4bd2-99ba-32e5eb10af36 tempest-VolumesSnapshotTestJSON-982820329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dbd0680-e6e3-4548-a04e-6d2f5b47a557) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33fb3ec9-8d21-4cf1-a746-3cc73655d4a8', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:30:35 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-7f539080-b6e6-4bd2-99ba-32e5eb10af36 tempest-VolumesSnapshotTestJSON-982820329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3d785a7-c190-44e1-90a0-85c97130de1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:30:35 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-7f539080-b6e6-4bd2-99ba-32e5eb10af36 tempest-VolumesSnapshotTestJSON-982820329 None] Volume volume-33fb3ec9-8d21-4cf1-a746-3cc73655d4a8 (33fb3ec9-8d21-4cf1-a746-3cc73655d4a8): created successfully Sep 16 20:30:35 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-7f539080-b6e6-4bd2-99ba-32e5eb10af36 tempest-VolumesSnapshotTestJSON-982820329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3d785a7-c190-44e1-90a0-85c97130de1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:30:35 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-7f539080-b6e6-4bd2-99ba-32e5eb10af36 tempest-VolumesSnapshotTestJSON-982820329 None] Flow 'volume_create_manager' (171a2dcc-9f0e-4462-a216-a8be4245ade1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:30:35 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-7f539080-b6e6-4bd2-99ba-32e5eb10af36 tempest-VolumesSnapshotTestJSON-982820329 None] Created volume successfully. Sep 16 20:30:37 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-953f7b02-5607-4f8e-a84b-acf7db84768f tempest-VolumesSnapshotTestJSON-982820329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:30:37 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-953f7b02-5607-4f8e-a84b-acf7db84768f tempest-VolumesSnapshotTestJSON-982820329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:30:37 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-953f7b02-5607-4f8e-a84b-acf7db84768f tempest-VolumesSnapshotTestJSON-982820329 None] Creating offline snapshot 627a453f-a1ae-4a7b-b861-f42b7e36559e of volume 33fb3ec9-8d21-4cf1-a746-3cc73655d4a8 {{(pid=86188) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 20:30:37 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c5b75d3-4d83-491b-9c69-745a98f2299d]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:30:37 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-953f7b02-5607-4f8e-a84b-acf7db84768f tempest-VolumesSnapshotTestJSON-982820329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-33fb3ec9-8d21-4cf1-a746-3cc73655d4a8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:30:37 devstack sudo[100432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-33fb3ec9-8d21-4cf1-a746-3cc73655d4a8 Sep 16 20:30:37 devstack sudo[100432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:30:37 devstack sudo[100432]: pam_unix(sudo:session): session closed for user root Sep 16 20:30:37 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-953f7b02-5607-4f8e-a84b-acf7db84768f tempest-VolumesSnapshotTestJSON-982820329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-33fb3ec9-8d21-4cf1-a746-3cc73655d4a8" returned: 0 in 0.400s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:30:37 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-953f7b02-5607-4f8e-a84b-acf7db84768f tempest-VolumesSnapshotTestJSON-982820329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-33fb3ec9-8d21-4cf1-a746-3cc73655d4a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-33fb3ec9-8d21-4cf1-a746-3cc73655d4a8.627a453f-a1ae-4a7b-b861-f42b7e36559e 1G {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:30:37 devstack sudo[100437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-33fb3ec9-8d21-4cf1-a746-3cc73655d4a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-33fb3ec9-8d21-4cf1-a746-3cc73655d4a8.627a453f-a1ae-4a7b-b861-f42b7e36559e 1G Sep 16 20:30:37 devstack sudo[100437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:30:38 devstack sudo[100437]: pam_unix(sudo:session): session closed for user root Sep 16 20:30:38 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-953f7b02-5607-4f8e-a84b-acf7db84768f tempest-VolumesSnapshotTestJSON-982820329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-33fb3ec9-8d21-4cf1-a746-3cc73655d4a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-33fb3ec9-8d21-4cf1-a746-3cc73655d4a8.627a453f-a1ae-4a7b-b861-f42b7e36559e 1G" returned: 0 in 0.440s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:30:38 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-953f7b02-5607-4f8e-a84b-acf7db84768f tempest-VolumesSnapshotTestJSON-982820329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33fb3ec9-8d21-4cf1-a746-3cc73655d4a8 -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-33fb3ec9-8d21-4cf1-a746-3cc73655d4a8.627a453f-a1ae-4a7b-b861-f42b7e36559e {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:30:38 devstack sudo[100443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33fb3ec9-8d21-4cf1-a746-3cc73655d4a8 -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-33fb3ec9-8d21-4cf1-a746-3cc73655d4a8.627a453f-a1ae-4a7b-b861-f42b7e36559e Sep 16 20:30:38 devstack sudo[100443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:30:38 devstack sudo[100443]: pam_unix(sudo:session): session closed for user root Sep 16 20:30:38 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-953f7b02-5607-4f8e-a84b-acf7db84768f tempest-VolumesSnapshotTestJSON-982820329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33fb3ec9-8d21-4cf1-a746-3cc73655d4a8 -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-33fb3ec9-8d21-4cf1-a746-3cc73655d4a8.627a453f-a1ae-4a7b-b861-f42b7e36559e" returned: 0 in 0.348s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:30:38 devstack cinder-volume[86188]: WARNING cinder.volume.drivers.remotefs [None req-953f7b02-5607-4f8e-a84b-acf7db84768f tempest-VolumesSnapshotTestJSON-982820329 None] /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-33fb3ec9-8d21-4cf1-a746-3cc73655d4a8.627a453f-a1ae-4a7b-b861-f42b7e36559e is being set with open permissions: ugo+rw Sep 16 20:30:38 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-953f7b02-5607-4f8e-a84b-acf7db84768f tempest-VolumesSnapshotTestJSON-982820329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-33fb3ec9-8d21-4cf1-a746-3cc73655d4a8.627a453f-a1ae-4a7b-b861-f42b7e36559e {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:30:38 devstack sudo[100449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-33fb3ec9-8d21-4cf1-a746-3cc73655d4a8.627a453f-a1ae-4a7b-b861-f42b7e36559e Sep 16 20:30:38 devstack sudo[100449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:30:38 devstack sudo[100449]: pam_unix(sudo:session): session closed for user root Sep 16 20:30:38 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-953f7b02-5607-4f8e-a84b-acf7db84768f tempest-VolumesSnapshotTestJSON-982820329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-33fb3ec9-8d21-4cf1-a746-3cc73655d4a8.627a453f-a1ae-4a7b-b861-f42b7e36559e" returned: 0 in 0.256s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:30:38 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-953f7b02-5607-4f8e-a84b-acf7db84768f tempest-VolumesSnapshotTestJSON-982820329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-33fb3ec9-8d21-4cf1-a746-3cc73655d4a8.info {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:30:38 devstack sudo[100452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-33fb3ec9-8d21-4cf1-a746-3cc73655d4a8.info Sep 16 20:30:38 devstack sudo[100452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:30:39 devstack sudo[100452]: pam_unix(sudo:session): session closed for user root Sep 16 20:30:39 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-953f7b02-5607-4f8e-a84b-acf7db84768f tempest-VolumesSnapshotTestJSON-982820329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-33fb3ec9-8d21-4cf1-a746-3cc73655d4a8.info" returned: 0 in 0.267s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:30:39 devstack cinder-volume[86188]: WARNING cinder.volume.drivers.remotefs [None req-953f7b02-5607-4f8e-a84b-acf7db84768f tempest-VolumesSnapshotTestJSON-982820329 None] /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-33fb3ec9-8d21-4cf1-a746-3cc73655d4a8.info is being set with open permissions: ugo+rw Sep 16 20:30:39 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-953f7b02-5607-4f8e-a84b-acf7db84768f tempest-VolumesSnapshotTestJSON-982820329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-33fb3ec9-8d21-4cf1-a746-3cc73655d4a8.info {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:30:39 devstack sudo[100455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-33fb3ec9-8d21-4cf1-a746-3cc73655d4a8.info Sep 16 20:30:39 devstack sudo[100455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:30:39 devstack sudo[100455]: pam_unix(sudo:session): session closed for user root Sep 16 20:30:39 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-953f7b02-5607-4f8e-a84b-acf7db84768f tempest-VolumesSnapshotTestJSON-982820329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-33fb3ec9-8d21-4cf1-a746-3cc73655d4a8.info" returned: 0 in 0.262s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:30:39 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-953f7b02-5607-4f8e-a84b-acf7db84768f tempest-VolumesSnapshotTestJSON-982820329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.075s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:30:39 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-953f7b02-5607-4f8e-a84b-acf7db84768f tempest-VolumesSnapshotTestJSON-982820329 None] Create snapshot completed successfully Sep 16 20:30:39 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-558f14a3-adf9-465e-8414-035628b246fe tempest-VolumesNegativeTest-613798960 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:30:39 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-558f14a3-adf9-465e-8414-035628b246fe tempest-VolumesNegativeTest-613798960 None] Flow 'volume_create_manager' (7a95763c-ad41-44a8-ad5f-c9f51017a1ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:30:39 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-558f14a3-adf9-465e-8414-035628b246fe tempest-VolumesNegativeTest-613798960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9aeaae3-46aa-4852-b2a8-2bb211697a8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:30:39 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-558f14a3-adf9-465e-8414-035628b246fe tempest-VolumesNegativeTest-613798960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9aeaae3-46aa-4852-b2a8-2bb211697a8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:30:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-12799059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9014b87e-19c0-44cd-a966-f08fa6bfec29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1a09000a44e49158944f80d8615d24a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:30:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:30:40Z,use_quota=True,user_id='8ef983a72cb44b97953e3c858ff7a88e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:30:39 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-558f14a3-adf9-465e-8414-035628b246fe tempest-VolumesNegativeTest-613798960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57003302-f5c1-4f4d-b069-0f60991f3123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:30:39 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-558f14a3-adf9-465e-8414-035628b246fe tempest-VolumesNegativeTest-613798960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57003302-f5c1-4f4d-b069-0f60991f3123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:30:39 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-558f14a3-adf9-465e-8414-035628b246fe tempest-VolumesNegativeTest-613798960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16eee081-b805-4303-a36d-4de9ec6d464f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:30:39 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-558f14a3-adf9-465e-8414-035628b246fe tempest-VolumesNegativeTest-613798960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16eee081-b805-4303-a36d-4de9ec6d464f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9014b87e-19c0-44cd-a966-f08fa6bfec29', 'volume_name': 'volume-9014b87e-19c0-44cd-a966-f08fa6bfec29', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:30:39 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-558f14a3-adf9-465e-8414-035628b246fe tempest-VolumesNegativeTest-613798960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4d6ffc8-a6b1-4630-b693-b215e040e0c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:30:39 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-558f14a3-adf9-465e-8414-035628b246fe tempest-VolumesNegativeTest-613798960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4d6ffc8-a6b1-4630-b693-b215e040e0c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:30:39 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-558f14a3-adf9-465e-8414-035628b246fe tempest-VolumesNegativeTest-613798960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d1f1310-9f6e-4564-9383-6b0118239367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:30:39 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-558f14a3-adf9-465e-8414-035628b246fe tempest-VolumesNegativeTest-613798960 None] Volume 9014b87e-19c0-44cd-a966-f08fa6bfec29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9014b87e-19c0-44cd-a966-f08fa6bfec29', 'volume_size': 1} Sep 16 20:30:39 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-558f14a3-adf9-465e-8414-035628b246fe tempest-VolumesNegativeTest-613798960 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:30:39 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-558f14a3-adf9-465e-8414-035628b246fe tempest-VolumesNegativeTest-613798960 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:30:39 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-558f14a3-adf9-465e-8414-035628b246fe tempest-VolumesNegativeTest-613798960 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:30:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-12799059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9014b87e-19c0-44cd-a966-f08fa6bfec29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1a09000a44e49158944f80d8615d24a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:30:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:30:40Z,use_quota=True,user_id='8ef983a72cb44b97953e3c858ff7a88e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:30:39 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-558f14a3-adf9-465e-8414-035628b246fe tempest-VolumesNegativeTest-613798960 None] Creating volume 9014b87e-19c0-44cd-a966-f08fa6bfec29 {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:30:39 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-558f14a3-adf9-465e-8414-035628b246fe tempest-VolumesNegativeTest-613798960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:30:39 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-558f14a3-adf9-465e-8414-035628b246fe tempest-VolumesNegativeTest-613798960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:30:39 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-558f14a3-adf9-465e-8414-035628b246fe tempest-VolumesNegativeTest-613798960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:30:39 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-558f14a3-adf9-465e-8414-035628b246fe tempest-VolumesNegativeTest-613798960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:30:39 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-558f14a3-adf9-465e-8414-035628b246fe tempest-VolumesNegativeTest-613798960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:30:39 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-558f14a3-adf9-465e-8414-035628b246fe tempest-VolumesNegativeTest-613798960 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:30:39 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-558f14a3-adf9-465e-8414-035628b246fe tempest-VolumesNegativeTest-613798960 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:30:39 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-558f14a3-adf9-465e-8414-035628b246fe tempest-VolumesNegativeTest-613798960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9014b87e-19c0-44cd-a966-f08fa6bfec29 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:30:40 devstack sudo[100459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9014b87e-19c0-44cd-a966-f08fa6bfec29 1073741824 Sep 16 20:30:40 devstack sudo[100459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:30:40 devstack sudo[100459]: pam_unix(sudo:session): session closed for user root Sep 16 20:30:40 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-558f14a3-adf9-465e-8414-035628b246fe tempest-VolumesNegativeTest-613798960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9014b87e-19c0-44cd-a966-f08fa6bfec29 1073741824" returned: 0 in 0.498s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:30:40 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-558f14a3-adf9-465e-8414-035628b246fe tempest-VolumesNegativeTest-613798960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9014b87e-19c0-44cd-a966-f08fa6bfec29 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:30:40 devstack sudo[100465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9014b87e-19c0-44cd-a966-f08fa6bfec29 Sep 16 20:30:40 devstack sudo[100465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:30:40 devstack sudo[100465]: pam_unix(sudo:session): session closed for user root Sep 16 20:30:40 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-558f14a3-adf9-465e-8414-035628b246fe tempest-VolumesNegativeTest-613798960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9014b87e-19c0-44cd-a966-f08fa6bfec29" returned: 0 in 0.282s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:30:40 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-558f14a3-adf9-465e-8414-035628b246fe tempest-VolumesNegativeTest-613798960 None] <== create_volume: return (826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:30:40 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-558f14a3-adf9-465e-8414-035628b246fe tempest-VolumesNegativeTest-613798960 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.829s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:30:40 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-558f14a3-adf9-465e-8414-035628b246fe tempest-VolumesNegativeTest-613798960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d1f1310-9f6e-4564-9383-6b0118239367) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9014b87e-19c0-44cd-a966-f08fa6bfec29', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:30:40 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-558f14a3-adf9-465e-8414-035628b246fe tempest-VolumesNegativeTest-613798960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a89c4a5a-8103-4964-83b3-a4ef9b7ba5c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:30:40 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-558f14a3-adf9-465e-8414-035628b246fe tempest-VolumesNegativeTest-613798960 None] Volume volume-9014b87e-19c0-44cd-a966-f08fa6bfec29 (9014b87e-19c0-44cd-a966-f08fa6bfec29): created successfully Sep 16 20:30:40 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-558f14a3-adf9-465e-8414-035628b246fe tempest-VolumesNegativeTest-613798960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a89c4a5a-8103-4964-83b3-a4ef9b7ba5c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:30:40 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-558f14a3-adf9-465e-8414-035628b246fe tempest-VolumesNegativeTest-613798960 None] Flow 'volume_create_manager' (7a95763c-ad41-44a8-ad5f-c9f51017a1ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:30:40 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-558f14a3-adf9-465e-8414-035628b246fe tempest-VolumesNegativeTest-613798960 None] Created volume successfully. Sep 16 20:30:41 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-b81da807-0ed4-4ab1-95a0-f636152d459f tempest-VolumesSnapshotTestJSON-982820329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:30:41 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-b81da807-0ed4-4ab1-95a0-f636152d459f tempest-VolumesSnapshotTestJSON-982820329 None] Flow 'volume_create_manager' (5e43aff4-6be9-4394-badc-724d4a857b13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:30:41 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-b81da807-0ed4-4ab1-95a0-f636152d459f tempest-VolumesSnapshotTestJSON-982820329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47c2c8af-d1ca-4ff9-97f4-0da949bfb156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:30:41 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-b81da807-0ed4-4ab1-95a0-f636152d459f tempest-VolumesSnapshotTestJSON-982820329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47c2c8af-d1ca-4ff9-97f4-0da949bfb156) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:30:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-273136414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9df4b75b-4345-41a4-96fe-2f2d5040fa61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b14473e8191340baa0f17e6030fae9fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:30:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=627a453f-a1ae-4a7b-b861-f42b7e36559e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:30:41Z,use_quota=True,user_id='02d8e75db6aa44c9b5660aa9226f8e20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:30:41 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-b81da807-0ed4-4ab1-95a0-f636152d459f tempest-VolumesSnapshotTestJSON-982820329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb3eb8d3-301b-4ed5-8be3-29876838309b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:30:41 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-b81da807-0ed4-4ab1-95a0-f636152d459f tempest-VolumesSnapshotTestJSON-982820329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb3eb8d3-301b-4ed5-8be3-29876838309b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:30:41 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-b81da807-0ed4-4ab1-95a0-f636152d459f tempest-VolumesSnapshotTestJSON-982820329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f2c10a2-4082-4fc9-a410-f4946fdccfa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:30:41 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-b81da807-0ed4-4ab1-95a0-f636152d459f tempest-VolumesSnapshotTestJSON-982820329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f2c10a2-4082-4fc9-a410-f4946fdccfa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9df4b75b-4345-41a4-96fe-2f2d5040fa61', 'volume_name': 'volume-9df4b75b-4345-41a4-96fe-2f2d5040fa61', 'volume_size': 1, 'snapshot_id': '627a453f-a1ae-4a7b-b861-f42b7e36559e'}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:30:41 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-b81da807-0ed4-4ab1-95a0-f636152d459f tempest-VolumesSnapshotTestJSON-982820329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a88f729-8e45-4e55-a209-bf1444095517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:30:41 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-b81da807-0ed4-4ab1-95a0-f636152d459f tempest-VolumesSnapshotTestJSON-982820329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a88f729-8e45-4e55-a209-bf1444095517) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:30:41 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-b81da807-0ed4-4ab1-95a0-f636152d459f tempest-VolumesSnapshotTestJSON-982820329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60a283ca-1f56-4056-b493-ee6831c05b49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:30:41 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-b81da807-0ed4-4ab1-95a0-f636152d459f tempest-VolumesSnapshotTestJSON-982820329 None] Volume 9df4b75b-4345-41a4-96fe-2f2d5040fa61: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9df4b75b-4345-41a4-96fe-2f2d5040fa61', 'volume_size': 1, 'snapshot_id': '627a453f-a1ae-4a7b-b861-f42b7e36559e'} Sep 16 20:30:41 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-b81da807-0ed4-4ab1-95a0-f636152d459f tempest-VolumesSnapshotTestJSON-982820329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:30:41 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-b81da807-0ed4-4ab1-95a0-f636152d459f tempest-VolumesSnapshotTestJSON-982820329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:30:41 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-b81da807-0ed4-4ab1-95a0-f636152d459f tempest-VolumesSnapshotTestJSON-982820329 None] Acquiring lock "cinder-quobyte-627a453f-a1ae-4a7b-b861-f42b7e36559e-9df4b75b-4345-41a4-96fe-2f2d5040fa61" by "_create_volume_from_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:30:41 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-b81da807-0ed4-4ab1-95a0-f636152d459f tempest-VolumesSnapshotTestJSON-982820329 None] Lock "cinder-quobyte-627a453f-a1ae-4a7b-b861-f42b7e36559e-9df4b75b-4345-41a4-96fe-2f2d5040fa61" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:30:41 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-b81da807-0ed4-4ab1-95a0-f636152d459f tempest-VolumesSnapshotTestJSON-982820329 None] Creating volume 9df4b75b-4345-41a4-96fe-2f2d5040fa61 from snapshot 627a453f-a1ae-4a7b-b861-f42b7e36559e {{(pid=86188) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 16 20:30:41 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-b81da807-0ed4-4ab1-95a0-f636152d459f tempest-VolumesSnapshotTestJSON-982820329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:30:41 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-b81da807-0ed4-4ab1-95a0-f636152d459f tempest-VolumesSnapshotTestJSON-982820329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:30:41 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-b81da807-0ed4-4ab1-95a0-f636152d459f tempest-VolumesSnapshotTestJSON-982820329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:30:41 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-b81da807-0ed4-4ab1-95a0-f636152d459f tempest-VolumesSnapshotTestJSON-982820329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:30:41 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-b81da807-0ed4-4ab1-95a0-f636152d459f tempest-VolumesSnapshotTestJSON-982820329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:30:41 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-b81da807-0ed4-4ab1-95a0-f636152d459f tempest-VolumesSnapshotTestJSON-982820329 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:30:41 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-b81da807-0ed4-4ab1-95a0-f636152d459f tempest-VolumesSnapshotTestJSON-982820329 None] Acquiring lock "cinder-quobyte-9df4b75b-4345-41a4-96fe-2f2d5040fa61" by "_copy_volume_from_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:30:41 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-b81da807-0ed4-4ab1-95a0-f636152d459f tempest-VolumesSnapshotTestJSON-982820329 None] Lock "cinder-quobyte-9df4b75b-4345-41a4-96fe-2f2d5040fa61" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:30:41 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-b81da807-0ed4-4ab1-95a0-f636152d459f tempest-VolumesSnapshotTestJSON-982820329 None] snapshot: 627a453f-a1ae-4a7b-b861-f42b7e36559e, volume: 9df4b75b-4345-41a4-96fe-2f2d5040fa61, {{(pid=86188) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 16 20:30:41 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-b81da807-0ed4-4ab1-95a0-f636152d459f tempest-VolumesSnapshotTestJSON-982820329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:30:41 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-b81da807-0ed4-4ab1-95a0-f636152d459f tempest-VolumesSnapshotTestJSON-982820329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:30:41 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-b81da807-0ed4-4ab1-95a0-f636152d459f tempest-VolumesSnapshotTestJSON-982820329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:30:41 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-b81da807-0ed4-4ab1-95a0-f636152d459f tempest-VolumesSnapshotTestJSON-982820329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:30:41 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-b81da807-0ed4-4ab1-95a0-f636152d459f tempest-VolumesSnapshotTestJSON-982820329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:30:41 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[51f4d1d9-4595-4bec-abbf-a76a1bba2e58]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:30:41 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b81da807-0ed4-4ab1-95a0-f636152d459f tempest-VolumesSnapshotTestJSON-982820329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-33fb3ec9-8d21-4cf1-a746-3cc73655d4a8.627a453f-a1ae-4a7b-b861-f42b7e36559e {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:30:41 devstack sudo[100468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-33fb3ec9-8d21-4cf1-a746-3cc73655d4a8.627a453f-a1ae-4a7b-b861-f42b7e36559e Sep 16 20:30:41 devstack sudo[100468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:30:41 devstack sudo[100468]: pam_unix(sudo:session): session closed for user root Sep 16 20:30:41 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b81da807-0ed4-4ab1-95a0-f636152d459f tempest-VolumesSnapshotTestJSON-982820329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-33fb3ec9-8d21-4cf1-a746-3cc73655d4a8.627a453f-a1ae-4a7b-b861-f42b7e36559e" returned: 0 in 0.446s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:30:41 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-b81da807-0ed4-4ab1-95a0-f636152d459f tempest-VolumesSnapshotTestJSON-982820329 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-33fb3ec9-8d21-4cf1-a746-3cc73655d4a8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86188) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 20:30:41 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a0d9f70-4a17-49cf-aac4-ecc179b9d49b]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:30:41 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b81da807-0ed4-4ab1-95a0-f636152d459f tempest-VolumesSnapshotTestJSON-982820329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-33fb3ec9-8d21-4cf1-a746-3cc73655d4a8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:30:41 devstack sudo[100475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-33fb3ec9-8d21-4cf1-a746-3cc73655d4a8 Sep 16 20:30:41 devstack sudo[100475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:30:42 devstack sudo[100475]: pam_unix(sudo:session): session closed for user root Sep 16 20:30:42 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b81da807-0ed4-4ab1-95a0-f636152d459f tempest-VolumesSnapshotTestJSON-982820329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-33fb3ec9-8d21-4cf1-a746-3cc73655d4a8" returned: 0 in 0.398s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:30:42 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-b81da807-0ed4-4ab1-95a0-f636152d459f tempest-VolumesSnapshotTestJSON-982820329 None] will copy from snapshot at /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-33fb3ec9-8d21-4cf1-a746-3cc73655d4a8 {{(pid=86188) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 16 20:30:42 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-b81da807-0ed4-4ab1-95a0-f636152d459f tempest-VolumesSnapshotTestJSON-982820329 None] Creating direct copy from snapshot {{(pid=86188) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 16 20:30:42 devstack cinder-volume[86188]: DEBUG cinder.utils [None req-b81da807-0ed4-4ab1-95a0-f636152d459f tempest-VolumesSnapshotTestJSON-982820329 None] Path /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9df4b75b-4345-41a4-96fe-2f2d5040fa61 not found in is_blk_device check {{(pid=86188) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 16 20:30:42 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b81da807-0ed4-4ab1-95a0-f636152d459f tempest-VolumesSnapshotTestJSON-982820329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-33fb3ec9-8d21-4cf1-a746-3cc73655d4a8 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9df4b75b-4345-41a4-96fe-2f2d5040fa61 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:30:42 devstack sudo[100481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-33fb3ec9-8d21-4cf1-a746-3cc73655d4a8 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9df4b75b-4345-41a4-96fe-2f2d5040fa61 Sep 16 20:30:42 devstack sudo[100481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:30:50 devstack sudo[100481]: pam_unix(sudo:session): session closed for user root Sep 16 20:30:50 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b81da807-0ed4-4ab1-95a0-f636152d459f tempest-VolumesSnapshotTestJSON-982820329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-33fb3ec9-8d21-4cf1-a746-3cc73655d4a8 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9df4b75b-4345-41a4-96fe-2f2d5040fa61" returned: 0 in 8.410s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:30:50 devstack cinder-volume[86188]: DEBUG cinder.image.image_utils [None req-b81da807-0ed4-4ab1-95a0-f636152d459f tempest-VolumesSnapshotTestJSON-982820329 None] Image conversion details: src /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-33fb3ec9-8d21-4cf1-a746-3cc73655d4a8, size 1024.00 MB, duration 8.41 sec, destination /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9df4b75b-4345-41a4-96fe-2f2d5040fa61 {{(pid=86188) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 16 20:30:50 devstack cinder-volume[86188]: INFO cinder.image.image_utils [None req-b81da807-0ed4-4ab1-95a0-f636152d459f tempest-VolumesSnapshotTestJSON-982820329 None] Converted 1024.00 MB image at 121.75 MB/s Sep 16 20:30:50 devstack cinder-volume[86188]: WARNING cinder.volume.drivers.remotefs [None req-b81da807-0ed4-4ab1-95a0-f636152d459f tempest-VolumesSnapshotTestJSON-982820329 None] /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9df4b75b-4345-41a4-96fe-2f2d5040fa61 is being set with open permissions: ugo+rw Sep 16 20:30:50 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b81da807-0ed4-4ab1-95a0-f636152d459f tempest-VolumesSnapshotTestJSON-982820329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9df4b75b-4345-41a4-96fe-2f2d5040fa61 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:30:50 devstack sudo[100516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9df4b75b-4345-41a4-96fe-2f2d5040fa61 Sep 16 20:30:50 devstack sudo[100516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:30:50 devstack sudo[100516]: pam_unix(sudo:session): session closed for user root Sep 16 20:30:50 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b81da807-0ed4-4ab1-95a0-f636152d459f tempest-VolumesSnapshotTestJSON-982820329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9df4b75b-4345-41a4-96fe-2f2d5040fa61" returned: 0 in 0.275s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:30:51 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-b81da807-0ed4-4ab1-95a0-f636152d459f tempest-VolumesSnapshotTestJSON-982820329 None] Lock "cinder-quobyte-9df4b75b-4345-41a4-96fe-2f2d5040fa61" released by "_copy_volume_from_snapshot" :: held 9.626s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:30:51 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-b81da807-0ed4-4ab1-95a0-f636152d459f tempest-VolumesSnapshotTestJSON-982820329 None] Lock "cinder-quobyte-627a453f-a1ae-4a7b-b861-f42b7e36559e-9df4b75b-4345-41a4-96fe-2f2d5040fa61" released by "_create_volume_from_snapshot" :: held 9.703s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:30:51 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-b81da807-0ed4-4ab1-95a0-f636152d459f tempest-VolumesSnapshotTestJSON-982820329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.721s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:30:51 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-b81da807-0ed4-4ab1-95a0-f636152d459f tempest-VolumesSnapshotTestJSON-982820329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60a283ca-1f56-4056-b493-ee6831c05b49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9df4b75b-4345-41a4-96fe-2f2d5040fa61', 'volume_size': 1, 'snapshot_id': '627a453f-a1ae-4a7b-b861-f42b7e36559e'}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:30:51 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-b81da807-0ed4-4ab1-95a0-f636152d459f tempest-VolumesSnapshotTestJSON-982820329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2eb5325-9d9d-4bd8-9883-8df4081b8e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:30:51 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-b81da807-0ed4-4ab1-95a0-f636152d459f tempest-VolumesSnapshotTestJSON-982820329 None] Volume volume-9df4b75b-4345-41a4-96fe-2f2d5040fa61 (9df4b75b-4345-41a4-96fe-2f2d5040fa61): created successfully Sep 16 20:30:51 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-b81da807-0ed4-4ab1-95a0-f636152d459f tempest-VolumesSnapshotTestJSON-982820329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2eb5325-9d9d-4bd8-9883-8df4081b8e23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:30:51 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-b81da807-0ed4-4ab1-95a0-f636152d459f tempest-VolumesSnapshotTestJSON-982820329 None] Flow 'volume_create_manager' (5e43aff4-6be9-4394-badc-724d4a857b13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:30:51 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-b81da807-0ed4-4ab1-95a0-f636152d459f tempest-VolumesSnapshotTestJSON-982820329 None] Created volume successfully. Sep 16 20:30:51 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-9e85146f-d1a6-442d-9128-c4405062bab3 tempest-VolumesSnapshotTestJSON-982820329 None] Acquiring lock "cinder-9df4b75b-4345-41a4-96fe-2f2d5040fa61-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:30:51 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-9e85146f-d1a6-442d-9128-c4405062bab3 tempest-VolumesSnapshotTestJSON-982820329 None] Lock "cinder-9df4b75b-4345-41a4-96fe-2f2d5040fa61-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:30:51 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-9e85146f-d1a6-442d-9128-c4405062bab3 tempest-VolumesSnapshotTestJSON-982820329 None] Acquiring lock "cinder-quobyte-9df4b75b-4345-41a4-96fe-2f2d5040fa61" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:30:51 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-9e85146f-d1a6-442d-9128-c4405062bab3 tempest-VolumesSnapshotTestJSON-982820329 None] Lock "cinder-quobyte-9df4b75b-4345-41a4-96fe-2f2d5040fa61" acquired by "delete_volume" :: waited 0.037s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:30:51 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[683cc66a-f7b2-4466-94c5-1a6854a2aaae]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:30:51 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-9e85146f-d1a6-442d-9128-c4405062bab3 tempest-VolumesSnapshotTestJSON-982820329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9df4b75b-4345-41a4-96fe-2f2d5040fa61 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:30:51 devstack sudo[100533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9df4b75b-4345-41a4-96fe-2f2d5040fa61 Sep 16 20:30:51 devstack sudo[100533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:30:52 devstack sudo[100533]: pam_unix(sudo:session): session closed for user root Sep 16 20:30:52 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-9e85146f-d1a6-442d-9128-c4405062bab3 tempest-VolumesSnapshotTestJSON-982820329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9df4b75b-4345-41a4-96fe-2f2d5040fa61" returned: 0 in 0.538s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:30:52 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-9e85146f-d1a6-442d-9128-c4405062bab3 tempest-VolumesSnapshotTestJSON-982820329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9df4b75b-4345-41a4-96fe-2f2d5040fa61 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:30:52 devstack sudo[100581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9df4b75b-4345-41a4-96fe-2f2d5040fa61 Sep 16 20:30:52 devstack sudo[100581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:30:52 devstack sudo[100581]: pam_unix(sudo:session): session closed for user root Sep 16 20:30:52 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-9e85146f-d1a6-442d-9128-c4405062bab3 tempest-VolumesSnapshotTestJSON-982820329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9df4b75b-4345-41a4-96fe-2f2d5040fa61" returned: 0 in 0.546s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:30:52 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-9e85146f-d1a6-442d-9128-c4405062bab3 tempest-VolumesSnapshotTestJSON-982820329 None] Lock "cinder-quobyte-9df4b75b-4345-41a4-96fe-2f2d5040fa61" released by "delete_volume" :: held 1.171s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:30:52 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-9e85146f-d1a6-442d-9128-c4405062bab3 tempest-VolumesSnapshotTestJSON-982820329 None] Created reservations ['6e7dd387-2a3a-40b3-b8e2-1c79f45ae2a6', '83545a27-8957-429d-adb9-2787a6bfce42', '1e0337d4-dad7-48f2-8da4-43b2bf1ba1eb', '188413d4-cde4-4c43-96a2-dd2926d04660'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:30:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-9e85146f-d1a6-442d-9128-c4405062bab3 tempest-VolumesSnapshotTestJSON-982820329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:30:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-9e85146f-d1a6-442d-9128-c4405062bab3 tempest-VolumesSnapshotTestJSON-982820329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:30:53 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-9e85146f-d1a6-442d-9128-c4405062bab3 tempest-VolumesSnapshotTestJSON-982820329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:30:53 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-9e85146f-d1a6-442d-9128-c4405062bab3 tempest-VolumesSnapshotTestJSON-982820329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:30:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-9e85146f-d1a6-442d-9128-c4405062bab3 tempest-VolumesSnapshotTestJSON-982820329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:30:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-9e85146f-d1a6-442d-9128-c4405062bab3 tempest-VolumesSnapshotTestJSON-982820329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:30:53 devstack cinder-volume[86188]: DEBUG oslo_service.periodic_task [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86188) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 20:30:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:30:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:30:53 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:30:53 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:30:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:30:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:30:53 devstack sudo[100592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:30:53 devstack sudo[100592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:30:53 devstack sudo[100593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:30:53 devstack sudo[100593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:30:53 devstack sudo[100592]: pam_unix(sudo:session): session closed for user root Sep 16 20:30:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-9e85146f-d1a6-442d-9128-c4405062bab3 tempest-VolumesSnapshotTestJSON-982820329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.396s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:30:53 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-9e85146f-d1a6-442d-9128-c4405062bab3 tempest-VolumesSnapshotTestJSON-982820329 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:30:53 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-9e85146f-d1a6-442d-9128-c4405062bab3 tempest-VolumesSnapshotTestJSON-982820329 None] Deleted volume successfully. Sep 16 20:30:53 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-9e85146f-d1a6-442d-9128-c4405062bab3 tempest-VolumesSnapshotTestJSON-982820329 None] Lock "cinder-9df4b75b-4345-41a4-96fe-2f2d5040fa61-delete_volume" released by "delete_volume" :: held 2.022s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:30:53 devstack sudo[100593]: pam_unix(sudo:session): session closed for user root Sep 16 20:30:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.446s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:30:53 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:30:53 devstack cinder-volume[86188]: DEBUG oslo_service.periodic_task [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Running periodic task VolumeManager._thread_info {{(pid=86188) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 20:30:53 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] thread count: 28 {{(pid=86188) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 16 20:30:53 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] thread info: [<_MainThread(MainThread, started 139858124406912)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86188) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 16 20:30:53 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-76150e0b-328f-4bb0-a3de-4f9f9b7b11aa tempest-VolumesSnapshotTestJSON-982820329 None] Acquiring lock "cinder-627a453f-a1ae-4a7b-b861-f42b7e36559e-delete_snapshot" by "delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:30:53 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-76150e0b-328f-4bb0-a3de-4f9f9b7b11aa tempest-VolumesSnapshotTestJSON-982820329 None] Lock "cinder-627a453f-a1ae-4a7b-b861-f42b7e36559e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:30:53 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-76150e0b-328f-4bb0-a3de-4f9f9b7b11aa tempest-VolumesSnapshotTestJSON-982820329 None] Acquiring lock "cinder-quobyte-33fb3ec9-8d21-4cf1-a746-3cc73655d4a8" by "delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:30:53 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-76150e0b-328f-4bb0-a3de-4f9f9b7b11aa tempest-VolumesSnapshotTestJSON-982820329 None] Lock "cinder-quobyte-33fb3ec9-8d21-4cf1-a746-3cc73655d4a8" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:30:53 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-76150e0b-328f-4bb0-a3de-4f9f9b7b11aa tempest-VolumesSnapshotTestJSON-982820329 None] Acquiring lock "cinder-quobyte-627a453f-a1ae-4a7b-b861-f42b7e36559e" by "_delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:30:53 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-76150e0b-328f-4bb0-a3de-4f9f9b7b11aa tempest-VolumesSnapshotTestJSON-982820329 None] Lock "cinder-quobyte-627a453f-a1ae-4a7b-b861-f42b7e36559e" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:30:53 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-76150e0b-328f-4bb0-a3de-4f9f9b7b11aa tempest-VolumesSnapshotTestJSON-982820329 None] Deleting offline snapshot 627a453f-a1ae-4a7b-b861-f42b7e36559e of volume 33fb3ec9-8d21-4cf1-a746-3cc73655d4a8 {{(pid=86188) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 20:30:53 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-76150e0b-328f-4bb0-a3de-4f9f9b7b11aa tempest-VolumesSnapshotTestJSON-982820329 None] snapshot_file for this snap is: volume-33fb3ec9-8d21-4cf1-a746-3cc73655d4a8.627a453f-a1ae-4a7b-b861-f42b7e36559e {{(pid=86188) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 20:30:53 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7fc8af4-9b27-43ae-adba-ef6356fe0594]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:30:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-76150e0b-328f-4bb0-a3de-4f9f9b7b11aa tempest-VolumesSnapshotTestJSON-982820329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-33fb3ec9-8d21-4cf1-a746-3cc73655d4a8.627a453f-a1ae-4a7b-b861-f42b7e36559e {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:30:54 devstack sudo[100601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-33fb3ec9-8d21-4cf1-a746-3cc73655d4a8.627a453f-a1ae-4a7b-b861-f42b7e36559e Sep 16 20:30:54 devstack sudo[100601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:30:54 devstack sudo[100601]: pam_unix(sudo:session): session closed for user root Sep 16 20:30:54 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-76150e0b-328f-4bb0-a3de-4f9f9b7b11aa tempest-VolumesSnapshotTestJSON-982820329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-33fb3ec9-8d21-4cf1-a746-3cc73655d4a8.627a453f-a1ae-4a7b-b861-f42b7e36559e" returned: 0 in 0.550s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:30:54 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-76150e0b-328f-4bb0-a3de-4f9f9b7b11aa tempest-VolumesSnapshotTestJSON-982820329 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-33fb3ec9-8d21-4cf1-a746-3cc73655d4a8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86188) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 20:30:54 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[da1da489-49b3-4b50-8e52-9786aad75c24]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:30:54 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-76150e0b-328f-4bb0-a3de-4f9f9b7b11aa tempest-VolumesSnapshotTestJSON-982820329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-33fb3ec9-8d21-4cf1-a746-3cc73655d4a8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:30:54 devstack sudo[100606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-33fb3ec9-8d21-4cf1-a746-3cc73655d4a8 Sep 16 20:30:54 devstack sudo[100606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:30:55 devstack sudo[100606]: pam_unix(sudo:session): session closed for user root Sep 16 20:30:55 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-76150e0b-328f-4bb0-a3de-4f9f9b7b11aa tempest-VolumesSnapshotTestJSON-982820329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-33fb3ec9-8d21-4cf1-a746-3cc73655d4a8" returned: 0 in 0.876s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:30:55 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-76150e0b-328f-4bb0-a3de-4f9f9b7b11aa tempest-VolumesSnapshotTestJSON-982820329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-33fb3ec9-8d21-4cf1-a746-3cc73655d4a8.627a453f-a1ae-4a7b-b861-f42b7e36559e {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:30:55 devstack sudo[100631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-33fb3ec9-8d21-4cf1-a746-3cc73655d4a8.627a453f-a1ae-4a7b-b861-f42b7e36559e Sep 16 20:30:55 devstack sudo[100631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:30:55 devstack sudo[100631]: pam_unix(sudo:session): session closed for user root Sep 16 20:30:55 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-76150e0b-328f-4bb0-a3de-4f9f9b7b11aa tempest-VolumesSnapshotTestJSON-982820329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-33fb3ec9-8d21-4cf1-a746-3cc73655d4a8.627a453f-a1ae-4a7b-b861-f42b7e36559e" returned: 0 in 0.432s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:30:55 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-76150e0b-328f-4bb0-a3de-4f9f9b7b11aa tempest-VolumesSnapshotTestJSON-982820329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-33fb3ec9-8d21-4cf1-a746-3cc73655d4a8.627a453f-a1ae-4a7b-b861-f42b7e36559e {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:30:55 devstack sudo[100638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-33fb3ec9-8d21-4cf1-a746-3cc73655d4a8.627a453f-a1ae-4a7b-b861-f42b7e36559e Sep 16 20:30:55 devstack sudo[100638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:30:56 devstack sudo[100638]: pam_unix(sudo:session): session closed for user root Sep 16 20:30:56 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-76150e0b-328f-4bb0-a3de-4f9f9b7b11aa tempest-VolumesSnapshotTestJSON-982820329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-33fb3ec9-8d21-4cf1-a746-3cc73655d4a8.627a453f-a1ae-4a7b-b861-f42b7e36559e" returned: 0 in 0.343s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:30:56 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-76150e0b-328f-4bb0-a3de-4f9f9b7b11aa tempest-VolumesSnapshotTestJSON-982820329 None] Lock "cinder-quobyte-627a453f-a1ae-4a7b-b861-f42b7e36559e" released by "_delete_snapshot" :: held 2.396s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:30:56 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-76150e0b-328f-4bb0-a3de-4f9f9b7b11aa tempest-VolumesSnapshotTestJSON-982820329 None] Lock "cinder-quobyte-33fb3ec9-8d21-4cf1-a746-3cc73655d4a8" released by "delete_snapshot" :: held 2.429s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:30:56 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-76150e0b-328f-4bb0-a3de-4f9f9b7b11aa tempest-VolumesSnapshotTestJSON-982820329 None] Created reservations ['d64e2aff-2c25-4b0f-8d55-4e3b547c6841', '7caa5cf8-22ba-426d-8a92-110992168c2b', '17c92c51-ff2d-4219-ad10-bc3ec2303683', '13250a35-996e-4a7a-897c-e4c5fba88e1b'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:30:56 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-76150e0b-328f-4bb0-a3de-4f9f9b7b11aa tempest-VolumesSnapshotTestJSON-982820329 None] Delete snapshot completed successfully. Sep 16 20:30:56 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-76150e0b-328f-4bb0-a3de-4f9f9b7b11aa tempest-VolumesSnapshotTestJSON-982820329 None] Lock "cinder-627a453f-a1ae-4a7b-b861-f42b7e36559e-delete_snapshot" released by "delete_snapshot" :: held 2.624s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:30:57 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-82131416-04da-4c4b-ba9d-59daeda79354 tempest-VolumesSnapshotTestJSON-982820329 None] Acquiring lock "cinder-33fb3ec9-8d21-4cf1-a746-3cc73655d4a8-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:30:57 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-82131416-04da-4c4b-ba9d-59daeda79354 tempest-VolumesSnapshotTestJSON-982820329 None] Lock "cinder-33fb3ec9-8d21-4cf1-a746-3cc73655d4a8-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:30:57 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-82131416-04da-4c4b-ba9d-59daeda79354 tempest-VolumesSnapshotTestJSON-982820329 None] Acquiring lock "cinder-quobyte-33fb3ec9-8d21-4cf1-a746-3cc73655d4a8" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:30:57 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-82131416-04da-4c4b-ba9d-59daeda79354 tempest-VolumesSnapshotTestJSON-982820329 None] Lock "cinder-quobyte-33fb3ec9-8d21-4cf1-a746-3cc73655d4a8" acquired by "delete_volume" :: waited 0.024s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:30:57 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd67db23-9716-427e-a435-f5a66972c84e]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:30:57 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-82131416-04da-4c4b-ba9d-59daeda79354 tempest-VolumesSnapshotTestJSON-982820329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-33fb3ec9-8d21-4cf1-a746-3cc73655d4a8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:30:57 devstack sudo[100677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-33fb3ec9-8d21-4cf1-a746-3cc73655d4a8 Sep 16 20:30:57 devstack sudo[100677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:30:57 devstack sudo[100677]: pam_unix(sudo:session): session closed for user root Sep 16 20:30:57 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-82131416-04da-4c4b-ba9d-59daeda79354 tempest-VolumesSnapshotTestJSON-982820329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-33fb3ec9-8d21-4cf1-a746-3cc73655d4a8" returned: 0 in 0.585s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:30:57 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-82131416-04da-4c4b-ba9d-59daeda79354 tempest-VolumesSnapshotTestJSON-982820329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-33fb3ec9-8d21-4cf1-a746-3cc73655d4a8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:30:57 devstack sudo[100685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-33fb3ec9-8d21-4cf1-a746-3cc73655d4a8 Sep 16 20:30:57 devstack sudo[100685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:30:58 devstack sudo[100685]: pam_unix(sudo:session): session closed for user root Sep 16 20:30:58 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-82131416-04da-4c4b-ba9d-59daeda79354 tempest-VolumesSnapshotTestJSON-982820329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-33fb3ec9-8d21-4cf1-a746-3cc73655d4a8" returned: 0 in 0.268s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:30:58 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-82131416-04da-4c4b-ba9d-59daeda79354 tempest-VolumesSnapshotTestJSON-982820329 None] Lock "cinder-quobyte-33fb3ec9-8d21-4cf1-a746-3cc73655d4a8" released by "delete_volume" :: held 0.929s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:30:58 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-82131416-04da-4c4b-ba9d-59daeda79354 tempest-VolumesSnapshotTestJSON-982820329 None] Created reservations ['fad378a7-bb2a-4d70-98e3-1fe1736e0ce7', '83e6fa89-45bd-4166-a56d-f34b19265b14', '4b7177b5-69d3-41be-97c8-38e67fb9d7a3', '861bf160-fb48-4784-be23-184ab7a86c93'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:30:58 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-82131416-04da-4c4b-ba9d-59daeda79354 tempest-VolumesSnapshotTestJSON-982820329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:30:58 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-82131416-04da-4c4b-ba9d-59daeda79354 tempest-VolumesSnapshotTestJSON-982820329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:30:58 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-82131416-04da-4c4b-ba9d-59daeda79354 tempest-VolumesSnapshotTestJSON-982820329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:30:58 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-82131416-04da-4c4b-ba9d-59daeda79354 tempest-VolumesSnapshotTestJSON-982820329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:30:58 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-82131416-04da-4c4b-ba9d-59daeda79354 tempest-VolumesSnapshotTestJSON-982820329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:30:58 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-82131416-04da-4c4b-ba9d-59daeda79354 tempest-VolumesSnapshotTestJSON-982820329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:30:58 devstack sudo[100688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:30:58 devstack sudo[100688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:30:58 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-121d802e-ff41-42b6-981f-a3e036e3aff5 tempest-VolumesSnapshotTestJSON-982820329 None] Acquiring lock "cinder-189aa1f5-b1d4-4b5e-a266-32b37558f6f1-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:30:58 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-121d802e-ff41-42b6-981f-a3e036e3aff5 tempest-VolumesSnapshotTestJSON-982820329 None] Lock "cinder-189aa1f5-b1d4-4b5e-a266-32b37558f6f1-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:30:58 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-121d802e-ff41-42b6-981f-a3e036e3aff5 tempest-VolumesSnapshotTestJSON-982820329 None] Acquiring lock "cinder-quobyte-189aa1f5-b1d4-4b5e-a266-32b37558f6f1" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:30:58 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-121d802e-ff41-42b6-981f-a3e036e3aff5 tempest-VolumesSnapshotTestJSON-982820329 None] Lock "cinder-quobyte-189aa1f5-b1d4-4b5e-a266-32b37558f6f1" acquired by "delete_volume" :: waited 0.032s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:30:58 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[17fafdd3-010d-4bd7-ab3d-1521e74bc2d3]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:30:58 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-121d802e-ff41-42b6-981f-a3e036e3aff5 tempest-VolumesSnapshotTestJSON-982820329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-189aa1f5-b1d4-4b5e-a266-32b37558f6f1 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:30:58 devstack sudo[100688]: pam_unix(sudo:session): session closed for user root Sep 16 20:30:58 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-82131416-04da-4c4b-ba9d-59daeda79354 tempest-VolumesSnapshotTestJSON-982820329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.330s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:30:58 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-82131416-04da-4c4b-ba9d-59daeda79354 tempest-VolumesSnapshotTestJSON-982820329 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:30:58 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-82131416-04da-4c4b-ba9d-59daeda79354 tempest-VolumesSnapshotTestJSON-982820329 None] Deleted volume successfully. Sep 16 20:30:58 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-82131416-04da-4c4b-ba9d-59daeda79354 tempest-VolumesSnapshotTestJSON-982820329 None] Lock "cinder-33fb3ec9-8d21-4cf1-a746-3cc73655d4a8-delete_volume" released by "delete_volume" :: held 1.553s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:30:58 devstack sudo[100691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-189aa1f5-b1d4-4b5e-a266-32b37558f6f1 Sep 16 20:30:58 devstack sudo[100691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:30:59 devstack sudo[100691]: pam_unix(sudo:session): session closed for user root Sep 16 20:30:59 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-121d802e-ff41-42b6-981f-a3e036e3aff5 tempest-VolumesSnapshotTestJSON-982820329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-189aa1f5-b1d4-4b5e-a266-32b37558f6f1" returned: 0 in 0.421s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:30:59 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-121d802e-ff41-42b6-981f-a3e036e3aff5 tempest-VolumesSnapshotTestJSON-982820329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-189aa1f5-b1d4-4b5e-a266-32b37558f6f1 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:30:59 devstack sudo[100696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-189aa1f5-b1d4-4b5e-a266-32b37558f6f1 Sep 16 20:30:59 devstack sudo[100696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:30:59 devstack sudo[100696]: pam_unix(sudo:session): session closed for user root Sep 16 20:30:59 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-121d802e-ff41-42b6-981f-a3e036e3aff5 tempest-VolumesSnapshotTestJSON-982820329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-189aa1f5-b1d4-4b5e-a266-32b37558f6f1" returned: 0 in 0.264s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:30:59 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-121d802e-ff41-42b6-981f-a3e036e3aff5 tempest-VolumesSnapshotTestJSON-982820329 None] Lock "cinder-quobyte-189aa1f5-b1d4-4b5e-a266-32b37558f6f1" released by "delete_volume" :: held 0.791s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:30:59 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-121d802e-ff41-42b6-981f-a3e036e3aff5 tempest-VolumesSnapshotTestJSON-982820329 None] Created reservations ['8567fefe-1a78-48d5-8c4b-2aca1df2738a', '88143aa7-6983-43a1-bf7f-a7d70187b5b8', '7366d83a-eed2-45b9-8300-d39595dccefe', '202c9bcc-68db-4f6c-a029-be27fe414982'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:30:59 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-121d802e-ff41-42b6-981f-a3e036e3aff5 tempest-VolumesSnapshotTestJSON-982820329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:30:59 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-121d802e-ff41-42b6-981f-a3e036e3aff5 tempest-VolumesSnapshotTestJSON-982820329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:30:59 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-121d802e-ff41-42b6-981f-a3e036e3aff5 tempest-VolumesSnapshotTestJSON-982820329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:30:59 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-121d802e-ff41-42b6-981f-a3e036e3aff5 tempest-VolumesSnapshotTestJSON-982820329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:30:59 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-121d802e-ff41-42b6-981f-a3e036e3aff5 tempest-VolumesSnapshotTestJSON-982820329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:30:59 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-121d802e-ff41-42b6-981f-a3e036e3aff5 tempest-VolumesSnapshotTestJSON-982820329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:30:59 devstack sudo[100700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:30:59 devstack sudo[100700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:30:59 devstack sudo[100700]: pam_unix(sudo:session): session closed for user root Sep 16 20:30:59 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-121d802e-ff41-42b6-981f-a3e036e3aff5 tempest-VolumesSnapshotTestJSON-982820329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.317s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:30:59 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-121d802e-ff41-42b6-981f-a3e036e3aff5 tempest-VolumesSnapshotTestJSON-982820329 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:30:59 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-121d802e-ff41-42b6-981f-a3e036e3aff5 tempest-VolumesSnapshotTestJSON-982820329 None] Deleted volume successfully. Sep 16 20:30:59 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-121d802e-ff41-42b6-981f-a3e036e3aff5 tempest-VolumesSnapshotTestJSON-982820329 None] Lock "cinder-189aa1f5-b1d4-4b5e-a266-32b37558f6f1-delete_volume" released by "delete_volume" :: held 1.372s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:31:04 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-0db6ea9d-eaa3-49c0-a96c-e4dae7e4c057 tempest-VolumesNegativeTest-613798960 None] Acquiring lock "cinder-9014b87e-19c0-44cd-a966-f08fa6bfec29-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:31:04 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-0db6ea9d-eaa3-49c0-a96c-e4dae7e4c057 tempest-VolumesNegativeTest-613798960 None] Lock "cinder-9014b87e-19c0-44cd-a966-f08fa6bfec29-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:31:05 devstack cinder-volume[86188]: DEBUG dbcounter [-] [86188] Writing DB stats cinder:UPDATE=152,cinder:SELECT=145,cinder:INSERT=46,cinder:DELETE=15 {{(pid=86188) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 20:31:05 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-0db6ea9d-eaa3-49c0-a96c-e4dae7e4c057 tempest-VolumesNegativeTest-613798960 None] Acquiring lock "cinder-quobyte-9014b87e-19c0-44cd-a966-f08fa6bfec29" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:31:05 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-0db6ea9d-eaa3-49c0-a96c-e4dae7e4c057 tempest-VolumesNegativeTest-613798960 None] Lock "cinder-quobyte-9014b87e-19c0-44cd-a966-f08fa6bfec29" acquired by "delete_volume" :: waited 0.016s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:31:05 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[90163647-848b-4a24-a5b4-def27157143b]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:31:05 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-0db6ea9d-eaa3-49c0-a96c-e4dae7e4c057 tempest-VolumesNegativeTest-613798960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9014b87e-19c0-44cd-a966-f08fa6bfec29 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:31:05 devstack sudo[100713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9014b87e-19c0-44cd-a966-f08fa6bfec29 Sep 16 20:31:05 devstack sudo[100713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:31:05 devstack sudo[100713]: pam_unix(sudo:session): session closed for user root Sep 16 20:31:05 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-0db6ea9d-eaa3-49c0-a96c-e4dae7e4c057 tempest-VolumesNegativeTest-613798960 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9014b87e-19c0-44cd-a966-f08fa6bfec29" returned: 0 in 0.355s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:31:05 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-0db6ea9d-eaa3-49c0-a96c-e4dae7e4c057 tempest-VolumesNegativeTest-613798960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9014b87e-19c0-44cd-a966-f08fa6bfec29 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:31:05 devstack sudo[100718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9014b87e-19c0-44cd-a966-f08fa6bfec29 Sep 16 20:31:05 devstack sudo[100718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:31:05 devstack sudo[100718]: pam_unix(sudo:session): session closed for user root Sep 16 20:31:05 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-0db6ea9d-eaa3-49c0-a96c-e4dae7e4c057 tempest-VolumesNegativeTest-613798960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9014b87e-19c0-44cd-a966-f08fa6bfec29" returned: 0 in 0.343s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:31:05 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-0db6ea9d-eaa3-49c0-a96c-e4dae7e4c057 tempest-VolumesNegativeTest-613798960 None] Lock "cinder-quobyte-9014b87e-19c0-44cd-a966-f08fa6bfec29" released by "delete_volume" :: held 0.742s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:31:05 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-0db6ea9d-eaa3-49c0-a96c-e4dae7e4c057 tempest-VolumesNegativeTest-613798960 None] Created reservations ['9ee4669b-ab64-42c1-8600-27ba993c97ca', 'cfa36ad4-8392-410d-ac46-0e13370ab974', '1bf3b324-d0eb-41bc-95ff-fae2ea3297ef', '87f41d95-79fa-489b-903b-205339ca67e8'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:31:05 devstack cinder-volume[86188]: DEBUG dbcounter [-] [86188] Writing DB stats cinder:UPDATE=172,cinder:DELETE=11,cinder:SELECT=143,cinder:INSERT=46 {{(pid=86188) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 20:31:05 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-0db6ea9d-eaa3-49c0-a96c-e4dae7e4c057 tempest-VolumesNegativeTest-613798960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:31:05 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-0db6ea9d-eaa3-49c0-a96c-e4dae7e4c057 tempest-VolumesNegativeTest-613798960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:31:05 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-0db6ea9d-eaa3-49c0-a96c-e4dae7e4c057 tempest-VolumesNegativeTest-613798960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:31:05 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-0db6ea9d-eaa3-49c0-a96c-e4dae7e4c057 tempest-VolumesNegativeTest-613798960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:31:05 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-0db6ea9d-eaa3-49c0-a96c-e4dae7e4c057 tempest-VolumesNegativeTest-613798960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:31:05 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-0db6ea9d-eaa3-49c0-a96c-e4dae7e4c057 tempest-VolumesNegativeTest-613798960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:31:06 devstack sudo[100721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:31:06 devstack sudo[100721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:31:06 devstack sudo[100721]: pam_unix(sudo:session): session closed for user root Sep 16 20:31:06 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-0db6ea9d-eaa3-49c0-a96c-e4dae7e4c057 tempest-VolumesNegativeTest-613798960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.333s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:31:06 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-0db6ea9d-eaa3-49c0-a96c-e4dae7e4c057 tempest-VolumesNegativeTest-613798960 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:31:06 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-0db6ea9d-eaa3-49c0-a96c-e4dae7e4c057 tempest-VolumesNegativeTest-613798960 None] Deleted volume successfully. Sep 16 20:31:06 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-0db6ea9d-eaa3-49c0-a96c-e4dae7e4c057 tempest-VolumesNegativeTest-613798960 None] Lock "cinder-9014b87e-19c0-44cd-a966-f08fa6bfec29-delete_volume" released by "delete_volume" :: held 1.352s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:31:14 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-e398936d-3a22-4841-870c-7d467190cff3 tempest-VolumeAndVolumeTypeFromImageTest-642861740 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:31:14 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e398936d-3a22-4841-870c-7d467190cff3 tempest-VolumeAndVolumeTypeFromImageTest-642861740 None] Flow 'volume_create_manager' (94d393a8-ad88-4e5c-b0ae-f4c0835c7d31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:31:14 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e398936d-3a22-4841-870c-7d467190cff3 tempest-VolumeAndVolumeTypeFromImageTest-642861740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58ddd696-fe1e-42ef-9a43-528d18e09db4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:31:14 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e398936d-3a22-4841-870c-7d467190cff3 tempest-VolumeAndVolumeTypeFromImageTest-642861740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58ddd696-fe1e-42ef-9a43-528d18e09db4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:31:14Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82bdff69-6803-4674-93d8-276eb362198d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4973707e9e124089bfb47f8da5fbde35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:31:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:31:14Z,use_quota=True,user_id='77b1bcdfb8784af4a77f8560f3191225',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(675e1f0c-9b26-40e9-b279-6a0ef96ca3dc),volume_type_id=675e1f0c-9b26-40e9-b279-6a0ef96ca3dc)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:31:14 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e398936d-3a22-4841-870c-7d467190cff3 tempest-VolumeAndVolumeTypeFromImageTest-642861740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfc489f6-05a5-4a78-b22a-b521c7afd8cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:31:14 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e398936d-3a22-4841-870c-7d467190cff3 tempest-VolumeAndVolumeTypeFromImageTest-642861740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfc489f6-05a5-4a78-b22a-b521c7afd8cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:31:14 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e398936d-3a22-4841-870c-7d467190cff3 tempest-VolumeAndVolumeTypeFromImageTest-642861740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a879918-4408-49a9-b9e1-e437be2c5d3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:31:14 devstack cinder-volume[86188]: DEBUG cinder.image.glance [None req-e398936d-3a22-4841-870c-7d467190cff3 tempest-VolumeAndVolumeTypeFromImageTest-642861740 None] Creating Keystone auth plugin from conf {{(pid=86188) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 16 20:31:14 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e398936d-3a22-4841-870c-7d467190cff3 tempest-VolumeAndVolumeTypeFromImageTest-642861740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a879918-4408-49a9-b9e1-e437be2c5d3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '82bdff69-6803-4674-93d8-276eb362198d', 'volume_name': 'volume-82bdff69-6803-4674-93d8-276eb362198d', 'volume_size': 1, 'image_id': 'd0970d8c-1523-44cb-bb8b-efd440518d55', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d0970d8c-1523-44cb-bb8b-efd440518d55', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '531328dd7fa28268ae87a3e6e9e79337', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4973707e9e124089bfb47f8da5fbde35', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e71bfe247da73156a52076101b69c511e236f42b38bf9ba3ef01068e65aa66026461dfa45d1edd2178a0d36eae2ba45ff51c34cbf563b5585eb787545496f48e', 'id': 'd0970d8c-1523-44cb-bb8b-efd440518d55', 'created_at': datetime.datetime(2026, 9, 16, 18, 31, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 18, 31, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d0970d8c-1523-44cb-bb8b-efd440518d55/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:31:14 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e398936d-3a22-4841-870c-7d467190cff3 tempest-VolumeAndVolumeTypeFromImageTest-642861740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e88eda4a-eff5-4ebb-bf8b-c7797b0a4ee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:31:14 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e398936d-3a22-4841-870c-7d467190cff3 tempest-VolumeAndVolumeTypeFromImageTest-642861740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e88eda4a-eff5-4ebb-bf8b-c7797b0a4ee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:31:14 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e398936d-3a22-4841-870c-7d467190cff3 tempest-VolumeAndVolumeTypeFromImageTest-642861740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32d7c2d6-0360-4606-aae8-977dedc9af1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:31:14 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-e398936d-3a22-4841-870c-7d467190cff3 tempest-VolumeAndVolumeTypeFromImageTest-642861740 None] Volume 82bdff69-6803-4674-93d8-276eb362198d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-82bdff69-6803-4674-93d8-276eb362198d', 'volume_size': 1, 'image_id': 'd0970d8c-1523-44cb-bb8b-efd440518d55', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d0970d8c-1523-44cb-bb8b-efd440518d55', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '531328dd7fa28268ae87a3e6e9e79337', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4973707e9e124089bfb47f8da5fbde35', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e71bfe247da73156a52076101b69c511e236f42b38bf9ba3ef01068e65aa66026461dfa45d1edd2178a0d36eae2ba45ff51c34cbf563b5585eb787545496f48e', 'id': 'd0970d8c-1523-44cb-bb8b-efd440518d55', 'created_at': datetime.datetime(2026, 9, 16, 18, 31, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 18, 31, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d0970d8c-1523-44cb-bb8b-efd440518d55/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 16 20:31:14 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-e398936d-3a22-4841-870c-7d467190cff3 tempest-VolumeAndVolumeTypeFromImageTest-642861740 None] Trying to clone 82bdff69-6803-4674-93d8-276eb362198d from image d0970d8c-1523-44cb-bb8b-efd440518d55 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d0970d8c-1523-44cb-bb8b-efd440518d55', 'metadata': {}}]). {{(pid=86188) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 16 20:31:14 devstack cinder-volume[86188]: DEBUG cinder.image.image_utils [None req-e398936d-3a22-4841-870c-7d467190cff3 tempest-VolumeAndVolumeTypeFromImageTest-642861740 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d0970d8c-1523-44cb-bb8b-efd440518d55_gaeyobwydevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86188) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 16 20:31:14 devstack cinder-volume[86188]: INFO cinder.image.image_utils [None req-e398936d-3a22-4841-870c-7d467190cff3 tempest-VolumeAndVolumeTypeFromImageTest-642861740 None] Image download 0.00 MB at 0.00 MB/s Sep 16 20:31:14 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fb24bc1-5465-4044-9f41-ca554036471d]: (4, 'raw') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:31:14 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e398936d-3a22-4841-870c-7d467190cff3 tempest-VolumeAndVolumeTypeFromImageTest-642861740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d0970d8c-1523-44cb-bb8b-efd440518d55_gaeyobwydevstack@QuobyteHD {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:31:15 devstack sudo[100730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d0970d8c-1523-44cb-bb8b-efd440518d55_gaeyobwydevstack@QuobyteHD Sep 16 20:31:15 devstack sudo[100730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:31:15 devstack sudo[100730]: pam_unix(sudo:session): session closed for user root Sep 16 20:31:15 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e398936d-3a22-4841-870c-7d467190cff3 tempest-VolumeAndVolumeTypeFromImageTest-642861740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d0970d8c-1523-44cb-bb8b-efd440518d55_gaeyobwydevstack@QuobyteHD" returned: 0 in 0.440s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:31:15 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e398936d-3a22-4841-870c-7d467190cff3 tempest-VolumeAndVolumeTypeFromImageTest-642861740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d0970d8c-1523-44cb-bb8b-efd440518d55_gaeyobwydevstack@QuobyteHD {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:31:15 devstack sudo[100734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d0970d8c-1523-44cb-bb8b-efd440518d55_gaeyobwydevstack@QuobyteHD Sep 16 20:31:15 devstack sudo[100734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:31:15 devstack sudo[100734]: pam_unix(sudo:session): session closed for user root Sep 16 20:31:15 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e398936d-3a22-4841-870c-7d467190cff3 tempest-VolumeAndVolumeTypeFromImageTest-642861740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d0970d8c-1523-44cb-bb8b-efd440518d55_gaeyobwydevstack@QuobyteHD" returned: 1 in 0.378s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:31:15 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e398936d-3a22-4841-870c-7d467190cff3 tempest-VolumeAndVolumeTypeFromImageTest-642861740 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d0970d8c-1523-44cb-bb8b-efd440518d55_gaeyobwydevstack@QuobyteHD' failed. Not Retrying. {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 16 20:31:15 devstack cinder-volume[86188]: DEBUG cinder.image.image_utils [None req-e398936d-3a22-4841-870c-7d467190cff3 tempest-VolumeAndVolumeTypeFromImageTest-642861740 None] Temporary image d0970d8c-1523-44cb-bb8b-efd440518d55 is fetched for user 77b1bcdfb8784af4a77f8560f3191225. {{(pid=86188) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 16 20:31:15 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9f43b60-0572-434a-8ef2-bba9bd7b7d8e]: (4, 'raw') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:31:15 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e398936d-3a22-4841-870c-7d467190cff3 tempest-VolumeAndVolumeTypeFromImageTest-642861740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d0970d8c-1523-44cb-bb8b-efd440518d55_gaeyobwydevstack@QuobyteHD {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:31:16 devstack sudo[100739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d0970d8c-1523-44cb-bb8b-efd440518d55_gaeyobwydevstack@QuobyteHD Sep 16 20:31:16 devstack sudo[100739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:31:16 devstack sudo[100739]: pam_unix(sudo:session): session closed for user root Sep 16 20:31:16 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e398936d-3a22-4841-870c-7d467190cff3 tempest-VolumeAndVolumeTypeFromImageTest-642861740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d0970d8c-1523-44cb-bb8b-efd440518d55_gaeyobwydevstack@QuobyteHD" returned: 0 in 0.388s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:31:16 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e398936d-3a22-4841-870c-7d467190cff3 tempest-VolumeAndVolumeTypeFromImageTest-642861740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d0970d8c-1523-44cb-bb8b-efd440518d55_gaeyobwydevstack@QuobyteHD {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:31:16 devstack sudo[100743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d0970d8c-1523-44cb-bb8b-efd440518d55_gaeyobwydevstack@QuobyteHD Sep 16 20:31:16 devstack sudo[100743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:31:16 devstack sudo[100743]: pam_unix(sudo:session): session closed for user root Sep 16 20:31:16 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e398936d-3a22-4841-870c-7d467190cff3 tempest-VolumeAndVolumeTypeFromImageTest-642861740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d0970d8c-1523-44cb-bb8b-efd440518d55_gaeyobwydevstack@QuobyteHD" returned: 1 in 0.390s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:31:16 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e398936d-3a22-4841-870c-7d467190cff3 tempest-VolumeAndVolumeTypeFromImageTest-642861740 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d0970d8c-1523-44cb-bb8b-efd440518d55_gaeyobwydevstack@QuobyteHD' failed. Not Retrying. {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 16 20:31:16 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-e398936d-3a22-4841-870c-7d467190cff3 tempest-VolumeAndVolumeTypeFromImageTest-642861740 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:31:16 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-e398936d-3a22-4841-870c-7d467190cff3 tempest-VolumeAndVolumeTypeFromImageTest-642861740 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:31:16 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-e398936d-3a22-4841-870c-7d467190cff3 tempest-VolumeAndVolumeTypeFromImageTest-642861740 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:31:14Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82bdff69-6803-4674-93d8-276eb362198d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4973707e9e124089bfb47f8da5fbde35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:31:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:31:14Z,use_quota=True,user_id='77b1bcdfb8784af4a77f8560f3191225',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(675e1f0c-9b26-40e9-b279-6a0ef96ca3dc),volume_type_id=675e1f0c-9b26-40e9-b279-6a0ef96ca3dc)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:31:16 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-e398936d-3a22-4841-870c-7d467190cff3 tempest-VolumeAndVolumeTypeFromImageTest-642861740 None] Creating volume 82bdff69-6803-4674-93d8-276eb362198d {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:31:16 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-e398936d-3a22-4841-870c-7d467190cff3 tempest-VolumeAndVolumeTypeFromImageTest-642861740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:31:16 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-e398936d-3a22-4841-870c-7d467190cff3 tempest-VolumeAndVolumeTypeFromImageTest-642861740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:31:16 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-e398936d-3a22-4841-870c-7d467190cff3 tempest-VolumeAndVolumeTypeFromImageTest-642861740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:31:16 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-e398936d-3a22-4841-870c-7d467190cff3 tempest-VolumeAndVolumeTypeFromImageTest-642861740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:31:16 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-e398936d-3a22-4841-870c-7d467190cff3 tempest-VolumeAndVolumeTypeFromImageTest-642861740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:31:16 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-e398936d-3a22-4841-870c-7d467190cff3 tempest-VolumeAndVolumeTypeFromImageTest-642861740 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:31:16 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-e398936d-3a22-4841-870c-7d467190cff3 tempest-VolumeAndVolumeTypeFromImageTest-642861740 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:31:16 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e398936d-3a22-4841-870c-7d467190cff3 tempest-VolumeAndVolumeTypeFromImageTest-642861740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82bdff69-6803-4674-93d8-276eb362198d 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:31:16 devstack sudo[100748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82bdff69-6803-4674-93d8-276eb362198d 1073741824 Sep 16 20:31:16 devstack sudo[100748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:31:17 devstack sudo[100748]: pam_unix(sudo:session): session closed for user root Sep 16 20:31:17 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e398936d-3a22-4841-870c-7d467190cff3 tempest-VolumeAndVolumeTypeFromImageTest-642861740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82bdff69-6803-4674-93d8-276eb362198d 1073741824" returned: 0 in 0.557s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:31:17 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e398936d-3a22-4841-870c-7d467190cff3 tempest-VolumeAndVolumeTypeFromImageTest-642861740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82bdff69-6803-4674-93d8-276eb362198d {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:31:17 devstack sudo[100754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82bdff69-6803-4674-93d8-276eb362198d Sep 16 20:31:17 devstack sudo[100754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:31:17 devstack sudo[100754]: pam_unix(sudo:session): session closed for user root Sep 16 20:31:17 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e398936d-3a22-4841-870c-7d467190cff3 tempest-VolumeAndVolumeTypeFromImageTest-642861740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82bdff69-6803-4674-93d8-276eb362198d" returned: 0 in 0.301s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:31:17 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-e398936d-3a22-4841-870c-7d467190cff3 tempest-VolumeAndVolumeTypeFromImageTest-642861740 None] <== create_volume: return (917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:31:17 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-e398936d-3a22-4841-870c-7d467190cff3 tempest-VolumeAndVolumeTypeFromImageTest-642861740 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:31:17 devstack cinder-volume[86188]: DEBUG cinder.volume.volume_utils [None req-e398936d-3a22-4841-870c-7d467190cff3 tempest-VolumeAndVolumeTypeFromImageTest-642861740 None] Attempting download of d0970d8c-1523-44cb-bb8b-efd440518d55 ((None, [{'url': 'file:///opt/stack/data/glance/images/d0970d8c-1523-44cb-bb8b-efd440518d55', 'metadata': {}}])) to volume 82bdff69-6803-4674-93d8-276eb362198d. {{(pid=86188) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 16 20:31:17 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[795b03c0-442a-46e3-80af-a35820773ff4]: (4, 'raw') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:31:17 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e398936d-3a22-4841-870c-7d467190cff3 tempest-VolumeAndVolumeTypeFromImageTest-642861740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d0970d8c-1523-44cb-bb8b-efd440518d55_vkup5z3s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:31:17 devstack sudo[100757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d0970d8c-1523-44cb-bb8b-efd440518d55_vkup5z3s Sep 16 20:31:17 devstack sudo[100757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:31:18 devstack sudo[100757]: pam_unix(sudo:session): session closed for user root Sep 16 20:31:18 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e398936d-3a22-4841-870c-7d467190cff3 tempest-VolumeAndVolumeTypeFromImageTest-642861740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d0970d8c-1523-44cb-bb8b-efd440518d55_vkup5z3s" returned: 0 in 0.355s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:31:18 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e398936d-3a22-4841-870c-7d467190cff3 tempest-VolumeAndVolumeTypeFromImageTest-642861740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d0970d8c-1523-44cb-bb8b-efd440518d55_vkup5z3s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:31:18 devstack sudo[100761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d0970d8c-1523-44cb-bb8b-efd440518d55_vkup5z3s Sep 16 20:31:18 devstack sudo[100761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:31:18 devstack sudo[100761]: pam_unix(sudo:session): session closed for user root Sep 16 20:31:18 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e398936d-3a22-4841-870c-7d467190cff3 tempest-VolumeAndVolumeTypeFromImageTest-642861740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d0970d8c-1523-44cb-bb8b-efd440518d55_vkup5z3s" returned: 1 in 0.358s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:31:18 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e398936d-3a22-4841-870c-7d467190cff3 tempest-VolumeAndVolumeTypeFromImageTest-642861740 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d0970d8c-1523-44cb-bb8b-efd440518d55_vkup5z3s' failed. Not Retrying. {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 16 20:31:18 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ff5b043-0ea8-40e2-88bb-f6071859a534]: (4, 'raw') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:31:18 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e398936d-3a22-4841-870c-7d467190cff3 tempest-VolumeAndVolumeTypeFromImageTest-642861740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d0970d8c-1523-44cb-bb8b-efd440518d55_gaeyobwydevstack@QuobyteHD {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:31:18 devstack sudo[100765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d0970d8c-1523-44cb-bb8b-efd440518d55_gaeyobwydevstack@QuobyteHD Sep 16 20:31:18 devstack sudo[100765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:31:18 devstack sudo[100765]: pam_unix(sudo:session): session closed for user root Sep 16 20:31:18 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e398936d-3a22-4841-870c-7d467190cff3 tempest-VolumeAndVolumeTypeFromImageTest-642861740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d0970d8c-1523-44cb-bb8b-efd440518d55_gaeyobwydevstack@QuobyteHD" returned: 0 in 0.421s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:31:18 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e398936d-3a22-4841-870c-7d467190cff3 tempest-VolumeAndVolumeTypeFromImageTest-642861740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d0970d8c-1523-44cb-bb8b-efd440518d55_gaeyobwydevstack@QuobyteHD {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:31:19 devstack sudo[100769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d0970d8c-1523-44cb-bb8b-efd440518d55_gaeyobwydevstack@QuobyteHD Sep 16 20:31:19 devstack sudo[100769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:31:19 devstack sudo[100769]: pam_unix(sudo:session): session closed for user root Sep 16 20:31:19 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e398936d-3a22-4841-870c-7d467190cff3 tempest-VolumeAndVolumeTypeFromImageTest-642861740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d0970d8c-1523-44cb-bb8b-efd440518d55_gaeyobwydevstack@QuobyteHD" returned: 1 in 0.420s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:31:19 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e398936d-3a22-4841-870c-7d467190cff3 tempest-VolumeAndVolumeTypeFromImageTest-642861740 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d0970d8c-1523-44cb-bb8b-efd440518d55_gaeyobwydevstack@QuobyteHD' failed. Not Retrying. {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 16 20:31:19 devstack cinder-volume[86188]: DEBUG cinder.image.image_utils [None req-e398936d-3a22-4841-870c-7d467190cff3 tempest-VolumeAndVolumeTypeFromImageTest-642861740 None] d0970d8c-1523-44cb-bb8b-efd440518d55 was raw, converting to qcow2 {{(pid=86188) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 16 20:31:19 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e398936d-3a22-4841-870c-7d467190cff3 tempest-VolumeAndVolumeTypeFromImageTest-642861740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d0970d8c-1523-44cb-bb8b-efd440518d55_gaeyobwydevstack@QuobyteHD /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82bdff69-6803-4674-93d8-276eb362198d {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:31:19 devstack sudo[100775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d0970d8c-1523-44cb-bb8b-efd440518d55_gaeyobwydevstack@QuobyteHD /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82bdff69-6803-4674-93d8-276eb362198d Sep 16 20:31:19 devstack sudo[100775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:31:19 devstack sudo[100775]: pam_unix(sudo:session): session closed for user root Sep 16 20:31:19 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e398936d-3a22-4841-870c-7d467190cff3 tempest-VolumeAndVolumeTypeFromImageTest-642861740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d0970d8c-1523-44cb-bb8b-efd440518d55_gaeyobwydevstack@QuobyteHD /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82bdff69-6803-4674-93d8-276eb362198d" returned: 0 in 0.649s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:31:19 devstack cinder-volume[86188]: DEBUG cinder.image.image_utils [None req-e398936d-3a22-4841-870c-7d467190cff3 tempest-VolumeAndVolumeTypeFromImageTest-642861740 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d0970d8c-1523-44cb-bb8b-efd440518d55_gaeyobwydevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82bdff69-6803-4674-93d8-276eb362198d {{(pid=86188) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 16 20:31:19 devstack cinder-volume[86188]: INFO cinder.image.image_utils [None req-e398936d-3a22-4841-870c-7d467190cff3 tempest-VolumeAndVolumeTypeFromImageTest-642861740 None] Converted 0.00 MB image at 0.00 MB/s Sep 16 20:31:19 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e398936d-3a22-4841-870c-7d467190cff3 tempest-VolumeAndVolumeTypeFromImageTest-642861740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82bdff69-6803-4674-93d8-276eb362198d 1G {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:31:19 devstack sudo[100781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82bdff69-6803-4674-93d8-276eb362198d 1G Sep 16 20:31:19 devstack sudo[100781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:31:20 devstack sudo[100781]: pam_unix(sudo:session): session closed for user root Sep 16 20:31:20 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e398936d-3a22-4841-870c-7d467190cff3 tempest-VolumeAndVolumeTypeFromImageTest-642861740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82bdff69-6803-4674-93d8-276eb362198d 1G" returned: 0 in 0.371s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:31:20 devstack cinder-volume[86188]: DEBUG cinder.volume.volume_utils [None req-e398936d-3a22-4841-870c-7d467190cff3 tempest-VolumeAndVolumeTypeFromImageTest-642861740 None] Downloaded image d0970d8c-1523-44cb-bb8b-efd440518d55 ((None, [{'url': 'file:///opt/stack/data/glance/images/d0970d8c-1523-44cb-bb8b-efd440518d55', 'metadata': {}}])) to volume 82bdff69-6803-4674-93d8-276eb362198d successfully. {{(pid=86188) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 16 20:31:20 devstack cinder-volume[86188]: DEBUG cinder.image.image_utils [None req-e398936d-3a22-4841-870c-7d467190cff3 tempest-VolumeAndVolumeTypeFromImageTest-642861740 None] Temporary image d0970d8c-1523-44cb-bb8b-efd440518d55 for user 77b1bcdfb8784af4a77f8560f3191225 is deleted. {{(pid=86188) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 16 20:31:20 devstack cinder-volume[86188]: DEBUG cinder.volume.volume_utils [None req-e398936d-3a22-4841-870c-7d467190cff3 tempest-VolumeAndVolumeTypeFromImageTest-642861740 None] Marking volume 82bdff69-6803-4674-93d8-276eb362198d as bootable. {{(pid=86188) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 16 20:31:20 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-e398936d-3a22-4841-870c-7d467190cff3 tempest-VolumeAndVolumeTypeFromImageTest-642861740 None] Copying metadata from image d0970d8c-1523-44cb-bb8b-efd440518d55 to 82bdff69-6803-4674-93d8-276eb362198d. {{(pid=86188) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 16 20:31:20 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-e398936d-3a22-4841-870c-7d467190cff3 tempest-VolumeAndVolumeTypeFromImageTest-642861740 None] Creating volume glance metadata for volume 82bdff69-6803-4674-93d8-276eb362198d backed by image d0970d8c-1523-44cb-bb8b-efd440518d55 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'd0970d8c-1523-44cb-bb8b-efd440518d55', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '531328dd7fa28268ae87a3e6e9e79337', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86188) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 16 20:31:20 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e398936d-3a22-4841-870c-7d467190cff3 tempest-VolumeAndVolumeTypeFromImageTest-642861740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32d7c2d6-0360-4606-aae8-977dedc9af1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82bdff69-6803-4674-93d8-276eb362198d', 'volume_size': 1, 'image_id': 'd0970d8c-1523-44cb-bb8b-efd440518d55', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d0970d8c-1523-44cb-bb8b-efd440518d55', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '531328dd7fa28268ae87a3e6e9e79337', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4973707e9e124089bfb47f8da5fbde35', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e71bfe247da73156a52076101b69c511e236f42b38bf9ba3ef01068e65aa66026461dfa45d1edd2178a0d36eae2ba45ff51c34cbf563b5585eb787545496f48e', 'id': 'd0970d8c-1523-44cb-bb8b-efd440518d55', 'created_at': datetime.datetime(2026, 9, 16, 18, 31, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 18, 31, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d0970d8c-1523-44cb-bb8b-efd440518d55/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:31:20 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e398936d-3a22-4841-870c-7d467190cff3 tempest-VolumeAndVolumeTypeFromImageTest-642861740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14f6272f-466c-4a77-add6-d648db3546fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:31:20 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-e398936d-3a22-4841-870c-7d467190cff3 tempest-VolumeAndVolumeTypeFromImageTest-642861740 None] Volume volume-82bdff69-6803-4674-93d8-276eb362198d (82bdff69-6803-4674-93d8-276eb362198d): created successfully Sep 16 20:31:20 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e398936d-3a22-4841-870c-7d467190cff3 tempest-VolumeAndVolumeTypeFromImageTest-642861740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14f6272f-466c-4a77-add6-d648db3546fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:31:20 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e398936d-3a22-4841-870c-7d467190cff3 tempest-VolumeAndVolumeTypeFromImageTest-642861740 None] Flow 'volume_create_manager' (94d393a8-ad88-4e5c-b0ae-f4c0835c7d31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:31:20 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-e398936d-3a22-4841-870c-7d467190cff3 tempest-VolumeAndVolumeTypeFromImageTest-642861740 None] Created volume successfully. Sep 16 20:31:20 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-86a21857-75bd-4264-8727-75f67f30c36f tempest-VolumeAndVolumeTypeFromImageTest-642861740 None] Acquiring lock "cinder-82bdff69-6803-4674-93d8-276eb362198d-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:31:20 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-86a21857-75bd-4264-8727-75f67f30c36f tempest-VolumeAndVolumeTypeFromImageTest-642861740 None] Lock "cinder-82bdff69-6803-4674-93d8-276eb362198d-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:31:20 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-86a21857-75bd-4264-8727-75f67f30c36f tempest-VolumeAndVolumeTypeFromImageTest-642861740 None] Acquiring lock "cinder-quobyte-82bdff69-6803-4674-93d8-276eb362198d" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:31:20 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-86a21857-75bd-4264-8727-75f67f30c36f tempest-VolumeAndVolumeTypeFromImageTest-642861740 None] Lock "cinder-quobyte-82bdff69-6803-4674-93d8-276eb362198d" acquired by "delete_volume" :: waited 0.025s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:31:21 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[002813e9-f168-44df-9178-eac6234cd63d]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:31:21 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-86a21857-75bd-4264-8727-75f67f30c36f tempest-VolumeAndVolumeTypeFromImageTest-642861740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82bdff69-6803-4674-93d8-276eb362198d {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:31:21 devstack sudo[100789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82bdff69-6803-4674-93d8-276eb362198d Sep 16 20:31:21 devstack sudo[100789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:31:21 devstack sudo[100789]: pam_unix(sudo:session): session closed for user root Sep 16 20:31:21 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-86a21857-75bd-4264-8727-75f67f30c36f tempest-VolumeAndVolumeTypeFromImageTest-642861740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82bdff69-6803-4674-93d8-276eb362198d" returned: 0 in 0.450s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:31:21 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-86a21857-75bd-4264-8727-75f67f30c36f tempest-VolumeAndVolumeTypeFromImageTest-642861740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82bdff69-6803-4674-93d8-276eb362198d {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:31:21 devstack sudo[100794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82bdff69-6803-4674-93d8-276eb362198d Sep 16 20:31:21 devstack sudo[100794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:31:21 devstack sudo[100794]: pam_unix(sudo:session): session closed for user root Sep 16 20:31:21 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-86a21857-75bd-4264-8727-75f67f30c36f tempest-VolumeAndVolumeTypeFromImageTest-642861740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-82bdff69-6803-4674-93d8-276eb362198d" returned: 0 in 0.305s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:31:21 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-86a21857-75bd-4264-8727-75f67f30c36f tempest-VolumeAndVolumeTypeFromImageTest-642861740 None] Lock "cinder-quobyte-82bdff69-6803-4674-93d8-276eb362198d" released by "delete_volume" :: held 0.817s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:31:21 devstack cinder-volume[86188]: WARNING cinder.quota [None req-86a21857-75bd-4264-8727-75f67f30c36f tempest-VolumeAndVolumeTypeFromImageTest-642861740 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 16 20:31:21 devstack cinder-volume[86188]: WARNING cinder.quota [None req-86a21857-75bd-4264-8727-75f67f30c36f tempest-VolumeAndVolumeTypeFromImageTest-642861740 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 16 20:31:21 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-86a21857-75bd-4264-8727-75f67f30c36f tempest-VolumeAndVolumeTypeFromImageTest-642861740 None] Created reservations ['0c8bf15d-ca33-41c7-996f-66a279238a19', '7865f05a-ad47-4f8e-81eb-c2cfa23857c0', '7e6dd2d0-0e53-419d-aea1-61086bf6bb66', '3a2eb32f-a00b-4efb-98c0-ac773aecb71d'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:31:21 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-86a21857-75bd-4264-8727-75f67f30c36f tempest-VolumeAndVolumeTypeFromImageTest-642861740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:31:21 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-86a21857-75bd-4264-8727-75f67f30c36f tempest-VolumeAndVolumeTypeFromImageTest-642861740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:31:21 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-86a21857-75bd-4264-8727-75f67f30c36f tempest-VolumeAndVolumeTypeFromImageTest-642861740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:31:21 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-86a21857-75bd-4264-8727-75f67f30c36f tempest-VolumeAndVolumeTypeFromImageTest-642861740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:31:21 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-86a21857-75bd-4264-8727-75f67f30c36f tempest-VolumeAndVolumeTypeFromImageTest-642861740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:31:21 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-86a21857-75bd-4264-8727-75f67f30c36f tempest-VolumeAndVolumeTypeFromImageTest-642861740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:31:22 devstack sudo[100797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:31:22 devstack sudo[100797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:31:22 devstack sudo[100797]: pam_unix(sudo:session): session closed for user root Sep 16 20:31:22 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-86a21857-75bd-4264-8727-75f67f30c36f tempest-VolumeAndVolumeTypeFromImageTest-642861740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.356s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:31:22 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-86a21857-75bd-4264-8727-75f67f30c36f tempest-VolumeAndVolumeTypeFromImageTest-642861740 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:31:22 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-86a21857-75bd-4264-8727-75f67f30c36f tempest-VolumeAndVolumeTypeFromImageTest-642861740 None] Deleted volume successfully. Sep 16 20:31:22 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-86a21857-75bd-4264-8727-75f67f30c36f tempest-VolumeAndVolumeTypeFromImageTest-642861740 None] Lock "cinder-82bdff69-6803-4674-93d8-276eb362198d-delete_volume" released by "delete_volume" :: held 1.459s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:31:29 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-65acfce0-a2e7-4afe-896d-e8c572ea3550 tempest-CreateVolumesFromImageTest-1117605042 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:31:29 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-65acfce0-a2e7-4afe-896d-e8c572ea3550 tempest-CreateVolumesFromImageTest-1117605042 None] Flow 'volume_create_manager' (9416e2b3-8f6b-4fb9-9dab-b8868e6bd2e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:31:29 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-65acfce0-a2e7-4afe-896d-e8c572ea3550 tempest-CreateVolumesFromImageTest-1117605042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f011998a-f41e-4da0-9247-c129e1c09e3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:31:29 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-65acfce0-a2e7-4afe-896d-e8c572ea3550 tempest-CreateVolumesFromImageTest-1117605042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f011998a-f41e-4da0-9247-c129e1c09e3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:31:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-914967929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ff02564-f2da-483a-a104-827c079ac81a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c51d53435d24b15863ea610953c5bed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:31:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:31:29Z,use_quota=True,user_id='53c71851dbf943d085d967e99738995d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:31:29 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-65acfce0-a2e7-4afe-896d-e8c572ea3550 tempest-CreateVolumesFromImageTest-1117605042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (552fc9aa-9d03-464c-8878-c0d78bebf5f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:31:29 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-65acfce0-a2e7-4afe-896d-e8c572ea3550 tempest-CreateVolumesFromImageTest-1117605042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (552fc9aa-9d03-464c-8878-c0d78bebf5f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:31:29 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-65acfce0-a2e7-4afe-896d-e8c572ea3550 tempest-CreateVolumesFromImageTest-1117605042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa60d9c2-f44b-442d-80cf-34dc7e957940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:31:29 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-65acfce0-a2e7-4afe-896d-e8c572ea3550 tempest-CreateVolumesFromImageTest-1117605042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa60d9c2-f44b-442d-80cf-34dc7e957940) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ff02564-f2da-483a-a104-827c079ac81a', 'volume_name': 'volume-3ff02564-f2da-483a-a104-827c079ac81a', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:31:29 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-65acfce0-a2e7-4afe-896d-e8c572ea3550 tempest-CreateVolumesFromImageTest-1117605042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5789bee-ba6d-4aad-8d8a-c856d0c0d13b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:31:29 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-65acfce0-a2e7-4afe-896d-e8c572ea3550 tempest-CreateVolumesFromImageTest-1117605042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5789bee-ba6d-4aad-8d8a-c856d0c0d13b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:31:29 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-65acfce0-a2e7-4afe-896d-e8c572ea3550 tempest-CreateVolumesFromImageTest-1117605042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8373f9e1-d480-4527-b6a3-fc67e3dea5d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:31:29 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-65acfce0-a2e7-4afe-896d-e8c572ea3550 tempest-CreateVolumesFromImageTest-1117605042 None] Volume 3ff02564-f2da-483a-a104-827c079ac81a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ff02564-f2da-483a-a104-827c079ac81a', 'volume_size': 1} Sep 16 20:31:29 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-65acfce0-a2e7-4afe-896d-e8c572ea3550 tempest-CreateVolumesFromImageTest-1117605042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:31:29 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-65acfce0-a2e7-4afe-896d-e8c572ea3550 tempest-CreateVolumesFromImageTest-1117605042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:31:29 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-65acfce0-a2e7-4afe-896d-e8c572ea3550 tempest-CreateVolumesFromImageTest-1117605042 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:31:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-914967929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ff02564-f2da-483a-a104-827c079ac81a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c51d53435d24b15863ea610953c5bed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:31:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:31:29Z,use_quota=True,user_id='53c71851dbf943d085d967e99738995d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:31:29 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-65acfce0-a2e7-4afe-896d-e8c572ea3550 tempest-CreateVolumesFromImageTest-1117605042 None] Creating volume 3ff02564-f2da-483a-a104-827c079ac81a {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:31:29 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-65acfce0-a2e7-4afe-896d-e8c572ea3550 tempest-CreateVolumesFromImageTest-1117605042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:31:29 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-65acfce0-a2e7-4afe-896d-e8c572ea3550 tempest-CreateVolumesFromImageTest-1117605042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:31:29 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-65acfce0-a2e7-4afe-896d-e8c572ea3550 tempest-CreateVolumesFromImageTest-1117605042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:31:29 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-65acfce0-a2e7-4afe-896d-e8c572ea3550 tempest-CreateVolumesFromImageTest-1117605042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:31:29 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-65acfce0-a2e7-4afe-896d-e8c572ea3550 tempest-CreateVolumesFromImageTest-1117605042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:31:29 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-65acfce0-a2e7-4afe-896d-e8c572ea3550 tempest-CreateVolumesFromImageTest-1117605042 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:31:29 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-65acfce0-a2e7-4afe-896d-e8c572ea3550 tempest-CreateVolumesFromImageTest-1117605042 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:31:29 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-65acfce0-a2e7-4afe-896d-e8c572ea3550 tempest-CreateVolumesFromImageTest-1117605042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-3ff02564-f2da-483a-a104-827c079ac81a 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:31:29 devstack sudo[100887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-3ff02564-f2da-483a-a104-827c079ac81a 1073741824 Sep 16 20:31:29 devstack sudo[100887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:31:30 devstack sudo[100887]: pam_unix(sudo:session): session closed for user root Sep 16 20:31:30 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-65acfce0-a2e7-4afe-896d-e8c572ea3550 tempest-CreateVolumesFromImageTest-1117605042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-3ff02564-f2da-483a-a104-827c079ac81a 1073741824" returned: 0 in 1.025s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:31:30 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-25f06b33-7b54-4469-b037-db0be2c8e366 tempest-CreateVolumesFromImageTest-1117605042 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:31:30 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-25f06b33-7b54-4469-b037-db0be2c8e366 tempest-CreateVolumesFromImageTest-1117605042 None] Flow 'volume_create_manager' (5c209eb1-311b-4b91-b360-c9c5f6a9d1c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:31:30 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-25f06b33-7b54-4469-b037-db0be2c8e366 tempest-CreateVolumesFromImageTest-1117605042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d31a655-936d-4d06-b7d3-582646609eba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:31:30 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-65acfce0-a2e7-4afe-896d-e8c572ea3550 tempest-CreateVolumesFromImageTest-1117605042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-3ff02564-f2da-483a-a104-827c079ac81a {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:31:30 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-25f06b33-7b54-4469-b037-db0be2c8e366 tempest-CreateVolumesFromImageTest-1117605042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d31a655-936d-4d06-b7d3-582646609eba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:31:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1579706666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ebc55a6-3518-45e8-a507-34be63a75052,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c51d53435d24b15863ea610953c5bed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:31:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:31:30Z,use_quota=True,user_id='53c71851dbf943d085d967e99738995d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:31:30 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-25f06b33-7b54-4469-b037-db0be2c8e366 tempest-CreateVolumesFromImageTest-1117605042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (255864b5-bd8f-4508-96bf-4be673f90608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:31:30 devstack sudo[100894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-3ff02564-f2da-483a-a104-827c079ac81a Sep 16 20:31:30 devstack sudo[100894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:31:30 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-25f06b33-7b54-4469-b037-db0be2c8e366 tempest-CreateVolumesFromImageTest-1117605042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (255864b5-bd8f-4508-96bf-4be673f90608) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:31:30 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-25f06b33-7b54-4469-b037-db0be2c8e366 tempest-CreateVolumesFromImageTest-1117605042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d4fad61-26df-41fd-850b-9c934399d66e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:31:30 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-25f06b33-7b54-4469-b037-db0be2c8e366 tempest-CreateVolumesFromImageTest-1117605042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d4fad61-26df-41fd-850b-9c934399d66e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ebc55a6-3518-45e8-a507-34be63a75052', 'volume_name': 'volume-1ebc55a6-3518-45e8-a507-34be63a75052', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:31:30 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-25f06b33-7b54-4469-b037-db0be2c8e366 tempest-CreateVolumesFromImageTest-1117605042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd1b1010-4383-4df9-b724-1f142c1c768c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:31:30 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-25f06b33-7b54-4469-b037-db0be2c8e366 tempest-CreateVolumesFromImageTest-1117605042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd1b1010-4383-4df9-b724-1f142c1c768c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:31:30 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-25f06b33-7b54-4469-b037-db0be2c8e366 tempest-CreateVolumesFromImageTest-1117605042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d19ed649-2965-408e-ac5d-75675ed2dcab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:31:30 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-25f06b33-7b54-4469-b037-db0be2c8e366 tempest-CreateVolumesFromImageTest-1117605042 None] Volume 1ebc55a6-3518-45e8-a507-34be63a75052: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ebc55a6-3518-45e8-a507-34be63a75052', 'volume_size': 1} Sep 16 20:31:30 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-25f06b33-7b54-4469-b037-db0be2c8e366 tempest-CreateVolumesFromImageTest-1117605042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:31:31 devstack sudo[100894]: pam_unix(sudo:session): session closed for user root Sep 16 20:31:31 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-65acfce0-a2e7-4afe-896d-e8c572ea3550 tempest-CreateVolumesFromImageTest-1117605042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-3ff02564-f2da-483a-a104-827c079ac81a" returned: 0 in 0.729s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:31:31 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-65acfce0-a2e7-4afe-896d-e8c572ea3550 tempest-CreateVolumesFromImageTest-1117605042 None] <== create_volume: return (1975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:31:31 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-65acfce0-a2e7-4afe-896d-e8c572ea3550 tempest-CreateVolumesFromImageTest-1117605042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.979s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:31:31 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-25f06b33-7b54-4469-b037-db0be2c8e366 tempest-CreateVolumesFromImageTest-1117605042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.622s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:31:31 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-25f06b33-7b54-4469-b037-db0be2c8e366 tempest-CreateVolumesFromImageTest-1117605042 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:31:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1579706666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ebc55a6-3518-45e8-a507-34be63a75052,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c51d53435d24b15863ea610953c5bed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:31:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:31:30Z,use_quota=True,user_id='53c71851dbf943d085d967e99738995d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:31:31 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-25f06b33-7b54-4469-b037-db0be2c8e366 tempest-CreateVolumesFromImageTest-1117605042 None] Creating volume 1ebc55a6-3518-45e8-a507-34be63a75052 {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:31:31 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-25f06b33-7b54-4469-b037-db0be2c8e366 tempest-CreateVolumesFromImageTest-1117605042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:31:31 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-25f06b33-7b54-4469-b037-db0be2c8e366 tempest-CreateVolumesFromImageTest-1117605042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:31:31 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-25f06b33-7b54-4469-b037-db0be2c8e366 tempest-CreateVolumesFromImageTest-1117605042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:31:31 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-25f06b33-7b54-4469-b037-db0be2c8e366 tempest-CreateVolumesFromImageTest-1117605042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:31:31 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-25f06b33-7b54-4469-b037-db0be2c8e366 tempest-CreateVolumesFromImageTest-1117605042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:31:31 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-25f06b33-7b54-4469-b037-db0be2c8e366 tempest-CreateVolumesFromImageTest-1117605042 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:31:31 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-25f06b33-7b54-4469-b037-db0be2c8e366 tempest-CreateVolumesFromImageTest-1117605042 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:31:31 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-25f06b33-7b54-4469-b037-db0be2c8e366 tempest-CreateVolumesFromImageTest-1117605042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-1ebc55a6-3518-45e8-a507-34be63a75052 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:31:31 devstack sudo[100898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-1ebc55a6-3518-45e8-a507-34be63a75052 1073741824 Sep 16 20:31:31 devstack sudo[100898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:31:31 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-65acfce0-a2e7-4afe-896d-e8c572ea3550 tempest-CreateVolumesFromImageTest-1117605042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8373f9e1-d480-4527-b6a3-fc67e3dea5d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ff02564-f2da-483a-a104-827c079ac81a', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:31:31 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-65acfce0-a2e7-4afe-896d-e8c572ea3550 tempest-CreateVolumesFromImageTest-1117605042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba25a352-8da0-49d8-96ce-ea7b1cb93085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:31:31 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-65acfce0-a2e7-4afe-896d-e8c572ea3550 tempest-CreateVolumesFromImageTest-1117605042 None] Volume volume-3ff02564-f2da-483a-a104-827c079ac81a (3ff02564-f2da-483a-a104-827c079ac81a): created successfully Sep 16 20:31:31 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-65acfce0-a2e7-4afe-896d-e8c572ea3550 tempest-CreateVolumesFromImageTest-1117605042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba25a352-8da0-49d8-96ce-ea7b1cb93085) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:31:31 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-65acfce0-a2e7-4afe-896d-e8c572ea3550 tempest-CreateVolumesFromImageTest-1117605042 None] Flow 'volume_create_manager' (9416e2b3-8f6b-4fb9-9dab-b8868e6bd2e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:31:31 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-be9257a7-b1f8-4bb8-8174-51ba7cc0d030 tempest-CreateVolumesFromImageTest-1117605042 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:31:31 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-be9257a7-b1f8-4bb8-8174-51ba7cc0d030 tempest-CreateVolumesFromImageTest-1117605042 None] Flow 'volume_create_manager' (f7dec5a8-a2cd-41b8-95e2-224081c9e273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:31:31 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-be9257a7-b1f8-4bb8-8174-51ba7cc0d030 tempest-CreateVolumesFromImageTest-1117605042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6566021a-a9db-4cc6-a6ae-4a7e0766dd39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:31:31 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-65acfce0-a2e7-4afe-896d-e8c572ea3550 tempest-CreateVolumesFromImageTest-1117605042 None] Created volume successfully. Sep 16 20:31:31 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-be9257a7-b1f8-4bb8-8174-51ba7cc0d030 tempest-CreateVolumesFromImageTest-1117605042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6566021a-a9db-4cc6-a6ae-4a7e0766dd39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:31:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-295295543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83d44727-43e2-486d-ac22-cb42410fbecf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c51d53435d24b15863ea610953c5bed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:31:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:31:31Z,use_quota=True,user_id='53c71851dbf943d085d967e99738995d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:31:31 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-be9257a7-b1f8-4bb8-8174-51ba7cc0d030 tempest-CreateVolumesFromImageTest-1117605042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6854607c-5677-4dd7-a79c-57031af52822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:31:31 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-be9257a7-b1f8-4bb8-8174-51ba7cc0d030 tempest-CreateVolumesFromImageTest-1117605042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6854607c-5677-4dd7-a79c-57031af52822) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:31:32 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-be9257a7-b1f8-4bb8-8174-51ba7cc0d030 tempest-CreateVolumesFromImageTest-1117605042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cd5ff28-61f6-4ffb-b51b-52274c59a913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:31:32 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-be9257a7-b1f8-4bb8-8174-51ba7cc0d030 tempest-CreateVolumesFromImageTest-1117605042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cd5ff28-61f6-4ffb-b51b-52274c59a913) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83d44727-43e2-486d-ac22-cb42410fbecf', 'volume_name': 'volume-83d44727-43e2-486d-ac22-cb42410fbecf', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:31:32 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-be9257a7-b1f8-4bb8-8174-51ba7cc0d030 tempest-CreateVolumesFromImageTest-1117605042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d3897ce-601b-45fd-bc7f-024e1829da9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:31:32 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-be9257a7-b1f8-4bb8-8174-51ba7cc0d030 tempest-CreateVolumesFromImageTest-1117605042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d3897ce-601b-45fd-bc7f-024e1829da9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:31:32 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-be9257a7-b1f8-4bb8-8174-51ba7cc0d030 tempest-CreateVolumesFromImageTest-1117605042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (071e2397-9f82-466a-8678-79f58be0fe8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:31:32 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-be9257a7-b1f8-4bb8-8174-51ba7cc0d030 tempest-CreateVolumesFromImageTest-1117605042 None] Volume 83d44727-43e2-486d-ac22-cb42410fbecf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83d44727-43e2-486d-ac22-cb42410fbecf', 'volume_size': 1} Sep 16 20:31:32 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-be9257a7-b1f8-4bb8-8174-51ba7cc0d030 tempest-CreateVolumesFromImageTest-1117605042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:31:32 devstack sudo[100898]: pam_unix(sudo:session): session closed for user root Sep 16 20:31:32 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-25f06b33-7b54-4469-b037-db0be2c8e366 tempest-CreateVolumesFromImageTest-1117605042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-1ebc55a6-3518-45e8-a507-34be63a75052 1073741824" returned: 0 in 0.824s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:31:32 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-25f06b33-7b54-4469-b037-db0be2c8e366 tempest-CreateVolumesFromImageTest-1117605042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-1ebc55a6-3518-45e8-a507-34be63a75052 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:31:32 devstack sudo[100904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-1ebc55a6-3518-45e8-a507-34be63a75052 Sep 16 20:31:32 devstack sudo[100904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:31:33 devstack sudo[100904]: pam_unix(sudo:session): session closed for user root Sep 16 20:31:33 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-25f06b33-7b54-4469-b037-db0be2c8e366 tempest-CreateVolumesFromImageTest-1117605042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-1ebc55a6-3518-45e8-a507-34be63a75052" returned: 0 in 0.635s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:31:33 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-25f06b33-7b54-4469-b037-db0be2c8e366 tempest-CreateVolumesFromImageTest-1117605042 None] <== create_volume: return (1580ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:31:33 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-25f06b33-7b54-4469-b037-db0be2c8e366 tempest-CreateVolumesFromImageTest-1117605042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.600s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:31:33 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-be9257a7-b1f8-4bb8-8174-51ba7cc0d030 tempest-CreateVolumesFromImageTest-1117605042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.928s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:31:33 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-be9257a7-b1f8-4bb8-8174-51ba7cc0d030 tempest-CreateVolumesFromImageTest-1117605042 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:31:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-295295543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83d44727-43e2-486d-ac22-cb42410fbecf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c51d53435d24b15863ea610953c5bed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:31:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:31:31Z,use_quota=True,user_id='53c71851dbf943d085d967e99738995d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:31:33 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-be9257a7-b1f8-4bb8-8174-51ba7cc0d030 tempest-CreateVolumesFromImageTest-1117605042 None] Creating volume 83d44727-43e2-486d-ac22-cb42410fbecf {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:31:33 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-be9257a7-b1f8-4bb8-8174-51ba7cc0d030 tempest-CreateVolumesFromImageTest-1117605042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:31:33 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-be9257a7-b1f8-4bb8-8174-51ba7cc0d030 tempest-CreateVolumesFromImageTest-1117605042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:31:33 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-be9257a7-b1f8-4bb8-8174-51ba7cc0d030 tempest-CreateVolumesFromImageTest-1117605042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:31:33 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-be9257a7-b1f8-4bb8-8174-51ba7cc0d030 tempest-CreateVolumesFromImageTest-1117605042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:31:33 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-be9257a7-b1f8-4bb8-8174-51ba7cc0d030 tempest-CreateVolumesFromImageTest-1117605042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:31:33 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-be9257a7-b1f8-4bb8-8174-51ba7cc0d030 tempest-CreateVolumesFromImageTest-1117605042 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:31:33 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-be9257a7-b1f8-4bb8-8174-51ba7cc0d030 tempest-CreateVolumesFromImageTest-1117605042 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:31:33 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-be9257a7-b1f8-4bb8-8174-51ba7cc0d030 tempest-CreateVolumesFromImageTest-1117605042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-83d44727-43e2-486d-ac22-cb42410fbecf 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:31:33 devstack sudo[100907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-83d44727-43e2-486d-ac22-cb42410fbecf 1073741824 Sep 16 20:31:33 devstack sudo[100907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:31:33 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-25f06b33-7b54-4469-b037-db0be2c8e366 tempest-CreateVolumesFromImageTest-1117605042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d19ed649-2965-408e-ac5d-75675ed2dcab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ebc55a6-3518-45e8-a507-34be63a75052', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:31:33 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-25f06b33-7b54-4469-b037-db0be2c8e366 tempest-CreateVolumesFromImageTest-1117605042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8ff376e-ffa2-487a-81c8-60e50f453485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:31:33 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-25f06b33-7b54-4469-b037-db0be2c8e366 tempest-CreateVolumesFromImageTest-1117605042 None] Volume volume-1ebc55a6-3518-45e8-a507-34be63a75052 (1ebc55a6-3518-45e8-a507-34be63a75052): created successfully Sep 16 20:31:33 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-25f06b33-7b54-4469-b037-db0be2c8e366 tempest-CreateVolumesFromImageTest-1117605042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8ff376e-ffa2-487a-81c8-60e50f453485) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:31:33 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-25f06b33-7b54-4469-b037-db0be2c8e366 tempest-CreateVolumesFromImageTest-1117605042 None] Flow 'volume_create_manager' (5c209eb1-311b-4b91-b360-c9c5f6a9d1c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:31:33 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-25f06b33-7b54-4469-b037-db0be2c8e366 tempest-CreateVolumesFromImageTest-1117605042 None] Created volume successfully. Sep 16 20:31:33 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b8e7237-f302-4b2d-9dba-7e14fd10ccf9 tempest-TestServerVolumeAttachmentScenario-117009106 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:31:34 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-8b8e7237-f302-4b2d-9dba-7e14fd10ccf9 tempest-TestServerVolumeAttachmentScenario-117009106 None] Flow 'volume_create_manager' (891145c5-20c5-4fd5-ab33-0d44fd3adcb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:31:34 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-8b8e7237-f302-4b2d-9dba-7e14fd10ccf9 tempest-TestServerVolumeAttachmentScenario-117009106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (792b1ba8-26b2-4ee4-8f00-9fda35d8377a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:31:34 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-8b8e7237-f302-4b2d-9dba-7e14fd10ccf9 tempest-TestServerVolumeAttachmentScenario-117009106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (792b1ba8-26b2-4ee4-8f00-9fda35d8377a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:31:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-975965800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f319e490-f6ba-4041-9455-844f5fc1c54e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c780d5624ab14923a763fffb7a13abcf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:31:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:31:34Z,use_quota=True,user_id='07abeef7d861465c8a7a4990d36addbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:31:34 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-8b8e7237-f302-4b2d-9dba-7e14fd10ccf9 tempest-TestServerVolumeAttachmentScenario-117009106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d12aa4a3-7c15-4abd-9a04-75ade1b535fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:31:34 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-8b8e7237-f302-4b2d-9dba-7e14fd10ccf9 tempest-TestServerVolumeAttachmentScenario-117009106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d12aa4a3-7c15-4abd-9a04-75ade1b535fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:31:34 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-8b8e7237-f302-4b2d-9dba-7e14fd10ccf9 tempest-TestServerVolumeAttachmentScenario-117009106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcf8cabe-9ce2-4bba-8d5a-cf8a1c6aa353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:31:34 devstack sudo[100907]: pam_unix(sudo:session): session closed for user root Sep 16 20:31:34 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-8b8e7237-f302-4b2d-9dba-7e14fd10ccf9 tempest-TestServerVolumeAttachmentScenario-117009106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcf8cabe-9ce2-4bba-8d5a-cf8a1c6aa353) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f319e490-f6ba-4041-9455-844f5fc1c54e', 'volume_name': 'volume-f319e490-f6ba-4041-9455-844f5fc1c54e', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:31:34 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-8b8e7237-f302-4b2d-9dba-7e14fd10ccf9 tempest-TestServerVolumeAttachmentScenario-117009106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96833297-6804-4e74-9751-fd5aead68e3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:31:34 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-8b8e7237-f302-4b2d-9dba-7e14fd10ccf9 tempest-TestServerVolumeAttachmentScenario-117009106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96833297-6804-4e74-9751-fd5aead68e3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:31:34 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-8b8e7237-f302-4b2d-9dba-7e14fd10ccf9 tempest-TestServerVolumeAttachmentScenario-117009106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c0e8494-59df-468a-a676-28dc40439c42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:31:34 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-8b8e7237-f302-4b2d-9dba-7e14fd10ccf9 tempest-TestServerVolumeAttachmentScenario-117009106 None] Volume f319e490-f6ba-4041-9455-844f5fc1c54e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f319e490-f6ba-4041-9455-844f5fc1c54e', 'volume_size': 1} Sep 16 20:31:34 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-8b8e7237-f302-4b2d-9dba-7e14fd10ccf9 tempest-TestServerVolumeAttachmentScenario-117009106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:31:34 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-be9257a7-b1f8-4bb8-8174-51ba7cc0d030 tempest-CreateVolumesFromImageTest-1117605042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-83d44727-43e2-486d-ac22-cb42410fbecf 1073741824" returned: 0 in 1.184s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:31:34 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-5274285e-a8e9-4743-9d76-3fc6025439c3 tempest-CreateVolumesFromImageTest-1117605042 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:31:34 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-5274285e-a8e9-4743-9d76-3fc6025439c3 tempest-CreateVolumesFromImageTest-1117605042 None] Flow 'volume_create_manager' (7c1caf3f-c516-49d3-b946-21ac216c5baa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:31:34 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-5274285e-a8e9-4743-9d76-3fc6025439c3 tempest-CreateVolumesFromImageTest-1117605042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86f7a592-b648-4f0c-ae7e-facef8aa159a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:31:34 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-5274285e-a8e9-4743-9d76-3fc6025439c3 tempest-CreateVolumesFromImageTest-1117605042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86f7a592-b648-4f0c-ae7e-facef8aa159a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:31:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1531653408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27aa3d83-e016-45d3-893f-7db933d4883e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c51d53435d24b15863ea610953c5bed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:31:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:31:34Z,use_quota=True,user_id='53c71851dbf943d085d967e99738995d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:31:34 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-5274285e-a8e9-4743-9d76-3fc6025439c3 tempest-CreateVolumesFromImageTest-1117605042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19f710ab-004c-4a51-be58-d2337523b6ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:31:34 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-5274285e-a8e9-4743-9d76-3fc6025439c3 tempest-CreateVolumesFromImageTest-1117605042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19f710ab-004c-4a51-be58-d2337523b6ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:31:34 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-5274285e-a8e9-4743-9d76-3fc6025439c3 tempest-CreateVolumesFromImageTest-1117605042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a837e6a-f894-4ff3-8b5f-82ba9e24848c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:31:34 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-5274285e-a8e9-4743-9d76-3fc6025439c3 tempest-CreateVolumesFromImageTest-1117605042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a837e6a-f894-4ff3-8b5f-82ba9e24848c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27aa3d83-e016-45d3-893f-7db933d4883e', 'volume_name': 'volume-27aa3d83-e016-45d3-893f-7db933d4883e', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:31:34 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-5274285e-a8e9-4743-9d76-3fc6025439c3 tempest-CreateVolumesFromImageTest-1117605042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9124fed2-c5c3-435b-a6a1-bc7e441f4d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:31:34 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-5274285e-a8e9-4743-9d76-3fc6025439c3 tempest-CreateVolumesFromImageTest-1117605042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9124fed2-c5c3-435b-a6a1-bc7e441f4d73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:31:34 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-5274285e-a8e9-4743-9d76-3fc6025439c3 tempest-CreateVolumesFromImageTest-1117605042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2527971-c3df-4e93-87cd-2240f0effdb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:31:34 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-5274285e-a8e9-4743-9d76-3fc6025439c3 tempest-CreateVolumesFromImageTest-1117605042 None] Volume 27aa3d83-e016-45d3-893f-7db933d4883e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27aa3d83-e016-45d3-893f-7db933d4883e', 'volume_size': 1} Sep 16 20:31:34 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-5274285e-a8e9-4743-9d76-3fc6025439c3 tempest-CreateVolumesFromImageTest-1117605042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:31:34 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-be9257a7-b1f8-4bb8-8174-51ba7cc0d030 tempest-CreateVolumesFromImageTest-1117605042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-83d44727-43e2-486d-ac22-cb42410fbecf {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:31:34 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4070ffb-12b7-463d-b64e-41da0f603fe3 tempest-TestServerVolumeAttachmentScenario-117009106 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:31:34 devstack sudo[100919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-83d44727-43e2-486d-ac22-cb42410fbecf Sep 16 20:31:34 devstack sudo[100919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:31:34 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f4070ffb-12b7-463d-b64e-41da0f603fe3 tempest-TestServerVolumeAttachmentScenario-117009106 None] Flow 'volume_create_manager' (e0f15a7e-6d74-478f-92c8-bdb38d8dac7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:31:34 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f4070ffb-12b7-463d-b64e-41da0f603fe3 tempest-TestServerVolumeAttachmentScenario-117009106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d4ebf07-f65c-4a7b-8c64-d68f45508f05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:31:34 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f4070ffb-12b7-463d-b64e-41da0f603fe3 tempest-TestServerVolumeAttachmentScenario-117009106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d4ebf07-f65c-4a7b-8c64-d68f45508f05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:31:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1133355652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=930e07b9-1719-4098-b8fd-6023842fd7ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c780d5624ab14923a763fffb7a13abcf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:31:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:31:34Z,use_quota=True,user_id='07abeef7d861465c8a7a4990d36addbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:31:34 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f4070ffb-12b7-463d-b64e-41da0f603fe3 tempest-TestServerVolumeAttachmentScenario-117009106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b017347-3f9b-42ad-83ce-0405cc0f31e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:31:34 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f4070ffb-12b7-463d-b64e-41da0f603fe3 tempest-TestServerVolumeAttachmentScenario-117009106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b017347-3f9b-42ad-83ce-0405cc0f31e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:31:34 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f4070ffb-12b7-463d-b64e-41da0f603fe3 tempest-TestServerVolumeAttachmentScenario-117009106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e2ae961-6e4e-4957-b5bd-e7af4e27ba3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:31:34 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f4070ffb-12b7-463d-b64e-41da0f603fe3 tempest-TestServerVolumeAttachmentScenario-117009106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e2ae961-6e4e-4957-b5bd-e7af4e27ba3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '930e07b9-1719-4098-b8fd-6023842fd7ab', 'volume_name': 'volume-930e07b9-1719-4098-b8fd-6023842fd7ab', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:31:34 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f4070ffb-12b7-463d-b64e-41da0f603fe3 tempest-TestServerVolumeAttachmentScenario-117009106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad19527f-96db-4ad3-b12e-d97b2abd9fb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:31:34 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f4070ffb-12b7-463d-b64e-41da0f603fe3 tempest-TestServerVolumeAttachmentScenario-117009106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad19527f-96db-4ad3-b12e-d97b2abd9fb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:31:34 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f4070ffb-12b7-463d-b64e-41da0f603fe3 tempest-TestServerVolumeAttachmentScenario-117009106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4b66c5a-f7ae-483d-9960-ee0fbe04e939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:31:34 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-f4070ffb-12b7-463d-b64e-41da0f603fe3 tempest-TestServerVolumeAttachmentScenario-117009106 None] Volume 930e07b9-1719-4098-b8fd-6023842fd7ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-930e07b9-1719-4098-b8fd-6023842fd7ab', 'volume_size': 1} Sep 16 20:31:34 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-f4070ffb-12b7-463d-b64e-41da0f603fe3 tempest-TestServerVolumeAttachmentScenario-117009106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:31:34 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf911e0a-2455-4a9a-9a32-3cb343d679b9 tempest-CreateVolumesFromImageTest-1117605042 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:31:34 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-cf911e0a-2455-4a9a-9a32-3cb343d679b9 tempest-CreateVolumesFromImageTest-1117605042 None] Flow 'volume_create_manager' (6f251eec-53a6-438a-ba03-f804bc18ad37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:31:34 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-cf911e0a-2455-4a9a-9a32-3cb343d679b9 tempest-CreateVolumesFromImageTest-1117605042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ea1f265-7d2d-4a31-bda2-642c005115fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:31:35 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-cf911e0a-2455-4a9a-9a32-3cb343d679b9 tempest-CreateVolumesFromImageTest-1117605042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ea1f265-7d2d-4a31-bda2-642c005115fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:31:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1481226136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfffb36b-1a80-4c4b-b881-c926b34e4193,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c51d53435d24b15863ea610953c5bed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:31:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:31:34Z,use_quota=True,user_id='53c71851dbf943d085d967e99738995d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:31:35 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-cf911e0a-2455-4a9a-9a32-3cb343d679b9 tempest-CreateVolumesFromImageTest-1117605042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67600999-d14e-47cc-b89e-3c67b32cd686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:31:35 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-cf911e0a-2455-4a9a-9a32-3cb343d679b9 tempest-CreateVolumesFromImageTest-1117605042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67600999-d14e-47cc-b89e-3c67b32cd686) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:31:35 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-cf911e0a-2455-4a9a-9a32-3cb343d679b9 tempest-CreateVolumesFromImageTest-1117605042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4953289-ea85-4a57-bd36-4506b07c20e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:31:35 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-cf911e0a-2455-4a9a-9a32-3cb343d679b9 tempest-CreateVolumesFromImageTest-1117605042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4953289-ea85-4a57-bd36-4506b07c20e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cfffb36b-1a80-4c4b-b881-c926b34e4193', 'volume_name': 'volume-cfffb36b-1a80-4c4b-b881-c926b34e4193', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:31:35 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-cf911e0a-2455-4a9a-9a32-3cb343d679b9 tempest-CreateVolumesFromImageTest-1117605042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11470546-9d2d-4e43-990e-17edb6697848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:31:35 devstack sudo[100919]: pam_unix(sudo:session): session closed for user root Sep 16 20:31:35 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-cf911e0a-2455-4a9a-9a32-3cb343d679b9 tempest-CreateVolumesFromImageTest-1117605042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11470546-9d2d-4e43-990e-17edb6697848) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:31:35 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-cf911e0a-2455-4a9a-9a32-3cb343d679b9 tempest-CreateVolumesFromImageTest-1117605042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b2f1d7e-9e80-4802-94d5-c833945bba59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:31:35 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-cf911e0a-2455-4a9a-9a32-3cb343d679b9 tempest-CreateVolumesFromImageTest-1117605042 None] Volume cfffb36b-1a80-4c4b-b881-c926b34e4193: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cfffb36b-1a80-4c4b-b881-c926b34e4193', 'volume_size': 1} Sep 16 20:31:35 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-cf911e0a-2455-4a9a-9a32-3cb343d679b9 tempest-CreateVolumesFromImageTest-1117605042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:31:35 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-be9257a7-b1f8-4bb8-8174-51ba7cc0d030 tempest-CreateVolumesFromImageTest-1117605042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-83d44727-43e2-486d-ac22-cb42410fbecf" returned: 0 in 0.452s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:31:35 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-be9257a7-b1f8-4bb8-8174-51ba7cc0d030 tempest-CreateVolumesFromImageTest-1117605042 None] <== create_volume: return (2043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:31:35 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-be9257a7-b1f8-4bb8-8174-51ba7cc0d030 tempest-CreateVolumesFromImageTest-1117605042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.051s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:31:35 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-8b8e7237-f302-4b2d-9dba-7e14fd10ccf9 tempest-TestServerVolumeAttachmentScenario-117009106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.847s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:31:35 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-8b8e7237-f302-4b2d-9dba-7e14fd10ccf9 tempest-TestServerVolumeAttachmentScenario-117009106 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:31:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-975965800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f319e490-f6ba-4041-9455-844f5fc1c54e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c780d5624ab14923a763fffb7a13abcf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:31:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:31:34Z,use_quota=True,user_id='07abeef7d861465c8a7a4990d36addbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:31:35 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-8b8e7237-f302-4b2d-9dba-7e14fd10ccf9 tempest-TestServerVolumeAttachmentScenario-117009106 None] Creating volume f319e490-f6ba-4041-9455-844f5fc1c54e {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:31:35 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-8b8e7237-f302-4b2d-9dba-7e14fd10ccf9 tempest-TestServerVolumeAttachmentScenario-117009106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:31:35 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-8b8e7237-f302-4b2d-9dba-7e14fd10ccf9 tempest-TestServerVolumeAttachmentScenario-117009106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:31:35 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-8b8e7237-f302-4b2d-9dba-7e14fd10ccf9 tempest-TestServerVolumeAttachmentScenario-117009106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:31:35 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-8b8e7237-f302-4b2d-9dba-7e14fd10ccf9 tempest-TestServerVolumeAttachmentScenario-117009106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:31:35 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-8b8e7237-f302-4b2d-9dba-7e14fd10ccf9 tempest-TestServerVolumeAttachmentScenario-117009106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:31:35 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-8b8e7237-f302-4b2d-9dba-7e14fd10ccf9 tempest-TestServerVolumeAttachmentScenario-117009106 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:31:35 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-8b8e7237-f302-4b2d-9dba-7e14fd10ccf9 tempest-TestServerVolumeAttachmentScenario-117009106 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:31:35 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-8b8e7237-f302-4b2d-9dba-7e14fd10ccf9 tempest-TestServerVolumeAttachmentScenario-117009106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-f319e490-f6ba-4041-9455-844f5fc1c54e 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:31:35 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-be9257a7-b1f8-4bb8-8174-51ba7cc0d030 tempest-CreateVolumesFromImageTest-1117605042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (071e2397-9f82-466a-8678-79f58be0fe8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83d44727-43e2-486d-ac22-cb42410fbecf', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:31:35 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-be9257a7-b1f8-4bb8-8174-51ba7cc0d030 tempest-CreateVolumesFromImageTest-1117605042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50530a86-2498-49cd-beae-0c2003e1100e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:31:35 devstack sudo[100923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-f319e490-f6ba-4041-9455-844f5fc1c54e 1073741824 Sep 16 20:31:35 devstack sudo[100923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:31:35 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-be9257a7-b1f8-4bb8-8174-51ba7cc0d030 tempest-CreateVolumesFromImageTest-1117605042 None] Volume volume-83d44727-43e2-486d-ac22-cb42410fbecf (83d44727-43e2-486d-ac22-cb42410fbecf): created successfully Sep 16 20:31:35 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-be9257a7-b1f8-4bb8-8174-51ba7cc0d030 tempest-CreateVolumesFromImageTest-1117605042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50530a86-2498-49cd-beae-0c2003e1100e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:31:35 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-be9257a7-b1f8-4bb8-8174-51ba7cc0d030 tempest-CreateVolumesFromImageTest-1117605042 None] Flow 'volume_create_manager' (f7dec5a8-a2cd-41b8-95e2-224081c9e273) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:31:35 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-be9257a7-b1f8-4bb8-8174-51ba7cc0d030 tempest-CreateVolumesFromImageTest-1117605042 None] Created volume successfully. Sep 16 20:31:35 devstack sudo[100923]: pam_unix(sudo:session): session closed for user root Sep 16 20:31:35 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-8b8e7237-f302-4b2d-9dba-7e14fd10ccf9 tempest-TestServerVolumeAttachmentScenario-117009106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-f319e490-f6ba-4041-9455-844f5fc1c54e 1073741824" returned: 0 in 0.596s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:31:35 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-8b8e7237-f302-4b2d-9dba-7e14fd10ccf9 tempest-TestServerVolumeAttachmentScenario-117009106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-f319e490-f6ba-4041-9455-844f5fc1c54e {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:31:35 devstack sudo[100929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-f319e490-f6ba-4041-9455-844f5fc1c54e Sep 16 20:31:35 devstack sudo[100929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:31:36 devstack sudo[100929]: pam_unix(sudo:session): session closed for user root Sep 16 20:31:36 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-8b8e7237-f302-4b2d-9dba-7e14fd10ccf9 tempest-TestServerVolumeAttachmentScenario-117009106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-f319e490-f6ba-4041-9455-844f5fc1c54e" returned: 0 in 0.264s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:31:36 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-8b8e7237-f302-4b2d-9dba-7e14fd10ccf9 tempest-TestServerVolumeAttachmentScenario-117009106 None] <== create_volume: return (916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:31:36 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-8b8e7237-f302-4b2d-9dba-7e14fd10ccf9 tempest-TestServerVolumeAttachmentScenario-117009106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:31:36 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-5274285e-a8e9-4743-9d76-3fc6025439c3 tempest-CreateVolumesFromImageTest-1117605042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.424s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:31:36 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-5274285e-a8e9-4743-9d76-3fc6025439c3 tempest-CreateVolumesFromImageTest-1117605042 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:31:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1531653408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27aa3d83-e016-45d3-893f-7db933d4883e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c51d53435d24b15863ea610953c5bed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:31:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:31:34Z,use_quota=True,user_id='53c71851dbf943d085d967e99738995d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:31:36 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-5274285e-a8e9-4743-9d76-3fc6025439c3 tempest-CreateVolumesFromImageTest-1117605042 None] Creating volume 27aa3d83-e016-45d3-893f-7db933d4883e {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:31:36 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-5274285e-a8e9-4743-9d76-3fc6025439c3 tempest-CreateVolumesFromImageTest-1117605042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:31:36 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-5274285e-a8e9-4743-9d76-3fc6025439c3 tempest-CreateVolumesFromImageTest-1117605042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:31:36 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-5274285e-a8e9-4743-9d76-3fc6025439c3 tempest-CreateVolumesFromImageTest-1117605042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:31:36 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-5274285e-a8e9-4743-9d76-3fc6025439c3 tempest-CreateVolumesFromImageTest-1117605042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:31:36 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-5274285e-a8e9-4743-9d76-3fc6025439c3 tempest-CreateVolumesFromImageTest-1117605042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:31:36 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-5274285e-a8e9-4743-9d76-3fc6025439c3 tempest-CreateVolumesFromImageTest-1117605042 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:31:36 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-5274285e-a8e9-4743-9d76-3fc6025439c3 tempest-CreateVolumesFromImageTest-1117605042 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:31:36 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-5274285e-a8e9-4743-9d76-3fc6025439c3 tempest-CreateVolumesFromImageTest-1117605042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-27aa3d83-e016-45d3-893f-7db933d4883e 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:31:36 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-8b8e7237-f302-4b2d-9dba-7e14fd10ccf9 tempest-TestServerVolumeAttachmentScenario-117009106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c0e8494-59df-468a-a676-28dc40439c42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f319e490-f6ba-4041-9455-844f5fc1c54e', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:31:36 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-8b8e7237-f302-4b2d-9dba-7e14fd10ccf9 tempest-TestServerVolumeAttachmentScenario-117009106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52dfd844-331c-410c-b580-82f6761e9e1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:31:36 devstack sudo[100932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-27aa3d83-e016-45d3-893f-7db933d4883e 1073741824 Sep 16 20:31:36 devstack sudo[100932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:31:36 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-8b8e7237-f302-4b2d-9dba-7e14fd10ccf9 tempest-TestServerVolumeAttachmentScenario-117009106 None] Volume volume-f319e490-f6ba-4041-9455-844f5fc1c54e (f319e490-f6ba-4041-9455-844f5fc1c54e): created successfully Sep 16 20:31:36 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-8b8e7237-f302-4b2d-9dba-7e14fd10ccf9 tempest-TestServerVolumeAttachmentScenario-117009106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52dfd844-331c-410c-b580-82f6761e9e1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:31:36 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-8b8e7237-f302-4b2d-9dba-7e14fd10ccf9 tempest-TestServerVolumeAttachmentScenario-117009106 None] Flow 'volume_create_manager' (891145c5-20c5-4fd5-ab33-0d44fd3adcb1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:31:36 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-8b8e7237-f302-4b2d-9dba-7e14fd10ccf9 tempest-TestServerVolumeAttachmentScenario-117009106 None] Created volume successfully. Sep 16 20:31:36 devstack sudo[100932]: pam_unix(sudo:session): session closed for user root Sep 16 20:31:36 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-5274285e-a8e9-4743-9d76-3fc6025439c3 tempest-CreateVolumesFromImageTest-1117605042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-27aa3d83-e016-45d3-893f-7db933d4883e 1073741824" returned: 0 in 0.516s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:31:36 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-5274285e-a8e9-4743-9d76-3fc6025439c3 tempest-CreateVolumesFromImageTest-1117605042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-27aa3d83-e016-45d3-893f-7db933d4883e {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:31:36 devstack sudo[100938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-27aa3d83-e016-45d3-893f-7db933d4883e Sep 16 20:31:36 devstack sudo[100938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:31:36 devstack sudo[100938]: pam_unix(sudo:session): session closed for user root Sep 16 20:31:36 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-5274285e-a8e9-4743-9d76-3fc6025439c3 tempest-CreateVolumesFromImageTest-1117605042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-27aa3d83-e016-45d3-893f-7db933d4883e" returned: 0 in 0.262s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:31:36 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-5274285e-a8e9-4743-9d76-3fc6025439c3 tempest-CreateVolumesFromImageTest-1117605042 None] <== create_volume: return (833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:31:36 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-5274285e-a8e9-4743-9d76-3fc6025439c3 tempest-CreateVolumesFromImageTest-1117605042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.838s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:31:36 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-f4070ffb-12b7-463d-b64e-41da0f603fe3 tempest-TestServerVolumeAttachmentScenario-117009106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.013s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:31:36 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-f4070ffb-12b7-463d-b64e-41da0f603fe3 tempest-TestServerVolumeAttachmentScenario-117009106 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:31:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1133355652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=930e07b9-1719-4098-b8fd-6023842fd7ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c780d5624ab14923a763fffb7a13abcf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:31:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:31:34Z,use_quota=True,user_id='07abeef7d861465c8a7a4990d36addbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:31:36 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-f4070ffb-12b7-463d-b64e-41da0f603fe3 tempest-TestServerVolumeAttachmentScenario-117009106 None] Creating volume 930e07b9-1719-4098-b8fd-6023842fd7ab {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:31:36 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-f4070ffb-12b7-463d-b64e-41da0f603fe3 tempest-TestServerVolumeAttachmentScenario-117009106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:31:36 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-f4070ffb-12b7-463d-b64e-41da0f603fe3 tempest-TestServerVolumeAttachmentScenario-117009106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:31:36 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-f4070ffb-12b7-463d-b64e-41da0f603fe3 tempest-TestServerVolumeAttachmentScenario-117009106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:31:36 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-f4070ffb-12b7-463d-b64e-41da0f603fe3 tempest-TestServerVolumeAttachmentScenario-117009106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:31:36 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-f4070ffb-12b7-463d-b64e-41da0f603fe3 tempest-TestServerVolumeAttachmentScenario-117009106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:31:36 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-f4070ffb-12b7-463d-b64e-41da0f603fe3 tempest-TestServerVolumeAttachmentScenario-117009106 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:31:36 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-f4070ffb-12b7-463d-b64e-41da0f603fe3 tempest-TestServerVolumeAttachmentScenario-117009106 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:31:36 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f4070ffb-12b7-463d-b64e-41da0f603fe3 tempest-TestServerVolumeAttachmentScenario-117009106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-930e07b9-1719-4098-b8fd-6023842fd7ab 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:31:36 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-5274285e-a8e9-4743-9d76-3fc6025439c3 tempest-CreateVolumesFromImageTest-1117605042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2527971-c3df-4e93-87cd-2240f0effdb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27aa3d83-e016-45d3-893f-7db933d4883e', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:31:36 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-5274285e-a8e9-4743-9d76-3fc6025439c3 tempest-CreateVolumesFromImageTest-1117605042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89e0fdca-442e-44f9-b47d-79196239d494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:31:36 devstack sudo[100941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-930e07b9-1719-4098-b8fd-6023842fd7ab 1073741824 Sep 16 20:31:36 devstack sudo[100941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:31:36 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-5274285e-a8e9-4743-9d76-3fc6025439c3 tempest-CreateVolumesFromImageTest-1117605042 None] Volume volume-27aa3d83-e016-45d3-893f-7db933d4883e (27aa3d83-e016-45d3-893f-7db933d4883e): created successfully Sep 16 20:31:36 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-5274285e-a8e9-4743-9d76-3fc6025439c3 tempest-CreateVolumesFromImageTest-1117605042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89e0fdca-442e-44f9-b47d-79196239d494) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:31:36 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-5274285e-a8e9-4743-9d76-3fc6025439c3 tempest-CreateVolumesFromImageTest-1117605042 None] Flow 'volume_create_manager' (7c1caf3f-c516-49d3-b946-21ac216c5baa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:31:36 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-5274285e-a8e9-4743-9d76-3fc6025439c3 tempest-CreateVolumesFromImageTest-1117605042 None] Created volume successfully. Sep 16 20:31:37 devstack sudo[100941]: pam_unix(sudo:session): session closed for user root Sep 16 20:31:37 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f4070ffb-12b7-463d-b64e-41da0f603fe3 tempest-TestServerVolumeAttachmentScenario-117009106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-930e07b9-1719-4098-b8fd-6023842fd7ab 1073741824" returned: 0 in 0.488s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:31:37 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f4070ffb-12b7-463d-b64e-41da0f603fe3 tempest-TestServerVolumeAttachmentScenario-117009106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-930e07b9-1719-4098-b8fd-6023842fd7ab {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:31:37 devstack sudo[100947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-930e07b9-1719-4098-b8fd-6023842fd7ab Sep 16 20:31:37 devstack sudo[100947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:31:37 devstack sudo[100947]: pam_unix(sudo:session): session closed for user root Sep 16 20:31:37 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f4070ffb-12b7-463d-b64e-41da0f603fe3 tempest-TestServerVolumeAttachmentScenario-117009106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-930e07b9-1719-4098-b8fd-6023842fd7ab" returned: 0 in 0.341s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:31:37 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-f4070ffb-12b7-463d-b64e-41da0f603fe3 tempest-TestServerVolumeAttachmentScenario-117009106 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:31:37 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-f4070ffb-12b7-463d-b64e-41da0f603fe3 tempest-TestServerVolumeAttachmentScenario-117009106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.874s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:31:37 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-cf911e0a-2455-4a9a-9a32-3cb343d679b9 tempest-CreateVolumesFromImageTest-1117605042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.660s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:31:37 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-cf911e0a-2455-4a9a-9a32-3cb343d679b9 tempest-CreateVolumesFromImageTest-1117605042 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:31:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1481226136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfffb36b-1a80-4c4b-b881-c926b34e4193,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c51d53435d24b15863ea610953c5bed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:31:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:31:34Z,use_quota=True,user_id='53c71851dbf943d085d967e99738995d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:31:37 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-cf911e0a-2455-4a9a-9a32-3cb343d679b9 tempest-CreateVolumesFromImageTest-1117605042 None] Creating volume cfffb36b-1a80-4c4b-b881-c926b34e4193 {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:31:37 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-cf911e0a-2455-4a9a-9a32-3cb343d679b9 tempest-CreateVolumesFromImageTest-1117605042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:31:37 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-cf911e0a-2455-4a9a-9a32-3cb343d679b9 tempest-CreateVolumesFromImageTest-1117605042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:31:37 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-cf911e0a-2455-4a9a-9a32-3cb343d679b9 tempest-CreateVolumesFromImageTest-1117605042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:31:37 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-cf911e0a-2455-4a9a-9a32-3cb343d679b9 tempest-CreateVolumesFromImageTest-1117605042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:31:37 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-cf911e0a-2455-4a9a-9a32-3cb343d679b9 tempest-CreateVolumesFromImageTest-1117605042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:31:37 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-cf911e0a-2455-4a9a-9a32-3cb343d679b9 tempest-CreateVolumesFromImageTest-1117605042 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:31:37 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-cf911e0a-2455-4a9a-9a32-3cb343d679b9 tempest-CreateVolumesFromImageTest-1117605042 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:31:37 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-cf911e0a-2455-4a9a-9a32-3cb343d679b9 tempest-CreateVolumesFromImageTest-1117605042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-cfffb36b-1a80-4c4b-b881-c926b34e4193 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:31:37 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f4070ffb-12b7-463d-b64e-41da0f603fe3 tempest-TestServerVolumeAttachmentScenario-117009106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4b66c5a-f7ae-483d-9960-ee0fbe04e939) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-930e07b9-1719-4098-b8fd-6023842fd7ab', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:31:37 devstack sudo[100953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-cfffb36b-1a80-4c4b-b881-c926b34e4193 1073741824 Sep 16 20:31:37 devstack sudo[100953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:31:37 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f4070ffb-12b7-463d-b64e-41da0f603fe3 tempest-TestServerVolumeAttachmentScenario-117009106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d129bd11-e144-4553-8e09-3b3117d7216b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:31:37 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-f4070ffb-12b7-463d-b64e-41da0f603fe3 tempest-TestServerVolumeAttachmentScenario-117009106 None] Volume volume-930e07b9-1719-4098-b8fd-6023842fd7ab (930e07b9-1719-4098-b8fd-6023842fd7ab): created successfully Sep 16 20:31:37 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f4070ffb-12b7-463d-b64e-41da0f603fe3 tempest-TestServerVolumeAttachmentScenario-117009106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d129bd11-e144-4553-8e09-3b3117d7216b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:31:37 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f4070ffb-12b7-463d-b64e-41da0f603fe3 tempest-TestServerVolumeAttachmentScenario-117009106 None] Flow 'volume_create_manager' (e0f15a7e-6d74-478f-92c8-bdb38d8dac7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:31:37 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-f4070ffb-12b7-463d-b64e-41da0f603fe3 tempest-TestServerVolumeAttachmentScenario-117009106 None] Created volume successfully. Sep 16 20:31:38 devstack sudo[100953]: pam_unix(sudo:session): session closed for user root Sep 16 20:31:38 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-cf911e0a-2455-4a9a-9a32-3cb343d679b9 tempest-CreateVolumesFromImageTest-1117605042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-cfffb36b-1a80-4c4b-b881-c926b34e4193 1073741824" returned: 0 in 0.528s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:31:38 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-cf911e0a-2455-4a9a-9a32-3cb343d679b9 tempest-CreateVolumesFromImageTest-1117605042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-cfffb36b-1a80-4c4b-b881-c926b34e4193 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:31:38 devstack sudo[100959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-cfffb36b-1a80-4c4b-b881-c926b34e4193 Sep 16 20:31:38 devstack sudo[100959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:31:38 devstack sudo[100959]: pam_unix(sudo:session): session closed for user root Sep 16 20:31:38 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-cf911e0a-2455-4a9a-9a32-3cb343d679b9 tempest-CreateVolumesFromImageTest-1117605042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-cfffb36b-1a80-4c4b-b881-c926b34e4193" returned: 0 in 0.284s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:31:38 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-cf911e0a-2455-4a9a-9a32-3cb343d679b9 tempest-CreateVolumesFromImageTest-1117605042 None] <== create_volume: return (860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:31:38 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-cf911e0a-2455-4a9a-9a32-3cb343d679b9 tempest-CreateVolumesFromImageTest-1117605042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.864s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:31:38 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-cf911e0a-2455-4a9a-9a32-3cb343d679b9 tempest-CreateVolumesFromImageTest-1117605042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b2f1d7e-9e80-4802-94d5-c833945bba59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfffb36b-1a80-4c4b-b881-c926b34e4193', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:31:38 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-cf911e0a-2455-4a9a-9a32-3cb343d679b9 tempest-CreateVolumesFromImageTest-1117605042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f873dd9-dae0-4d6a-a169-8f4068a92245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:31:38 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-cf911e0a-2455-4a9a-9a32-3cb343d679b9 tempest-CreateVolumesFromImageTest-1117605042 None] Volume volume-cfffb36b-1a80-4c4b-b881-c926b34e4193 (cfffb36b-1a80-4c4b-b881-c926b34e4193): created successfully Sep 16 20:31:38 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-cf911e0a-2455-4a9a-9a32-3cb343d679b9 tempest-CreateVolumesFromImageTest-1117605042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f873dd9-dae0-4d6a-a169-8f4068a92245) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:31:38 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-cf911e0a-2455-4a9a-9a32-3cb343d679b9 tempest-CreateVolumesFromImageTest-1117605042 None] Flow 'volume_create_manager' (6f251eec-53a6-438a-ba03-f804bc18ad37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:31:38 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-cf911e0a-2455-4a9a-9a32-3cb343d679b9 tempest-CreateVolumesFromImageTest-1117605042 None] Created volume successfully. Sep 16 20:31:38 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-1bdff7a7-2bfc-4f1a-a14e-3f304de25dc0 tempest-CreateVolumesFromImageTest-1117605042 None] Acquiring lock "cinder-cfffb36b-1a80-4c4b-b881-c926b34e4193-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:31:38 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-1bdff7a7-2bfc-4f1a-a14e-3f304de25dc0 tempest-CreateVolumesFromImageTest-1117605042 None] Lock "cinder-cfffb36b-1a80-4c4b-b881-c926b34e4193-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:31:38 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-1bdff7a7-2bfc-4f1a-a14e-3f304de25dc0 tempest-CreateVolumesFromImageTest-1117605042 None] Acquiring lock "cinder-quobyte-cfffb36b-1a80-4c4b-b881-c926b34e4193" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:31:38 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-1bdff7a7-2bfc-4f1a-a14e-3f304de25dc0 tempest-CreateVolumesFromImageTest-1117605042 None] Lock "cinder-quobyte-cfffb36b-1a80-4c4b-b881-c926b34e4193" acquired by "delete_volume" :: waited 0.035s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:31:39 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[72b23c61-5ab6-4941-8c09-74038e60ad5d]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:31:39 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-1bdff7a7-2bfc-4f1a-a14e-3f304de25dc0 tempest-CreateVolumesFromImageTest-1117605042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-cfffb36b-1a80-4c4b-b881-c926b34e4193 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:31:39 devstack sudo[100962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-cfffb36b-1a80-4c4b-b881-c926b34e4193 Sep 16 20:31:39 devstack sudo[100962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:31:39 devstack sudo[100962]: pam_unix(sudo:session): session closed for user root Sep 16 20:31:39 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-1bdff7a7-2bfc-4f1a-a14e-3f304de25dc0 tempest-CreateVolumesFromImageTest-1117605042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-cfffb36b-1a80-4c4b-b881-c926b34e4193" returned: 0 in 0.423s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:31:39 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-1bdff7a7-2bfc-4f1a-a14e-3f304de25dc0 tempest-CreateVolumesFromImageTest-1117605042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-cfffb36b-1a80-4c4b-b881-c926b34e4193 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:31:39 devstack sudo[100969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-cfffb36b-1a80-4c4b-b881-c926b34e4193 Sep 16 20:31:39 devstack sudo[100969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:31:39 devstack sudo[100969]: pam_unix(sudo:session): session closed for user root Sep 16 20:31:39 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-1bdff7a7-2bfc-4f1a-a14e-3f304de25dc0 tempest-CreateVolumesFromImageTest-1117605042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-cfffb36b-1a80-4c4b-b881-c926b34e4193" returned: 0 in 0.297s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:31:39 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-1bdff7a7-2bfc-4f1a-a14e-3f304de25dc0 tempest-CreateVolumesFromImageTest-1117605042 None] Lock "cinder-quobyte-cfffb36b-1a80-4c4b-b881-c926b34e4193" released by "delete_volume" :: held 0.796s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:31:39 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-1bdff7a7-2bfc-4f1a-a14e-3f304de25dc0 tempest-CreateVolumesFromImageTest-1117605042 None] Created reservations ['cad2365c-7e72-4a2e-a0cd-e2dce41385b1', '7b3c5a24-1cb3-49df-bdcb-d5cdc7d6121a', '4eb379a8-6822-48b3-9947-3d66fb1983d3', 'f2ba6b4b-46a4-4575-89bc-a03c610d41bc'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:31:39 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-1bdff7a7-2bfc-4f1a-a14e-3f304de25dc0 tempest-CreateVolumesFromImageTest-1117605042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:31:39 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-1bdff7a7-2bfc-4f1a-a14e-3f304de25dc0 tempest-CreateVolumesFromImageTest-1117605042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:31:39 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-1bdff7a7-2bfc-4f1a-a14e-3f304de25dc0 tempest-CreateVolumesFromImageTest-1117605042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:31:40 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-1bdff7a7-2bfc-4f1a-a14e-3f304de25dc0 tempest-CreateVolumesFromImageTest-1117605042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:31:40 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-1bdff7a7-2bfc-4f1a-a14e-3f304de25dc0 tempest-CreateVolumesFromImageTest-1117605042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.045s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:31:40 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-1bdff7a7-2bfc-4f1a-a14e-3f304de25dc0 tempest-CreateVolumesFromImageTest-1117605042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:31:40 devstack sudo[100981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:31:40 devstack sudo[100981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:31:40 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-a3197198-5e19-47f8-ab10-dd0fe7a99750 tempest-CreateVolumesFromImageTest-1117605042 None] Acquiring lock "cinder-27aa3d83-e016-45d3-893f-7db933d4883e-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:31:40 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-a3197198-5e19-47f8-ab10-dd0fe7a99750 tempest-CreateVolumesFromImageTest-1117605042 None] Lock "cinder-27aa3d83-e016-45d3-893f-7db933d4883e-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:31:40 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-a3197198-5e19-47f8-ab10-dd0fe7a99750 tempest-CreateVolumesFromImageTest-1117605042 None] Acquiring lock "cinder-quobyte-27aa3d83-e016-45d3-893f-7db933d4883e" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:31:40 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-a3197198-5e19-47f8-ab10-dd0fe7a99750 tempest-CreateVolumesFromImageTest-1117605042 None] Lock "cinder-quobyte-27aa3d83-e016-45d3-893f-7db933d4883e" acquired by "delete_volume" :: waited 0.032s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:31:40 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[9da4969d-85f7-4715-a242-168d84c1ea9e]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:31:40 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a3197198-5e19-47f8-ab10-dd0fe7a99750 tempest-CreateVolumesFromImageTest-1117605042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-27aa3d83-e016-45d3-893f-7db933d4883e {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:31:40 devstack sudo[100981]: pam_unix(sudo:session): session closed for user root Sep 16 20:31:40 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-1bdff7a7-2bfc-4f1a-a14e-3f304de25dc0 tempest-CreateVolumesFromImageTest-1117605042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.516s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:31:40 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-1bdff7a7-2bfc-4f1a-a14e-3f304de25dc0 tempest-CreateVolumesFromImageTest-1117605042 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:31:40 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-1bdff7a7-2bfc-4f1a-a14e-3f304de25dc0 tempest-CreateVolumesFromImageTest-1117605042 None] Deleted volume successfully. Sep 16 20:31:40 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-1bdff7a7-2bfc-4f1a-a14e-3f304de25dc0 tempest-CreateVolumesFromImageTest-1117605042 None] Lock "cinder-cfffb36b-1a80-4c4b-b881-c926b34e4193-delete_volume" released by "delete_volume" :: held 1.745s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:31:40 devstack sudo[100987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-27aa3d83-e016-45d3-893f-7db933d4883e Sep 16 20:31:40 devstack sudo[100987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:31:40 devstack sudo[100987]: pam_unix(sudo:session): session closed for user root Sep 16 20:31:40 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a3197198-5e19-47f8-ab10-dd0fe7a99750 tempest-CreateVolumesFromImageTest-1117605042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-27aa3d83-e016-45d3-893f-7db933d4883e" returned: 0 in 0.455s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:31:40 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a3197198-5e19-47f8-ab10-dd0fe7a99750 tempest-CreateVolumesFromImageTest-1117605042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-27aa3d83-e016-45d3-893f-7db933d4883e {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:31:41 devstack sudo[100996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-27aa3d83-e016-45d3-893f-7db933d4883e Sep 16 20:31:41 devstack sudo[100996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:31:41 devstack sudo[100996]: pam_unix(sudo:session): session closed for user root Sep 16 20:31:41 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a3197198-5e19-47f8-ab10-dd0fe7a99750 tempest-CreateVolumesFromImageTest-1117605042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-27aa3d83-e016-45d3-893f-7db933d4883e" returned: 0 in 0.273s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:31:41 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-a3197198-5e19-47f8-ab10-dd0fe7a99750 tempest-CreateVolumesFromImageTest-1117605042 None] Lock "cinder-quobyte-27aa3d83-e016-45d3-893f-7db933d4883e" released by "delete_volume" :: held 0.788s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:31:41 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-a3197198-5e19-47f8-ab10-dd0fe7a99750 tempest-CreateVolumesFromImageTest-1117605042 None] Created reservations ['28f1edc1-1231-48f1-828e-77f843924171', 'fdc39464-3cdf-4368-9100-65144ee3e595', '92ab016e-c428-4377-afd4-95245cec9b8b', 'ecfbe46f-9e52-4b8f-ac75-5ff005db2584'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:31:41 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a3197198-5e19-47f8-ab10-dd0fe7a99750 tempest-CreateVolumesFromImageTest-1117605042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:31:41 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a3197198-5e19-47f8-ab10-dd0fe7a99750 tempest-CreateVolumesFromImageTest-1117605042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:31:41 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-a3197198-5e19-47f8-ab10-dd0fe7a99750 tempest-CreateVolumesFromImageTest-1117605042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:31:41 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-a3197198-5e19-47f8-ab10-dd0fe7a99750 tempest-CreateVolumesFromImageTest-1117605042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:31:41 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a3197198-5e19-47f8-ab10-dd0fe7a99750 tempest-CreateVolumesFromImageTest-1117605042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:31:41 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a3197198-5e19-47f8-ab10-dd0fe7a99750 tempest-CreateVolumesFromImageTest-1117605042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:31:41 devstack sudo[100999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:31:41 devstack sudo[100999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:31:41 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-5ec6575c-574f-49b5-950f-d8d0f4a3b4a8 tempest-CreateVolumesFromImageTest-1117605042 None] Acquiring lock "cinder-83d44727-43e2-486d-ac22-cb42410fbecf-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:31:41 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-5ec6575c-574f-49b5-950f-d8d0f4a3b4a8 tempest-CreateVolumesFromImageTest-1117605042 None] Lock "cinder-83d44727-43e2-486d-ac22-cb42410fbecf-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:31:41 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-5ec6575c-574f-49b5-950f-d8d0f4a3b4a8 tempest-CreateVolumesFromImageTest-1117605042 None] Acquiring lock "cinder-quobyte-83d44727-43e2-486d-ac22-cb42410fbecf" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:31:41 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-5ec6575c-574f-49b5-950f-d8d0f4a3b4a8 tempest-CreateVolumesFromImageTest-1117605042 None] Lock "cinder-quobyte-83d44727-43e2-486d-ac22-cb42410fbecf" acquired by "delete_volume" :: waited 0.032s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:31:41 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0ca7d0c-502f-4050-926e-66ed4eadfb06]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:31:41 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-5ec6575c-574f-49b5-950f-d8d0f4a3b4a8 tempest-CreateVolumesFromImageTest-1117605042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-83d44727-43e2-486d-ac22-cb42410fbecf {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:31:41 devstack sudo[100999]: pam_unix(sudo:session): session closed for user root Sep 16 20:31:41 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a3197198-5e19-47f8-ab10-dd0fe7a99750 tempest-CreateVolumesFromImageTest-1117605042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.494s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:31:41 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-a3197198-5e19-47f8-ab10-dd0fe7a99750 tempest-CreateVolumesFromImageTest-1117605042 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:31:41 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-a3197198-5e19-47f8-ab10-dd0fe7a99750 tempest-CreateVolumesFromImageTest-1117605042 None] Deleted volume successfully. Sep 16 20:31:41 devstack sudo[101001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-83d44727-43e2-486d-ac22-cb42410fbecf Sep 16 20:31:41 devstack sudo[101001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:31:41 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-a3197198-5e19-47f8-ab10-dd0fe7a99750 tempest-CreateVolumesFromImageTest-1117605042 None] Lock "cinder-27aa3d83-e016-45d3-893f-7db933d4883e-delete_volume" released by "delete_volume" :: held 1.626s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:31:42 devstack sudo[101001]: pam_unix(sudo:session): session closed for user root Sep 16 20:31:42 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-5ec6575c-574f-49b5-950f-d8d0f4a3b4a8 tempest-CreateVolumesFromImageTest-1117605042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-83d44727-43e2-486d-ac22-cb42410fbecf" returned: 0 in 0.531s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:31:42 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-5ec6575c-574f-49b5-950f-d8d0f4a3b4a8 tempest-CreateVolumesFromImageTest-1117605042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-83d44727-43e2-486d-ac22-cb42410fbecf {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:31:42 devstack sudo[101031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-83d44727-43e2-486d-ac22-cb42410fbecf Sep 16 20:31:42 devstack sudo[101031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:31:42 devstack sudo[101031]: pam_unix(sudo:session): session closed for user root Sep 16 20:31:42 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-5ec6575c-574f-49b5-950f-d8d0f4a3b4a8 tempest-CreateVolumesFromImageTest-1117605042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-83d44727-43e2-486d-ac22-cb42410fbecf" returned: 0 in 0.415s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:31:42 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-5ec6575c-574f-49b5-950f-d8d0f4a3b4a8 tempest-CreateVolumesFromImageTest-1117605042 None] Lock "cinder-quobyte-83d44727-43e2-486d-ac22-cb42410fbecf" released by "delete_volume" :: held 1.042s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:31:42 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-5ec6575c-574f-49b5-950f-d8d0f4a3b4a8 tempest-CreateVolumesFromImageTest-1117605042 None] Created reservations ['16fe7b89-f76b-47b3-9a29-d51e40baf972', 'dd3f6ecb-00b3-4fb5-9787-8a9c26d43f2c', '70bd485b-8969-4ec8-bb88-f5f348dd9564', '708ce6f9-f005-4393-b107-c49754f8d486'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:31:42 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-5ec6575c-574f-49b5-950f-d8d0f4a3b4a8 tempest-CreateVolumesFromImageTest-1117605042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:31:42 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-5ec6575c-574f-49b5-950f-d8d0f4a3b4a8 tempest-CreateVolumesFromImageTest-1117605042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:31:42 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-5ec6575c-574f-49b5-950f-d8d0f4a3b4a8 tempest-CreateVolumesFromImageTest-1117605042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:31:42 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-5ec6575c-574f-49b5-950f-d8d0f4a3b4a8 tempest-CreateVolumesFromImageTest-1117605042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:31:42 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-5ec6575c-574f-49b5-950f-d8d0f4a3b4a8 tempest-CreateVolumesFromImageTest-1117605042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:31:42 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-5ec6575c-574f-49b5-950f-d8d0f4a3b4a8 tempest-CreateVolumesFromImageTest-1117605042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:31:43 devstack sudo[101075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:31:43 devstack sudo[101075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:31:43 devstack sudo[101075]: pam_unix(sudo:session): session closed for user root Sep 16 20:31:43 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-5ec6575c-574f-49b5-950f-d8d0f4a3b4a8 tempest-CreateVolumesFromImageTest-1117605042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.466s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:31:43 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-5ec6575c-574f-49b5-950f-d8d0f4a3b4a8 tempest-CreateVolumesFromImageTest-1117605042 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:31:43 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-5ec6575c-574f-49b5-950f-d8d0f4a3b4a8 tempest-CreateVolumesFromImageTest-1117605042 None] Deleted volume successfully. Sep 16 20:31:43 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-5ec6575c-574f-49b5-950f-d8d0f4a3b4a8 tempest-CreateVolumesFromImageTest-1117605042 None] Lock "cinder-83d44727-43e2-486d-ac22-cb42410fbecf-delete_volume" released by "delete_volume" :: held 1.964s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:31:43 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-39c4fabd-4ff4-49d6-975d-f81eb2296e64 tempest-CreateVolumesFromImageTest-1117605042 None] Acquiring lock "cinder-1ebc55a6-3518-45e8-a507-34be63a75052-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:31:43 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-39c4fabd-4ff4-49d6-975d-f81eb2296e64 tempest-CreateVolumesFromImageTest-1117605042 None] Lock "cinder-1ebc55a6-3518-45e8-a507-34be63a75052-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:31:43 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-39c4fabd-4ff4-49d6-975d-f81eb2296e64 tempest-CreateVolumesFromImageTest-1117605042 None] Acquiring lock "cinder-quobyte-1ebc55a6-3518-45e8-a507-34be63a75052" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:31:43 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-39c4fabd-4ff4-49d6-975d-f81eb2296e64 tempest-CreateVolumesFromImageTest-1117605042 None] Lock "cinder-quobyte-1ebc55a6-3518-45e8-a507-34be63a75052" acquired by "delete_volume" :: waited 0.015s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:31:43 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b14ea0a-4c64-49f8-8edd-627f1a2b6cfc]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:31:43 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-39c4fabd-4ff4-49d6-975d-f81eb2296e64 tempest-CreateVolumesFromImageTest-1117605042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-1ebc55a6-3518-45e8-a507-34be63a75052 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:31:44 devstack sudo[101103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-1ebc55a6-3518-45e8-a507-34be63a75052 Sep 16 20:31:44 devstack sudo[101103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:31:44 devstack sudo[101103]: pam_unix(sudo:session): session closed for user root Sep 16 20:31:44 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-39c4fabd-4ff4-49d6-975d-f81eb2296e64 tempest-CreateVolumesFromImageTest-1117605042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-1ebc55a6-3518-45e8-a507-34be63a75052" returned: 0 in 0.456s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:31:44 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-39c4fabd-4ff4-49d6-975d-f81eb2296e64 tempest-CreateVolumesFromImageTest-1117605042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-1ebc55a6-3518-45e8-a507-34be63a75052 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:31:44 devstack sudo[101110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-1ebc55a6-3518-45e8-a507-34be63a75052 Sep 16 20:31:44 devstack sudo[101110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:31:44 devstack sudo[101110]: pam_unix(sudo:session): session closed for user root Sep 16 20:31:44 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-39c4fabd-4ff4-49d6-975d-f81eb2296e64 tempest-CreateVolumesFromImageTest-1117605042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-1ebc55a6-3518-45e8-a507-34be63a75052" returned: 0 in 0.256s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:31:44 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-39c4fabd-4ff4-49d6-975d-f81eb2296e64 tempest-CreateVolumesFromImageTest-1117605042 None] Lock "cinder-quobyte-1ebc55a6-3518-45e8-a507-34be63a75052" released by "delete_volume" :: held 0.753s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:31:44 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-39c4fabd-4ff4-49d6-975d-f81eb2296e64 tempest-CreateVolumesFromImageTest-1117605042 None] Created reservations ['c6e880a5-11bb-4580-8bb4-cd83536724ca', 'ae8ad005-2dbb-430a-a66d-7a296ed7a62b', '809e2110-9b03-4e3b-8def-5a3af6356cba', '10d71d49-2493-4f55-bfb5-f72b6eca8210'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:31:44 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-39c4fabd-4ff4-49d6-975d-f81eb2296e64 tempest-CreateVolumesFromImageTest-1117605042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:31:44 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-39c4fabd-4ff4-49d6-975d-f81eb2296e64 tempest-CreateVolumesFromImageTest-1117605042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:31:44 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-39c4fabd-4ff4-49d6-975d-f81eb2296e64 tempest-CreateVolumesFromImageTest-1117605042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:31:44 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-39c4fabd-4ff4-49d6-975d-f81eb2296e64 tempest-CreateVolumesFromImageTest-1117605042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:31:44 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-39c4fabd-4ff4-49d6-975d-f81eb2296e64 tempest-CreateVolumesFromImageTest-1117605042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:31:44 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-39c4fabd-4ff4-49d6-975d-f81eb2296e64 tempest-CreateVolumesFromImageTest-1117605042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:31:44 devstack sudo[101113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:31:44 devstack sudo[101113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:31:45 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-a0b74e0e-6100-435e-b4e5-cda0972285d3 tempest-CreateVolumesFromImageTest-1117605042 None] Acquiring lock "cinder-3ff02564-f2da-483a-a104-827c079ac81a-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:31:45 devstack sudo[101113]: pam_unix(sudo:session): session closed for user root Sep 16 20:31:45 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-39c4fabd-4ff4-49d6-975d-f81eb2296e64 tempest-CreateVolumesFromImageTest-1117605042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.290s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:31:45 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-39c4fabd-4ff4-49d6-975d-f81eb2296e64 tempest-CreateVolumesFromImageTest-1117605042 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:31:45 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-a0b74e0e-6100-435e-b4e5-cda0972285d3 tempest-CreateVolumesFromImageTest-1117605042 None] Lock "cinder-3ff02564-f2da-483a-a104-827c079ac81a-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:31:45 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-39c4fabd-4ff4-49d6-975d-f81eb2296e64 tempest-CreateVolumesFromImageTest-1117605042 None] Deleted volume successfully. Sep 16 20:31:45 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-39c4fabd-4ff4-49d6-975d-f81eb2296e64 tempest-CreateVolumesFromImageTest-1117605042 None] Lock "cinder-1ebc55a6-3518-45e8-a507-34be63a75052-delete_volume" released by "delete_volume" :: held 1.317s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:31:45 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-a0b74e0e-6100-435e-b4e5-cda0972285d3 tempest-CreateVolumesFromImageTest-1117605042 None] Acquiring lock "cinder-quobyte-3ff02564-f2da-483a-a104-827c079ac81a" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:31:45 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-a0b74e0e-6100-435e-b4e5-cda0972285d3 tempest-CreateVolumesFromImageTest-1117605042 None] Lock "cinder-quobyte-3ff02564-f2da-483a-a104-827c079ac81a" acquired by "delete_volume" :: waited 0.021s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:31:45 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a22bde2-7bf0-42c4-ab94-f9613924d2db]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:31:45 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a0b74e0e-6100-435e-b4e5-cda0972285d3 tempest-CreateVolumesFromImageTest-1117605042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-3ff02564-f2da-483a-a104-827c079ac81a {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:31:45 devstack sudo[101116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-3ff02564-f2da-483a-a104-827c079ac81a Sep 16 20:31:45 devstack sudo[101116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:31:45 devstack sudo[101116]: pam_unix(sudo:session): session closed for user root Sep 16 20:31:45 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a0b74e0e-6100-435e-b4e5-cda0972285d3 tempest-CreateVolumesFromImageTest-1117605042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-3ff02564-f2da-483a-a104-827c079ac81a" returned: 0 in 0.398s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:31:45 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a0b74e0e-6100-435e-b4e5-cda0972285d3 tempest-CreateVolumesFromImageTest-1117605042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-3ff02564-f2da-483a-a104-827c079ac81a {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:31:45 devstack sudo[101121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-3ff02564-f2da-483a-a104-827c079ac81a Sep 16 20:31:45 devstack sudo[101121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:31:46 devstack sudo[101121]: pam_unix(sudo:session): session closed for user root Sep 16 20:31:46 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a0b74e0e-6100-435e-b4e5-cda0972285d3 tempest-CreateVolumesFromImageTest-1117605042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-3ff02564-f2da-483a-a104-827c079ac81a" returned: 0 in 0.334s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:31:46 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-a0b74e0e-6100-435e-b4e5-cda0972285d3 tempest-CreateVolumesFromImageTest-1117605042 None] Lock "cinder-quobyte-3ff02564-f2da-483a-a104-827c079ac81a" released by "delete_volume" :: held 0.798s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:31:46 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-a0b74e0e-6100-435e-b4e5-cda0972285d3 tempest-CreateVolumesFromImageTest-1117605042 None] Created reservations ['e59f5549-e570-4277-9a92-2d0db923a4e7', 'bef3c91f-3fec-44e6-9007-e3f1e536279b', 'b88d06f9-df5a-466a-8a0d-b5afabcb1940', '7fa2daf7-a991-479e-8b85-aefdfa997a28'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:31:46 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a0b74e0e-6100-435e-b4e5-cda0972285d3 tempest-CreateVolumesFromImageTest-1117605042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:31:46 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a0b74e0e-6100-435e-b4e5-cda0972285d3 tempest-CreateVolumesFromImageTest-1117605042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:31:46 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-a0b74e0e-6100-435e-b4e5-cda0972285d3 tempest-CreateVolumesFromImageTest-1117605042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:31:46 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-a0b74e0e-6100-435e-b4e5-cda0972285d3 tempest-CreateVolumesFromImageTest-1117605042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:31:46 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a0b74e0e-6100-435e-b4e5-cda0972285d3 tempest-CreateVolumesFromImageTest-1117605042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:31:46 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a0b74e0e-6100-435e-b4e5-cda0972285d3 tempest-CreateVolumesFromImageTest-1117605042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:31:46 devstack sudo[101125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:31:46 devstack sudo[101125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:31:46 devstack sudo[101125]: pam_unix(sudo:session): session closed for user root Sep 16 20:31:46 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a0b74e0e-6100-435e-b4e5-cda0972285d3 tempest-CreateVolumesFromImageTest-1117605042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.294s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:31:46 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-a0b74e0e-6100-435e-b4e5-cda0972285d3 tempest-CreateVolumesFromImageTest-1117605042 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:31:46 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-a0b74e0e-6100-435e-b4e5-cda0972285d3 tempest-CreateVolumesFromImageTest-1117605042 None] Deleted volume successfully. Sep 16 20:31:46 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-a0b74e0e-6100-435e-b4e5-cda0972285d3 tempest-CreateVolumesFromImageTest-1117605042 None] Lock "cinder-3ff02564-f2da-483a-a104-827c079ac81a-delete_volume" released by "delete_volume" :: held 1.398s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:31:49 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-00802a9c-3dea-4714-b09e-1f1fb912ca26 tempest-CinderUnicodeTest-1557671649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:31:49 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-00802a9c-3dea-4714-b09e-1f1fb912ca26 tempest-CinderUnicodeTest-1557671649 None] Flow 'volume_create_manager' (ebf6fba2-0e05-4789-80bd-450a31facb03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:31:49 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-00802a9c-3dea-4714-b09e-1f1fb912ca26 tempest-CinderUnicodeTest-1557671649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73c0d52b-cdee-4047-8e47-1f2f4dd2fa87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:31:49 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-00802a9c-3dea-4714-b09e-1f1fb912ca26 tempest-CinderUnicodeTest-1557671649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73c0d52b-cdee-4047-8e47-1f2f4dd2fa87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:31:49Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3784362-38ba-4e00-9f5b-81676f41aea3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80376545263e44fc96fd9f3443de0c15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:31:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:31:49Z,use_quota=True,user_id='137203ccb5874ab0aaa0a9b1dc45379e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:31:49 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-00802a9c-3dea-4714-b09e-1f1fb912ca26 tempest-CinderUnicodeTest-1557671649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9473db1-acfd-41cb-a1d5-2b601bc77b75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:31:49 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-00802a9c-3dea-4714-b09e-1f1fb912ca26 tempest-CinderUnicodeTest-1557671649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9473db1-acfd-41cb-a1d5-2b601bc77b75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:31:49 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-00802a9c-3dea-4714-b09e-1f1fb912ca26 tempest-CinderUnicodeTest-1557671649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (491ba84e-c207-4e22-a3b4-7428ea84e6ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:31:49 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-00802a9c-3dea-4714-b09e-1f1fb912ca26 tempest-CinderUnicodeTest-1557671649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (491ba84e-c207-4e22-a3b4-7428ea84e6ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3784362-38ba-4e00-9f5b-81676f41aea3', 'volume_name': 'volume-a3784362-38ba-4e00-9f5b-81676f41aea3', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:31:49 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-00802a9c-3dea-4714-b09e-1f1fb912ca26 tempest-CinderUnicodeTest-1557671649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33b5ee11-378c-4349-ac53-243c06d83f4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:31:49 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-00802a9c-3dea-4714-b09e-1f1fb912ca26 tempest-CinderUnicodeTest-1557671649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33b5ee11-378c-4349-ac53-243c06d83f4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:31:49 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-00802a9c-3dea-4714-b09e-1f1fb912ca26 tempest-CinderUnicodeTest-1557671649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59f90bba-ec0c-4dc8-bbd9-1e220096e14d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:31:49 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-00802a9c-3dea-4714-b09e-1f1fb912ca26 tempest-CinderUnicodeTest-1557671649 None] Volume a3784362-38ba-4e00-9f5b-81676f41aea3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3784362-38ba-4e00-9f5b-81676f41aea3', 'volume_size': 1} Sep 16 20:31:49 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-00802a9c-3dea-4714-b09e-1f1fb912ca26 tempest-CinderUnicodeTest-1557671649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:31:49 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-00802a9c-3dea-4714-b09e-1f1fb912ca26 tempest-CinderUnicodeTest-1557671649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:31:49 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-00802a9c-3dea-4714-b09e-1f1fb912ca26 tempest-CinderUnicodeTest-1557671649 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:31:49Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3784362-38ba-4e00-9f5b-81676f41aea3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80376545263e44fc96fd9f3443de0c15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:31:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:31:49Z,use_quota=True,user_id='137203ccb5874ab0aaa0a9b1dc45379e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:31:49 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-00802a9c-3dea-4714-b09e-1f1fb912ca26 tempest-CinderUnicodeTest-1557671649 None] Creating volume a3784362-38ba-4e00-9f5b-81676f41aea3 {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:31:49 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-00802a9c-3dea-4714-b09e-1f1fb912ca26 tempest-CinderUnicodeTest-1557671649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:31:49 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-00802a9c-3dea-4714-b09e-1f1fb912ca26 tempest-CinderUnicodeTest-1557671649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:31:49 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-00802a9c-3dea-4714-b09e-1f1fb912ca26 tempest-CinderUnicodeTest-1557671649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:31:49 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-00802a9c-3dea-4714-b09e-1f1fb912ca26 tempest-CinderUnicodeTest-1557671649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:31:49 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-00802a9c-3dea-4714-b09e-1f1fb912ca26 tempest-CinderUnicodeTest-1557671649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:31:49 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-00802a9c-3dea-4714-b09e-1f1fb912ca26 tempest-CinderUnicodeTest-1557671649 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:31:49 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-00802a9c-3dea-4714-b09e-1f1fb912ca26 tempest-CinderUnicodeTest-1557671649 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:31:49 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-00802a9c-3dea-4714-b09e-1f1fb912ca26 tempest-CinderUnicodeTest-1557671649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a3784362-38ba-4e00-9f5b-81676f41aea3 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:31:49 devstack sudo[101131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a3784362-38ba-4e00-9f5b-81676f41aea3 1073741824 Sep 16 20:31:49 devstack sudo[101131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:31:49 devstack sudo[101131]: pam_unix(sudo:session): session closed for user root Sep 16 20:31:49 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-00802a9c-3dea-4714-b09e-1f1fb912ca26 tempest-CinderUnicodeTest-1557671649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a3784362-38ba-4e00-9f5b-81676f41aea3 1073741824" returned: 0 in 0.487s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:31:49 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-00802a9c-3dea-4714-b09e-1f1fb912ca26 tempest-CinderUnicodeTest-1557671649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a3784362-38ba-4e00-9f5b-81676f41aea3 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:31:50 devstack sudo[101136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a3784362-38ba-4e00-9f5b-81676f41aea3 Sep 16 20:31:50 devstack sudo[101136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:31:50 devstack sudo[101136]: pam_unix(sudo:session): session closed for user root Sep 16 20:31:50 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-00802a9c-3dea-4714-b09e-1f1fb912ca26 tempest-CinderUnicodeTest-1557671649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a3784362-38ba-4e00-9f5b-81676f41aea3" returned: 0 in 0.278s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:31:50 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-00802a9c-3dea-4714-b09e-1f1fb912ca26 tempest-CinderUnicodeTest-1557671649 None] <== create_volume: return (821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:31:50 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-00802a9c-3dea-4714-b09e-1f1fb912ca26 tempest-CinderUnicodeTest-1557671649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.826s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:31:50 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-00802a9c-3dea-4714-b09e-1f1fb912ca26 tempest-CinderUnicodeTest-1557671649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59f90bba-ec0c-4dc8-bbd9-1e220096e14d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3784362-38ba-4e00-9f5b-81676f41aea3', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:31:50 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-00802a9c-3dea-4714-b09e-1f1fb912ca26 tempest-CinderUnicodeTest-1557671649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5906831-a8bc-469f-ab79-698bad5adc37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:31:50 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-00802a9c-3dea-4714-b09e-1f1fb912ca26 tempest-CinderUnicodeTest-1557671649 None] Volume volume-a3784362-38ba-4e00-9f5b-81676f41aea3 (a3784362-38ba-4e00-9f5b-81676f41aea3): created successfully Sep 16 20:31:50 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-00802a9c-3dea-4714-b09e-1f1fb912ca26 tempest-CinderUnicodeTest-1557671649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5906831-a8bc-469f-ab79-698bad5adc37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:31:50 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-00802a9c-3dea-4714-b09e-1f1fb912ca26 tempest-CinderUnicodeTest-1557671649 None] Flow 'volume_create_manager' (ebf6fba2-0e05-4789-80bd-450a31facb03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:31:50 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-00802a9c-3dea-4714-b09e-1f1fb912ca26 tempest-CinderUnicodeTest-1557671649 None] Created volume successfully. Sep 16 20:31:51 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b2b13e2-edf4-4b9e-b7da-920c1302757b tempest-CinderUnicodeTest-1557671649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:31:52 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-4b2b13e2-edf4-4b9e-b7da-920c1302757b tempest-CinderUnicodeTest-1557671649 None] Flow 'volume_create_manager' (444c6b4e-e267-41f9-8463-2153b24e4537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:31:52 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-4b2b13e2-edf4-4b9e-b7da-920c1302757b tempest-CinderUnicodeTest-1557671649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c7baf49-b7a4-4285-bfeb-18fd9b918218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:31:52 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-4b2b13e2-edf4-4b9e-b7da-920c1302757b tempest-CinderUnicodeTest-1557671649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c7baf49-b7a4-4285-bfeb-18fd9b918218) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:31:52Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-921703317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04033805-d5a2-444f-87d9-b06d8a7a2a8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80376545263e44fc96fd9f3443de0c15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:31:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:31:52Z,use_quota=True,user_id='137203ccb5874ab0aaa0a9b1dc45379e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:31:52 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-4b2b13e2-edf4-4b9e-b7da-920c1302757b tempest-CinderUnicodeTest-1557671649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34181651-a9b8-4cc7-91c7-ff11f497c69f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:31:52 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-4b2b13e2-edf4-4b9e-b7da-920c1302757b tempest-CinderUnicodeTest-1557671649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34181651-a9b8-4cc7-91c7-ff11f497c69f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:31:52 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-4b2b13e2-edf4-4b9e-b7da-920c1302757b tempest-CinderUnicodeTest-1557671649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (399d5e2f-b25f-4be7-a34b-ff174c0a6345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:31:52 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-4b2b13e2-edf4-4b9e-b7da-920c1302757b tempest-CinderUnicodeTest-1557671649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (399d5e2f-b25f-4be7-a34b-ff174c0a6345) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04033805-d5a2-444f-87d9-b06d8a7a2a8b', 'volume_name': 'volume-04033805-d5a2-444f-87d9-b06d8a7a2a8b', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:31:52 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-4b2b13e2-edf4-4b9e-b7da-920c1302757b tempest-CinderUnicodeTest-1557671649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6405282c-8886-476c-9b69-1b1b74ee0845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:31:52 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-4b2b13e2-edf4-4b9e-b7da-920c1302757b tempest-CinderUnicodeTest-1557671649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6405282c-8886-476c-9b69-1b1b74ee0845) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:31:52 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-4b2b13e2-edf4-4b9e-b7da-920c1302757b tempest-CinderUnicodeTest-1557671649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a0d78d1-3d91-48ce-a02f-9f1f42554b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:31:52 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-4b2b13e2-edf4-4b9e-b7da-920c1302757b tempest-CinderUnicodeTest-1557671649 None] Volume 04033805-d5a2-444f-87d9-b06d8a7a2a8b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04033805-d5a2-444f-87d9-b06d8a7a2a8b', 'volume_size': 1} Sep 16 20:31:52 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-4b2b13e2-edf4-4b9e-b7da-920c1302757b tempest-CinderUnicodeTest-1557671649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:31:52 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-4b2b13e2-edf4-4b9e-b7da-920c1302757b tempest-CinderUnicodeTest-1557671649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:31:52 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-4b2b13e2-edf4-4b9e-b7da-920c1302757b tempest-CinderUnicodeTest-1557671649 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:31:52Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-921703317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04033805-d5a2-444f-87d9-b06d8a7a2a8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80376545263e44fc96fd9f3443de0c15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:31:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:31:52Z,use_quota=True,user_id='137203ccb5874ab0aaa0a9b1dc45379e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:31:52 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-4b2b13e2-edf4-4b9e-b7da-920c1302757b tempest-CinderUnicodeTest-1557671649 None] Creating volume 04033805-d5a2-444f-87d9-b06d8a7a2a8b {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:31:52 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-4b2b13e2-edf4-4b9e-b7da-920c1302757b tempest-CinderUnicodeTest-1557671649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:31:52 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-4b2b13e2-edf4-4b9e-b7da-920c1302757b tempest-CinderUnicodeTest-1557671649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:31:52 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-4b2b13e2-edf4-4b9e-b7da-920c1302757b tempest-CinderUnicodeTest-1557671649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:31:52 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-4b2b13e2-edf4-4b9e-b7da-920c1302757b tempest-CinderUnicodeTest-1557671649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:31:52 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-4b2b13e2-edf4-4b9e-b7da-920c1302757b tempest-CinderUnicodeTest-1557671649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:31:52 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-4b2b13e2-edf4-4b9e-b7da-920c1302757b tempest-CinderUnicodeTest-1557671649 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:31:52 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-4b2b13e2-edf4-4b9e-b7da-920c1302757b tempest-CinderUnicodeTest-1557671649 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:31:52 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-4b2b13e2-edf4-4b9e-b7da-920c1302757b tempest-CinderUnicodeTest-1557671649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-04033805-d5a2-444f-87d9-b06d8a7a2a8b 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:31:52 devstack sudo[101139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-04033805-d5a2-444f-87d9-b06d8a7a2a8b 1073741824 Sep 16 20:31:52 devstack sudo[101139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:31:52 devstack sudo[101139]: pam_unix(sudo:session): session closed for user root Sep 16 20:31:52 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-4b2b13e2-edf4-4b9e-b7da-920c1302757b tempest-CinderUnicodeTest-1557671649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-04033805-d5a2-444f-87d9-b06d8a7a2a8b 1073741824" returned: 0 in 0.447s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:31:52 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-4b2b13e2-edf4-4b9e-b7da-920c1302757b tempest-CinderUnicodeTest-1557671649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-04033805-d5a2-444f-87d9-b06d8a7a2a8b {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:31:52 devstack sudo[101145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-04033805-d5a2-444f-87d9-b06d8a7a2a8b Sep 16 20:31:52 devstack sudo[101145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:31:52 devstack sudo[101145]: pam_unix(sudo:session): session closed for user root Sep 16 20:31:52 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-4b2b13e2-edf4-4b9e-b7da-920c1302757b tempest-CinderUnicodeTest-1557671649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-04033805-d5a2-444f-87d9-b06d8a7a2a8b" returned: 0 in 0.253s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:31:52 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-4b2b13e2-edf4-4b9e-b7da-920c1302757b tempest-CinderUnicodeTest-1557671649 None] <== create_volume: return (743ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:31:52 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-4b2b13e2-edf4-4b9e-b7da-920c1302757b tempest-CinderUnicodeTest-1557671649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.746s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:31:52 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-4b2b13e2-edf4-4b9e-b7da-920c1302757b tempest-CinderUnicodeTest-1557671649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a0d78d1-3d91-48ce-a02f-9f1f42554b43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04033805-d5a2-444f-87d9-b06d8a7a2a8b', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:31:52 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-4b2b13e2-edf4-4b9e-b7da-920c1302757b tempest-CinderUnicodeTest-1557671649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfd4431d-62f5-4365-bd27-6a86a49780b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:31:52 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-4b2b13e2-edf4-4b9e-b7da-920c1302757b tempest-CinderUnicodeTest-1557671649 None] Volume volume-04033805-d5a2-444f-87d9-b06d8a7a2a8b (04033805-d5a2-444f-87d9-b06d8a7a2a8b): created successfully Sep 16 20:31:52 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-4b2b13e2-edf4-4b9e-b7da-920c1302757b tempest-CinderUnicodeTest-1557671649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfd4431d-62f5-4365-bd27-6a86a49780b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:31:52 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-4b2b13e2-edf4-4b9e-b7da-920c1302757b tempest-CinderUnicodeTest-1557671649 None] Flow 'volume_create_manager' (444c6b4e-e267-41f9-8463-2153b24e4537) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:31:52 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-4b2b13e2-edf4-4b9e-b7da-920c1302757b tempest-CinderUnicodeTest-1557671649 None] Created volume successfully. Sep 16 20:31:53 devstack cinder-volume[86188]: DEBUG oslo_service.periodic_task [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86188) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 20:31:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:31:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:31:53 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:31:53 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:31:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:31:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:31:53 devstack sudo[101148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:31:53 devstack sudo[101148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:31:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-231ab830-f429-44c9-9220-dbd3c1378425 tempest-CinderUnicodeTest-1557671649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:31:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-231ab830-f429-44c9-9220-dbd3c1378425 tempest-CinderUnicodeTest-1557671649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:31:53 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-231ab830-f429-44c9-9220-dbd3c1378425 tempest-CinderUnicodeTest-1557671649 None] Creating offline snapshot 82b244b2-06a2-4d7f-be26-4d01adf6f9d5 of volume 04033805-d5a2-444f-87d9-b06d8a7a2a8b {{(pid=86188) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 20:31:53 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[56b0ec3a-fe64-4d22-9cef-61799b68ab2c]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:31:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-231ab830-f429-44c9-9220-dbd3c1378425 tempest-CinderUnicodeTest-1557671649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-04033805-d5a2-444f-87d9-b06d8a7a2a8b {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:31:53 devstack sudo[101148]: pam_unix(sudo:session): session closed for user root Sep 16 20:31:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.294s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:31:53 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:31:53 devstack cinder-volume[86188]: DEBUG oslo_service.periodic_task [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Running periodic task VolumeManager._thread_info {{(pid=86188) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 20:31:53 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] thread count: 28 {{(pid=86188) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 16 20:31:53 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] thread info: [<_MainThread(MainThread, started 139858124406912)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86188) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 16 20:31:53 devstack sudo[101150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-04033805-d5a2-444f-87d9-b06d8a7a2a8b Sep 16 20:31:53 devstack sudo[101150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:31:53 devstack sudo[101150]: pam_unix(sudo:session): session closed for user root Sep 16 20:31:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-231ab830-f429-44c9-9220-dbd3c1378425 tempest-CinderUnicodeTest-1557671649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-04033805-d5a2-444f-87d9-b06d8a7a2a8b" returned: 0 in 0.389s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:31:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-231ab830-f429-44c9-9220-dbd3c1378425 tempest-CinderUnicodeTest-1557671649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-04033805-d5a2-444f-87d9-b06d8a7a2a8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-04033805-d5a2-444f-87d9-b06d8a7a2a8b.82b244b2-06a2-4d7f-be26-4d01adf6f9d5 1G {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:31:53 devstack sudo[101156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-04033805-d5a2-444f-87d9-b06d8a7a2a8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-04033805-d5a2-444f-87d9-b06d8a7a2a8b.82b244b2-06a2-4d7f-be26-4d01adf6f9d5 1G Sep 16 20:31:53 devstack sudo[101156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:31:54 devstack sudo[101156]: pam_unix(sudo:session): session closed for user root Sep 16 20:31:54 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-231ab830-f429-44c9-9220-dbd3c1378425 tempest-CinderUnicodeTest-1557671649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-04033805-d5a2-444f-87d9-b06d8a7a2a8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-04033805-d5a2-444f-87d9-b06d8a7a2a8b.82b244b2-06a2-4d7f-be26-4d01adf6f9d5 1G" returned: 0 in 0.475s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:31:54 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-231ab830-f429-44c9-9220-dbd3c1378425 tempest-CinderUnicodeTest-1557671649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04033805-d5a2-444f-87d9-b06d8a7a2a8b -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-04033805-d5a2-444f-87d9-b06d8a7a2a8b.82b244b2-06a2-4d7f-be26-4d01adf6f9d5 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:31:54 devstack sudo[101163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04033805-d5a2-444f-87d9-b06d8a7a2a8b -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-04033805-d5a2-444f-87d9-b06d8a7a2a8b.82b244b2-06a2-4d7f-be26-4d01adf6f9d5 Sep 16 20:31:54 devstack sudo[101163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:31:54 devstack sudo[101163]: pam_unix(sudo:session): session closed for user root Sep 16 20:31:54 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-231ab830-f429-44c9-9220-dbd3c1378425 tempest-CinderUnicodeTest-1557671649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04033805-d5a2-444f-87d9-b06d8a7a2a8b -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-04033805-d5a2-444f-87d9-b06d8a7a2a8b.82b244b2-06a2-4d7f-be26-4d01adf6f9d5" returned: 0 in 0.336s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:31:54 devstack cinder-volume[86188]: WARNING cinder.volume.drivers.remotefs [None req-231ab830-f429-44c9-9220-dbd3c1378425 tempest-CinderUnicodeTest-1557671649 None] /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-04033805-d5a2-444f-87d9-b06d8a7a2a8b.82b244b2-06a2-4d7f-be26-4d01adf6f9d5 is being set with open permissions: ugo+rw Sep 16 20:31:54 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-231ab830-f429-44c9-9220-dbd3c1378425 tempest-CinderUnicodeTest-1557671649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-04033805-d5a2-444f-87d9-b06d8a7a2a8b.82b244b2-06a2-4d7f-be26-4d01adf6f9d5 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:31:54 devstack sudo[101168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-04033805-d5a2-444f-87d9-b06d8a7a2a8b.82b244b2-06a2-4d7f-be26-4d01adf6f9d5 Sep 16 20:31:54 devstack sudo[101168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:31:54 devstack sudo[101168]: pam_unix(sudo:session): session closed for user root Sep 16 20:31:54 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-231ab830-f429-44c9-9220-dbd3c1378425 tempest-CinderUnicodeTest-1557671649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-04033805-d5a2-444f-87d9-b06d8a7a2a8b.82b244b2-06a2-4d7f-be26-4d01adf6f9d5" returned: 0 in 0.286s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:31:54 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-231ab830-f429-44c9-9220-dbd3c1378425 tempest-CinderUnicodeTest-1557671649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-04033805-d5a2-444f-87d9-b06d8a7a2a8b.info {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:31:54 devstack sudo[101171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-04033805-d5a2-444f-87d9-b06d8a7a2a8b.info Sep 16 20:31:54 devstack sudo[101171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:31:55 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-5128a322-8e79-448c-82d8-a901e56a0bd2 tempest-TestServerVolumeAttachScenarioOldVersion-2085325911 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:31:55 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-5128a322-8e79-448c-82d8-a901e56a0bd2 tempest-TestServerVolumeAttachScenarioOldVersion-2085325911 None] Flow 'volume_create_manager' (59580311-ffe5-464e-9b7e-f82fc9d1d792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:31:55 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-5128a322-8e79-448c-82d8-a901e56a0bd2 tempest-TestServerVolumeAttachScenarioOldVersion-2085325911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15fdeb8b-4ff8-408f-9051-abcc9f35d793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:31:55 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-5128a322-8e79-448c-82d8-a901e56a0bd2 tempest-TestServerVolumeAttachScenarioOldVersion-2085325911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15fdeb8b-4ff8-408f-9051-abcc9f35d793) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:31:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-284688055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=020636f8-c505-4520-a172-69843a6e82af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d5f6c3b5c044264bce365650dad9cfe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:31:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:31:55Z,use_quota=True,user_id='43e1260b2e85470ca3f971fb17d42bea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:31:55 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-5128a322-8e79-448c-82d8-a901e56a0bd2 tempest-TestServerVolumeAttachScenarioOldVersion-2085325911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edb77fab-d321-40f8-b294-6bf79fa15740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:31:55 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-5128a322-8e79-448c-82d8-a901e56a0bd2 tempest-TestServerVolumeAttachScenarioOldVersion-2085325911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edb77fab-d321-40f8-b294-6bf79fa15740) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:31:55 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-5128a322-8e79-448c-82d8-a901e56a0bd2 tempest-TestServerVolumeAttachScenarioOldVersion-2085325911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5550e573-db38-4dd4-b6a7-9167eb966f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:31:55 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-5128a322-8e79-448c-82d8-a901e56a0bd2 tempest-TestServerVolumeAttachScenarioOldVersion-2085325911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5550e573-db38-4dd4-b6a7-9167eb966f48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '020636f8-c505-4520-a172-69843a6e82af', 'volume_name': 'volume-020636f8-c505-4520-a172-69843a6e82af', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:31:55 devstack sudo[101171]: pam_unix(sudo:session): session closed for user root Sep 16 20:31:55 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-5128a322-8e79-448c-82d8-a901e56a0bd2 tempest-TestServerVolumeAttachScenarioOldVersion-2085325911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0b1023d-d772-4085-970c-bea89943631e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:31:55 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-5128a322-8e79-448c-82d8-a901e56a0bd2 tempest-TestServerVolumeAttachScenarioOldVersion-2085325911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0b1023d-d772-4085-970c-bea89943631e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:31:55 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-5128a322-8e79-448c-82d8-a901e56a0bd2 tempest-TestServerVolumeAttachScenarioOldVersion-2085325911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3af73ab-0a3e-424d-9099-bfba79e60305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:31:55 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-5128a322-8e79-448c-82d8-a901e56a0bd2 tempest-TestServerVolumeAttachScenarioOldVersion-2085325911 None] Volume 020636f8-c505-4520-a172-69843a6e82af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-020636f8-c505-4520-a172-69843a6e82af', 'volume_size': 1} Sep 16 20:31:55 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-5128a322-8e79-448c-82d8-a901e56a0bd2 tempest-TestServerVolumeAttachScenarioOldVersion-2085325911 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:31:55 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-231ab830-f429-44c9-9220-dbd3c1378425 tempest-CinderUnicodeTest-1557671649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-04033805-d5a2-444f-87d9-b06d8a7a2a8b.info" returned: 0 in 0.326s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:31:55 devstack cinder-volume[86188]: WARNING cinder.volume.drivers.remotefs [None req-231ab830-f429-44c9-9220-dbd3c1378425 tempest-CinderUnicodeTest-1557671649 None] /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-04033805-d5a2-444f-87d9-b06d8a7a2a8b.info is being set with open permissions: ugo+rw Sep 16 20:31:55 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-231ab830-f429-44c9-9220-dbd3c1378425 tempest-CinderUnicodeTest-1557671649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-04033805-d5a2-444f-87d9-b06d8a7a2a8b.info {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:31:55 devstack sudo[101174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-04033805-d5a2-444f-87d9-b06d8a7a2a8b.info Sep 16 20:31:55 devstack sudo[101174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:31:55 devstack sudo[101174]: pam_unix(sudo:session): session closed for user root Sep 16 20:31:55 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-231ab830-f429-44c9-9220-dbd3c1378425 tempest-CinderUnicodeTest-1557671649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-04033805-d5a2-444f-87d9-b06d8a7a2a8b.info" returned: 0 in 0.247s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:31:55 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-231ab830-f429-44c9-9220-dbd3c1378425 tempest-CinderUnicodeTest-1557671649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.172s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:31:55 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-5128a322-8e79-448c-82d8-a901e56a0bd2 tempest-TestServerVolumeAttachScenarioOldVersion-2085325911 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.267s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:31:55 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-5128a322-8e79-448c-82d8-a901e56a0bd2 tempest-TestServerVolumeAttachScenarioOldVersion-2085325911 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:31:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-284688055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=020636f8-c505-4520-a172-69843a6e82af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d5f6c3b5c044264bce365650dad9cfe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:31:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:31:55Z,use_quota=True,user_id='43e1260b2e85470ca3f971fb17d42bea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:31:55 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-5128a322-8e79-448c-82d8-a901e56a0bd2 tempest-TestServerVolumeAttachScenarioOldVersion-2085325911 None] Creating volume 020636f8-c505-4520-a172-69843a6e82af {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:31:55 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-5128a322-8e79-448c-82d8-a901e56a0bd2 tempest-TestServerVolumeAttachScenarioOldVersion-2085325911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:31:55 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-5128a322-8e79-448c-82d8-a901e56a0bd2 tempest-TestServerVolumeAttachScenarioOldVersion-2085325911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:31:55 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-5128a322-8e79-448c-82d8-a901e56a0bd2 tempest-TestServerVolumeAttachScenarioOldVersion-2085325911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:31:55 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-5128a322-8e79-448c-82d8-a901e56a0bd2 tempest-TestServerVolumeAttachScenarioOldVersion-2085325911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:31:55 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-5128a322-8e79-448c-82d8-a901e56a0bd2 tempest-TestServerVolumeAttachScenarioOldVersion-2085325911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:31:55 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-5128a322-8e79-448c-82d8-a901e56a0bd2 tempest-TestServerVolumeAttachScenarioOldVersion-2085325911 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:31:55 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-5128a322-8e79-448c-82d8-a901e56a0bd2 tempest-TestServerVolumeAttachScenarioOldVersion-2085325911 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:31:55 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-5128a322-8e79-448c-82d8-a901e56a0bd2 tempest-TestServerVolumeAttachScenarioOldVersion-2085325911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-020636f8-c505-4520-a172-69843a6e82af 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:31:55 devstack sudo[101177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-020636f8-c505-4520-a172-69843a6e82af 1073741824 Sep 16 20:31:55 devstack sudo[101177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:31:55 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-231ab830-f429-44c9-9220-dbd3c1378425 tempest-CinderUnicodeTest-1557671649 None] Create snapshot completed successfully Sep 16 20:31:55 devstack sudo[101177]: pam_unix(sudo:session): session closed for user root Sep 16 20:31:55 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-5128a322-8e79-448c-82d8-a901e56a0bd2 tempest-TestServerVolumeAttachScenarioOldVersion-2085325911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-020636f8-c505-4520-a172-69843a6e82af 1073741824" returned: 0 in 0.433s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:31:55 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-5128a322-8e79-448c-82d8-a901e56a0bd2 tempest-TestServerVolumeAttachScenarioOldVersion-2085325911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-020636f8-c505-4520-a172-69843a6e82af {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:31:55 devstack sudo[101182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-020636f8-c505-4520-a172-69843a6e82af Sep 16 20:31:55 devstack sudo[101182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:31:56 devstack sudo[101182]: pam_unix(sudo:session): session closed for user root Sep 16 20:31:56 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-5128a322-8e79-448c-82d8-a901e56a0bd2 tempest-TestServerVolumeAttachScenarioOldVersion-2085325911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-020636f8-c505-4520-a172-69843a6e82af" returned: 0 in 0.276s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:31:56 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-5128a322-8e79-448c-82d8-a901e56a0bd2 tempest-TestServerVolumeAttachScenarioOldVersion-2085325911 None] <== create_volume: return (757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:31:56 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-5128a322-8e79-448c-82d8-a901e56a0bd2 tempest-TestServerVolumeAttachScenarioOldVersion-2085325911 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.761s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:31:56 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-5128a322-8e79-448c-82d8-a901e56a0bd2 tempest-TestServerVolumeAttachScenarioOldVersion-2085325911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3af73ab-0a3e-424d-9099-bfba79e60305) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-020636f8-c505-4520-a172-69843a6e82af', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:31:56 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-5128a322-8e79-448c-82d8-a901e56a0bd2 tempest-TestServerVolumeAttachScenarioOldVersion-2085325911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03beb038-13ca-4fc4-aff5-b10f46e4b46e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:31:56 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-5128a322-8e79-448c-82d8-a901e56a0bd2 tempest-TestServerVolumeAttachScenarioOldVersion-2085325911 None] Volume volume-020636f8-c505-4520-a172-69843a6e82af (020636f8-c505-4520-a172-69843a6e82af): created successfully Sep 16 20:31:56 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-5128a322-8e79-448c-82d8-a901e56a0bd2 tempest-TestServerVolumeAttachScenarioOldVersion-2085325911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03beb038-13ca-4fc4-aff5-b10f46e4b46e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:31:56 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-5128a322-8e79-448c-82d8-a901e56a0bd2 tempest-TestServerVolumeAttachScenarioOldVersion-2085325911 None] Flow 'volume_create_manager' (59580311-ffe5-464e-9b7e-f82fc9d1d792) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:31:56 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-5128a322-8e79-448c-82d8-a901e56a0bd2 tempest-TestServerVolumeAttachScenarioOldVersion-2085325911 None] Created volume successfully. Sep 16 20:31:56 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-6d9aed7b-047d-45ca-90eb-284ff61e27ac tempest-CinderUnicodeTest-1557671649 None] Acquiring lock "cinder-82b244b2-06a2-4d7f-be26-4d01adf6f9d5-delete_snapshot" by "delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:31:56 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-6d9aed7b-047d-45ca-90eb-284ff61e27ac tempest-CinderUnicodeTest-1557671649 None] Lock "cinder-82b244b2-06a2-4d7f-be26-4d01adf6f9d5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:31:56 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-6d9aed7b-047d-45ca-90eb-284ff61e27ac tempest-CinderUnicodeTest-1557671649 None] Acquiring lock "cinder-quobyte-04033805-d5a2-444f-87d9-b06d8a7a2a8b" by "delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:31:56 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-6d9aed7b-047d-45ca-90eb-284ff61e27ac tempest-CinderUnicodeTest-1557671649 None] Lock "cinder-quobyte-04033805-d5a2-444f-87d9-b06d8a7a2a8b" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:31:56 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-6d9aed7b-047d-45ca-90eb-284ff61e27ac tempest-CinderUnicodeTest-1557671649 None] Acquiring lock "cinder-quobyte-82b244b2-06a2-4d7f-be26-4d01adf6f9d5" by "_delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:31:56 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-6d9aed7b-047d-45ca-90eb-284ff61e27ac tempest-CinderUnicodeTest-1557671649 None] Lock "cinder-quobyte-82b244b2-06a2-4d7f-be26-4d01adf6f9d5" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:31:56 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-6d9aed7b-047d-45ca-90eb-284ff61e27ac tempest-CinderUnicodeTest-1557671649 None] Deleting offline snapshot 82b244b2-06a2-4d7f-be26-4d01adf6f9d5 of volume 04033805-d5a2-444f-87d9-b06d8a7a2a8b {{(pid=86188) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 20:31:56 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-6d9aed7b-047d-45ca-90eb-284ff61e27ac tempest-CinderUnicodeTest-1557671649 None] snapshot_file for this snap is: volume-04033805-d5a2-444f-87d9-b06d8a7a2a8b.82b244b2-06a2-4d7f-be26-4d01adf6f9d5 {{(pid=86188) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 20:31:56 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[08972cdf-b97d-4ea0-9c1a-6fc889313c76]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:31:56 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-6d9aed7b-047d-45ca-90eb-284ff61e27ac tempest-CinderUnicodeTest-1557671649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-04033805-d5a2-444f-87d9-b06d8a7a2a8b.82b244b2-06a2-4d7f-be26-4d01adf6f9d5 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:31:56 devstack sudo[101197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-04033805-d5a2-444f-87d9-b06d8a7a2a8b.82b244b2-06a2-4d7f-be26-4d01adf6f9d5 Sep 16 20:31:56 devstack sudo[101197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:31:56 devstack sudo[101197]: pam_unix(sudo:session): session closed for user root Sep 16 20:31:56 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-6d9aed7b-047d-45ca-90eb-284ff61e27ac tempest-CinderUnicodeTest-1557671649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-04033805-d5a2-444f-87d9-b06d8a7a2a8b.82b244b2-06a2-4d7f-be26-4d01adf6f9d5" returned: 0 in 0.379s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:31:56 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-6d9aed7b-047d-45ca-90eb-284ff61e27ac tempest-CinderUnicodeTest-1557671649 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-04033805-d5a2-444f-87d9-b06d8a7a2a8b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86188) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 20:31:56 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d36b3ca-e475-466c-921b-3a46c92d73f6]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:31:56 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-6d9aed7b-047d-45ca-90eb-284ff61e27ac tempest-CinderUnicodeTest-1557671649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-04033805-d5a2-444f-87d9-b06d8a7a2a8b {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:31:57 devstack sudo[101202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-04033805-d5a2-444f-87d9-b06d8a7a2a8b Sep 16 20:31:57 devstack sudo[101202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:31:57 devstack sudo[101202]: pam_unix(sudo:session): session closed for user root Sep 16 20:31:57 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-6d9aed7b-047d-45ca-90eb-284ff61e27ac tempest-CinderUnicodeTest-1557671649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-04033805-d5a2-444f-87d9-b06d8a7a2a8b" returned: 0 in 0.391s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:31:57 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-6d9aed7b-047d-45ca-90eb-284ff61e27ac tempest-CinderUnicodeTest-1557671649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-04033805-d5a2-444f-87d9-b06d8a7a2a8b.82b244b2-06a2-4d7f-be26-4d01adf6f9d5 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:31:57 devstack sudo[101210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-04033805-d5a2-444f-87d9-b06d8a7a2a8b.82b244b2-06a2-4d7f-be26-4d01adf6f9d5 Sep 16 20:31:57 devstack sudo[101210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:31:57 devstack sudo[101210]: pam_unix(sudo:session): session closed for user root Sep 16 20:31:57 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-6d9aed7b-047d-45ca-90eb-284ff61e27ac tempest-CinderUnicodeTest-1557671649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-04033805-d5a2-444f-87d9-b06d8a7a2a8b.82b244b2-06a2-4d7f-be26-4d01adf6f9d5" returned: 0 in 0.393s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:31:57 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-6d9aed7b-047d-45ca-90eb-284ff61e27ac tempest-CinderUnicodeTest-1557671649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-04033805-d5a2-444f-87d9-b06d8a7a2a8b.82b244b2-06a2-4d7f-be26-4d01adf6f9d5 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:31:57 devstack sudo[101238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-04033805-d5a2-444f-87d9-b06d8a7a2a8b.82b244b2-06a2-4d7f-be26-4d01adf6f9d5 Sep 16 20:31:57 devstack sudo[101238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:31:57 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [req-c0bc3ae3-3b00-4bdf-a6c7-20c2b5e65a5b req-d64cceaa-c868-4efb-b8b2-16070ea84230 tempest-TestServerVolumeAttachScenarioOldVersion-2085325911 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:31:57 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [req-c0bc3ae3-3b00-4bdf-a6c7-20c2b5e65a5b req-d64cceaa-c868-4efb-b8b2-16070ea84230 tempest-TestServerVolumeAttachScenarioOldVersion-2085325911 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:31:57 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [req-c0bc3ae3-3b00-4bdf-a6c7-20c2b5e65a5b req-d64cceaa-c868-4efb-b8b2-16070ea84230 tempest-TestServerVolumeAttachScenarioOldVersion-2085325911 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:31:57 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [req-c0bc3ae3-3b00-4bdf-a6c7-20c2b5e65a5b req-d64cceaa-c868-4efb-b8b2-16070ea84230 tempest-TestServerVolumeAttachScenarioOldVersion-2085325911 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81', 'name': 'volume-020636f8-c505-4520-a172-69843a6e82af', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '66103d64-f019-497a-a100-c9b72dee76fd', 'enforce_multipath': True} {{(pid=86188) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 16 20:31:58 devstack cinder-volume[86188]: INFO cinder.volume.manager [req-c0bc3ae3-3b00-4bdf-a6c7-20c2b5e65a5b req-d64cceaa-c868-4efb-b8b2-16070ea84230 tempest-TestServerVolumeAttachScenarioOldVersion-2085325911 None] attachment_update completed successfully. Sep 16 20:31:58 devstack sudo[101238]: pam_unix(sudo:session): session closed for user root Sep 16 20:31:58 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-6d9aed7b-047d-45ca-90eb-284ff61e27ac tempest-CinderUnicodeTest-1557671649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-04033805-d5a2-444f-87d9-b06d8a7a2a8b.82b244b2-06a2-4d7f-be26-4d01adf6f9d5" returned: 0 in 0.343s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:31:58 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-6d9aed7b-047d-45ca-90eb-284ff61e27ac tempest-CinderUnicodeTest-1557671649 None] Lock "cinder-quobyte-82b244b2-06a2-4d7f-be26-4d01adf6f9d5" released by "_delete_snapshot" :: held 1.624s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:31:58 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-6d9aed7b-047d-45ca-90eb-284ff61e27ac tempest-CinderUnicodeTest-1557671649 None] Lock "cinder-quobyte-04033805-d5a2-444f-87d9-b06d8a7a2a8b" released by "delete_snapshot" :: held 1.650s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:31:58 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-6d9aed7b-047d-45ca-90eb-284ff61e27ac tempest-CinderUnicodeTest-1557671649 None] Created reservations ['f7d52f76-33ce-46bb-9a3d-c5c6fbf1fe64', '18ba5998-9ed9-402a-bd8d-394475b2753f', '394cfe93-1588-4287-88fb-86671b3034f5', '79b38c6c-8796-41a5-ab9d-c2dfa9bc665d'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:31:58 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-6d9aed7b-047d-45ca-90eb-284ff61e27ac tempest-CinderUnicodeTest-1557671649 None] Delete snapshot completed successfully. Sep 16 20:31:58 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-6d9aed7b-047d-45ca-90eb-284ff61e27ac tempest-CinderUnicodeTest-1557671649 None] Lock "cinder-82b244b2-06a2-4d7f-be26-4d01adf6f9d5-delete_snapshot" released by "delete_snapshot" :: held 1.814s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:31:58 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-fe0f471a-4732-4b60-9f26-cb570e74ab37 tempest-CinderUnicodeTest-1557671649 None] Acquiring lock "cinder-04033805-d5a2-444f-87d9-b06d8a7a2a8b-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:31:58 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-fe0f471a-4732-4b60-9f26-cb570e74ab37 tempest-CinderUnicodeTest-1557671649 None] Lock "cinder-04033805-d5a2-444f-87d9-b06d8a7a2a8b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:31:58 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-fe0f471a-4732-4b60-9f26-cb570e74ab37 tempest-CinderUnicodeTest-1557671649 None] Acquiring lock "cinder-quobyte-04033805-d5a2-444f-87d9-b06d8a7a2a8b" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:31:58 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-fe0f471a-4732-4b60-9f26-cb570e74ab37 tempest-CinderUnicodeTest-1557671649 None] Lock "cinder-quobyte-04033805-d5a2-444f-87d9-b06d8a7a2a8b" acquired by "delete_volume" :: waited 0.017s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:31:58 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f222ddb-b724-4407-a03a-4773df0beff4]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:31:58 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-fe0f471a-4732-4b60-9f26-cb570e74ab37 tempest-CinderUnicodeTest-1557671649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-04033805-d5a2-444f-87d9-b06d8a7a2a8b {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:31:58 devstack sudo[101675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-04033805-d5a2-444f-87d9-b06d8a7a2a8b Sep 16 20:31:58 devstack sudo[101675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:31:59 devstack sudo[101675]: pam_unix(sudo:session): session closed for user root Sep 16 20:31:59 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-fe0f471a-4732-4b60-9f26-cb570e74ab37 tempest-CinderUnicodeTest-1557671649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-04033805-d5a2-444f-87d9-b06d8a7a2a8b" returned: 0 in 0.374s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:31:59 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-fe0f471a-4732-4b60-9f26-cb570e74ab37 tempest-CinderUnicodeTest-1557671649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-04033805-d5a2-444f-87d9-b06d8a7a2a8b {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:31:59 devstack sudo[101681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-04033805-d5a2-444f-87d9-b06d8a7a2a8b Sep 16 20:31:59 devstack sudo[101681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:31:59 devstack sudo[101681]: pam_unix(sudo:session): session closed for user root Sep 16 20:31:59 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-fe0f471a-4732-4b60-9f26-cb570e74ab37 tempest-CinderUnicodeTest-1557671649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-04033805-d5a2-444f-87d9-b06d8a7a2a8b" returned: 0 in 0.243s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:31:59 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-fe0f471a-4732-4b60-9f26-cb570e74ab37 tempest-CinderUnicodeTest-1557671649 None] Lock "cinder-quobyte-04033805-d5a2-444f-87d9-b06d8a7a2a8b" released by "delete_volume" :: held 0.674s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:31:59 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-fe0f471a-4732-4b60-9f26-cb570e74ab37 tempest-CinderUnicodeTest-1557671649 None] Created reservations ['edf3ff07-c21c-49f3-833f-e0109003e970', '08b0368f-7f45-4b08-9216-f2d635c30695', 'df53570b-2c37-4d5f-9f53-7bd30f48f146', 'b02c90ad-e22b-4159-b371-1d1865a09382'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:31:59 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-fe0f471a-4732-4b60-9f26-cb570e74ab37 tempest-CinderUnicodeTest-1557671649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:31:59 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-fe0f471a-4732-4b60-9f26-cb570e74ab37 tempest-CinderUnicodeTest-1557671649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:31:59 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-fe0f471a-4732-4b60-9f26-cb570e74ab37 tempest-CinderUnicodeTest-1557671649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:31:59 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-fe0f471a-4732-4b60-9f26-cb570e74ab37 tempest-CinderUnicodeTest-1557671649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:31:59 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-fe0f471a-4732-4b60-9f26-cb570e74ab37 tempest-CinderUnicodeTest-1557671649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:31:59 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-fe0f471a-4732-4b60-9f26-cb570e74ab37 tempest-CinderUnicodeTest-1557671649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:31:59 devstack sudo[101684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:31:59 devstack sudo[101684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:31:59 devstack sudo[101684]: pam_unix(sudo:session): session closed for user root Sep 16 20:31:59 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-fe0f471a-4732-4b60-9f26-cb570e74ab37 tempest-CinderUnicodeTest-1557671649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.246s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:31:59 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-fe0f471a-4732-4b60-9f26-cb570e74ab37 tempest-CinderUnicodeTest-1557671649 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:31:59 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-fe0f471a-4732-4b60-9f26-cb570e74ab37 tempest-CinderUnicodeTest-1557671649 None] Deleted volume successfully. Sep 16 20:31:59 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-fe0f471a-4732-4b60-9f26-cb570e74ab37 tempest-CinderUnicodeTest-1557671649 None] Lock "cinder-04033805-d5a2-444f-87d9-b06d8a7a2a8b-delete_volume" released by "delete_volume" :: held 1.113s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:31:59 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-36ba1a81-8b70-4a10-afd6-e011e3d9d105 tempest-CinderUnicodeTest-1557671649 None] Acquiring lock "cinder-a3784362-38ba-4e00-9f5b-81676f41aea3-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:31:59 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-36ba1a81-8b70-4a10-afd6-e011e3d9d105 tempest-CinderUnicodeTest-1557671649 None] Lock "cinder-a3784362-38ba-4e00-9f5b-81676f41aea3-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:31:59 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-36ba1a81-8b70-4a10-afd6-e011e3d9d105 tempest-CinderUnicodeTest-1557671649 None] Acquiring lock "cinder-quobyte-a3784362-38ba-4e00-9f5b-81676f41aea3" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:31:59 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-36ba1a81-8b70-4a10-afd6-e011e3d9d105 tempest-CinderUnicodeTest-1557671649 None] Lock "cinder-quobyte-a3784362-38ba-4e00-9f5b-81676f41aea3" acquired by "delete_volume" :: waited 0.017s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:31:59 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[18d86645-4e62-418a-994a-c22278c9f54c]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:31:59 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-36ba1a81-8b70-4a10-afd6-e011e3d9d105 tempest-CinderUnicodeTest-1557671649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a3784362-38ba-4e00-9f5b-81676f41aea3 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:32:00 devstack sudo[101687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a3784362-38ba-4e00-9f5b-81676f41aea3 Sep 16 20:32:00 devstack sudo[101687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:32:00 devstack sudo[101687]: pam_unix(sudo:session): session closed for user root Sep 16 20:32:00 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-36ba1a81-8b70-4a10-afd6-e011e3d9d105 tempest-CinderUnicodeTest-1557671649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a3784362-38ba-4e00-9f5b-81676f41aea3" returned: 0 in 0.377s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:32:00 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-36ba1a81-8b70-4a10-afd6-e011e3d9d105 tempest-CinderUnicodeTest-1557671649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a3784362-38ba-4e00-9f5b-81676f41aea3 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:32:00 devstack sudo[101692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a3784362-38ba-4e00-9f5b-81676f41aea3 Sep 16 20:32:00 devstack sudo[101692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:32:00 devstack sudo[101692]: pam_unix(sudo:session): session closed for user root Sep 16 20:32:00 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-36ba1a81-8b70-4a10-afd6-e011e3d9d105 tempest-CinderUnicodeTest-1557671649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a3784362-38ba-4e00-9f5b-81676f41aea3" returned: 0 in 0.248s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:32:00 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-36ba1a81-8b70-4a10-afd6-e011e3d9d105 tempest-CinderUnicodeTest-1557671649 None] Lock "cinder-quobyte-a3784362-38ba-4e00-9f5b-81676f41aea3" released by "delete_volume" :: held 0.680s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:32:00 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-36ba1a81-8b70-4a10-afd6-e011e3d9d105 tempest-CinderUnicodeTest-1557671649 None] Created reservations ['92df209c-abf0-44af-b748-9358886b6b58', '1f453ee4-915b-4ddb-97ea-520e93216a42', '5a504015-7bd9-454e-bc37-2f3930a104c5', '14812387-1488-43da-b925-a40c0d64d088'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:32:00 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-36ba1a81-8b70-4a10-afd6-e011e3d9d105 tempest-CinderUnicodeTest-1557671649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:32:00 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-36ba1a81-8b70-4a10-afd6-e011e3d9d105 tempest-CinderUnicodeTest-1557671649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:32:00 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-36ba1a81-8b70-4a10-afd6-e011e3d9d105 tempest-CinderUnicodeTest-1557671649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:32:00 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-36ba1a81-8b70-4a10-afd6-e011e3d9d105 tempest-CinderUnicodeTest-1557671649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:32:00 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-36ba1a81-8b70-4a10-afd6-e011e3d9d105 tempest-CinderUnicodeTest-1557671649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:32:00 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-36ba1a81-8b70-4a10-afd6-e011e3d9d105 tempest-CinderUnicodeTest-1557671649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:32:00 devstack sudo[101695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:32:00 devstack sudo[101695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:32:01 devstack sudo[101695]: pam_unix(sudo:session): session closed for user root Sep 16 20:32:01 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-36ba1a81-8b70-4a10-afd6-e011e3d9d105 tempest-CinderUnicodeTest-1557671649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.282s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:32:01 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-36ba1a81-8b70-4a10-afd6-e011e3d9d105 tempest-CinderUnicodeTest-1557671649 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:32:01 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-36ba1a81-8b70-4a10-afd6-e011e3d9d105 tempest-CinderUnicodeTest-1557671649 None] Deleted volume successfully. Sep 16 20:32:01 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-36ba1a81-8b70-4a10-afd6-e011e3d9d105 tempest-CinderUnicodeTest-1557671649 None] Lock "cinder-a3784362-38ba-4e00-9f5b-81676f41aea3-delete_volume" released by "delete_volume" :: held 1.166s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:32:01 devstack cinder-volume[86188]: INFO cinder.volume.manager [req-f0845c71-3a22-4209-8691-d56a9a4755f4 req-fe199142-900b-4b52-b3aa-8d1aed9fcb28 tempest-TestServerVolumeAttachScenarioOldVersion-2085325911 None] Terminate volume connection completed successfully. Sep 16 20:32:01 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [req-f0845c71-3a22-4209-8691-d56a9a4755f4 req-fe199142-900b-4b52-b3aa-8d1aed9fcb28 tempest-TestServerVolumeAttachScenarioOldVersion-2085325911 None] Deleting attachment 66103d64-f019-497a-a100-c9b72dee76fd. {{(pid=86188) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 16 20:32:02 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-bbbb6629-8478-4821-8cd9-8577e05fcb49 tempest-TestServerVolumeAttachScenarioOldVersion-2085325911 None] Acquiring lock "cinder-020636f8-c505-4520-a172-69843a6e82af-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:32:02 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-bbbb6629-8478-4821-8cd9-8577e05fcb49 tempest-TestServerVolumeAttachScenarioOldVersion-2085325911 None] Lock "cinder-020636f8-c505-4520-a172-69843a6e82af-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:32:02 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-bbbb6629-8478-4821-8cd9-8577e05fcb49 tempest-TestServerVolumeAttachScenarioOldVersion-2085325911 None] Acquiring lock "cinder-quobyte-020636f8-c505-4520-a172-69843a6e82af" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:32:02 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-bbbb6629-8478-4821-8cd9-8577e05fcb49 tempest-TestServerVolumeAttachScenarioOldVersion-2085325911 None] Lock "cinder-quobyte-020636f8-c505-4520-a172-69843a6e82af" acquired by "delete_volume" :: waited 0.018s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:32:02 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cc7931a-e6ce-452f-9663-8d3df5d7cb8f]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:32:02 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-bbbb6629-8478-4821-8cd9-8577e05fcb49 tempest-TestServerVolumeAttachScenarioOldVersion-2085325911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-020636f8-c505-4520-a172-69843a6e82af {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:32:02 devstack sudo[101724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-020636f8-c505-4520-a172-69843a6e82af Sep 16 20:32:02 devstack sudo[101724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:32:02 devstack sudo[101724]: pam_unix(sudo:session): session closed for user root Sep 16 20:32:02 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-bbbb6629-8478-4821-8cd9-8577e05fcb49 tempest-TestServerVolumeAttachScenarioOldVersion-2085325911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-020636f8-c505-4520-a172-69843a6e82af" returned: 0 in 0.373s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:32:02 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-bbbb6629-8478-4821-8cd9-8577e05fcb49 tempest-TestServerVolumeAttachScenarioOldVersion-2085325911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-020636f8-c505-4520-a172-69843a6e82af {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:32:02 devstack sudo[101729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-020636f8-c505-4520-a172-69843a6e82af Sep 16 20:32:02 devstack sudo[101729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:32:02 devstack sudo[101729]: pam_unix(sudo:session): session closed for user root Sep 16 20:32:02 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-bbbb6629-8478-4821-8cd9-8577e05fcb49 tempest-TestServerVolumeAttachScenarioOldVersion-2085325911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-020636f8-c505-4520-a172-69843a6e82af" returned: 0 in 0.254s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:32:02 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-bbbb6629-8478-4821-8cd9-8577e05fcb49 tempest-TestServerVolumeAttachScenarioOldVersion-2085325911 None] Lock "cinder-quobyte-020636f8-c505-4520-a172-69843a6e82af" released by "delete_volume" :: held 0.694s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:32:02 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-bbbb6629-8478-4821-8cd9-8577e05fcb49 tempest-TestServerVolumeAttachScenarioOldVersion-2085325911 None] Created reservations ['7d517dd9-a521-4f03-810e-a7a84cab3673', '5065db82-a94d-4bf7-b3fa-a800d6e0b875', '4125618f-a095-4e45-9381-d725e248f572', 'df23cc30-b6c2-4d93-b00d-f5788e4af5fa'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:32:03 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-bbbb6629-8478-4821-8cd9-8577e05fcb49 tempest-TestServerVolumeAttachScenarioOldVersion-2085325911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:32:03 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-bbbb6629-8478-4821-8cd9-8577e05fcb49 tempest-TestServerVolumeAttachScenarioOldVersion-2085325911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:32:03 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-bbbb6629-8478-4821-8cd9-8577e05fcb49 tempest-TestServerVolumeAttachScenarioOldVersion-2085325911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:32:03 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-bbbb6629-8478-4821-8cd9-8577e05fcb49 tempest-TestServerVolumeAttachScenarioOldVersion-2085325911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:32:03 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-bbbb6629-8478-4821-8cd9-8577e05fcb49 tempest-TestServerVolumeAttachScenarioOldVersion-2085325911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:32:03 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-bbbb6629-8478-4821-8cd9-8577e05fcb49 tempest-TestServerVolumeAttachScenarioOldVersion-2085325911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:32:03 devstack sudo[101732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:32:03 devstack sudo[101732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:32:03 devstack sudo[101732]: pam_unix(sudo:session): session closed for user root Sep 16 20:32:03 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-bbbb6629-8478-4821-8cd9-8577e05fcb49 tempest-TestServerVolumeAttachScenarioOldVersion-2085325911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.327s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:32:03 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-bbbb6629-8478-4821-8cd9-8577e05fcb49 tempest-TestServerVolumeAttachScenarioOldVersion-2085325911 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:32:03 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-bbbb6629-8478-4821-8cd9-8577e05fcb49 tempest-TestServerVolumeAttachScenarioOldVersion-2085325911 None] Deleted volume successfully. Sep 16 20:32:03 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-bbbb6629-8478-4821-8cd9-8577e05fcb49 tempest-TestServerVolumeAttachScenarioOldVersion-2085325911 None] Lock "cinder-020636f8-c505-4520-a172-69843a6e82af-delete_volume" released by "delete_volume" :: held 1.267s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:32:07 devstack cinder-volume[86188]: DEBUG dbcounter [-] [86188] Writing DB stats cinder:UPDATE=115,cinder:SELECT=86,cinder:INSERT=33,cinder:DELETE=9 {{(pid=86188) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 20:32:07 devstack cinder-volume[86188]: DEBUG dbcounter [-] [86188] Writing DB stats cinder:SELECT=101,cinder:INSERT=31,cinder:UPDATE=126,cinder:DELETE=13 {{(pid=86188) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 20:32:07 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [req-905efd33-cde9-4fa2-bd25-4f8e9e252072 req-cc2203bd-afb1-4e0a-8ca4-e04598cd6ebc tempest-TestServerVolumeAttachmentScenario-117009106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:32:07 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [req-905efd33-cde9-4fa2-bd25-4f8e9e252072 req-cc2203bd-afb1-4e0a-8ca4-e04598cd6ebc tempest-TestServerVolumeAttachmentScenario-117009106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:32:07 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [req-905efd33-cde9-4fa2-bd25-4f8e9e252072 req-cc2203bd-afb1-4e0a-8ca4-e04598cd6ebc tempest-TestServerVolumeAttachmentScenario-117009106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:32:07 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [req-905efd33-cde9-4fa2-bd25-4f8e9e252072 req-cc2203bd-afb1-4e0a-8ca4-e04598cd6ebc tempest-TestServerVolumeAttachmentScenario-117009106 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81', 'name': 'volume-930e07b9-1719-4098-b8fd-6023842fd7ab', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e544e3fd-f112-40f7-9509-42e7d9cf7882', 'enforce_multipath': True} {{(pid=86188) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 16 20:32:07 devstack cinder-volume[86188]: INFO cinder.volume.manager [req-905efd33-cde9-4fa2-bd25-4f8e9e252072 req-cc2203bd-afb1-4e0a-8ca4-e04598cd6ebc tempest-TestServerVolumeAttachmentScenario-117009106 None] attachment_update completed successfully. Sep 16 20:32:12 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [req-0ebc0f09-ff15-4a8d-a822-b2ed269c5050 req-706ce821-41a0-4d69-b0e7-b9c3cdbda138 tempest-TestServerVolumeAttachmentScenario-117009106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:32:12 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [req-0ebc0f09-ff15-4a8d-a822-b2ed269c5050 req-706ce821-41a0-4d69-b0e7-b9c3cdbda138 tempest-TestServerVolumeAttachmentScenario-117009106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:32:12 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [req-0ebc0f09-ff15-4a8d-a822-b2ed269c5050 req-706ce821-41a0-4d69-b0e7-b9c3cdbda138 tempest-TestServerVolumeAttachmentScenario-117009106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:32:12 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [req-0ebc0f09-ff15-4a8d-a822-b2ed269c5050 req-706ce821-41a0-4d69-b0e7-b9c3cdbda138 tempest-TestServerVolumeAttachmentScenario-117009106 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81', 'name': 'volume-f319e490-f6ba-4041-9455-844f5fc1c54e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b7489e9b-2231-4127-98e1-013c14305db2', 'enforce_multipath': True} {{(pid=86188) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 16 20:32:12 devstack cinder-volume[86188]: INFO cinder.volume.manager [req-0ebc0f09-ff15-4a8d-a822-b2ed269c5050 req-706ce821-41a0-4d69-b0e7-b9c3cdbda138 tempest-TestServerVolumeAttachmentScenario-117009106 None] attachment_update completed successfully. Sep 16 20:32:14 devstack cinder-volume[86188]: INFO cinder.volume.manager [req-010297e8-4c09-4562-a30e-554030ad88cc req-c0e25caa-3963-42d3-af94-41f22724bef2 tempest-TestServerVolumeAttachmentScenario-117009106 None] Terminate volume connection completed successfully. Sep 16 20:32:14 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [req-010297e8-4c09-4562-a30e-554030ad88cc req-c0e25caa-3963-42d3-af94-41f22724bef2 tempest-TestServerVolumeAttachmentScenario-117009106 None] Deleting attachment b7489e9b-2231-4127-98e1-013c14305db2. {{(pid=86188) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 16 20:32:15 devstack cinder-volume[86188]: INFO cinder.volume.manager [req-277f93cf-75e5-42e7-b8b9-460146723b72 req-49f4fb2d-cf27-4289-a6eb-258e8053bdf1 tempest-TestServerVolumeAttachmentScenario-117009106 None] Terminate volume connection completed successfully. Sep 16 20:32:15 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [req-277f93cf-75e5-42e7-b8b9-460146723b72 req-49f4fb2d-cf27-4289-a6eb-258e8053bdf1 tempest-TestServerVolumeAttachmentScenario-117009106 None] Deleting attachment e544e3fd-f112-40f7-9509-42e7d9cf7882. {{(pid=86188) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 16 20:32:20 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-c6c6e22a-4721-4c2f-9f22-73922ecb592f tempest-TestServerVolumeAttachmentScenario-117009106 None] Acquiring lock "cinder-f319e490-f6ba-4041-9455-844f5fc1c54e-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:32:20 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-c6c6e22a-4721-4c2f-9f22-73922ecb592f tempest-TestServerVolumeAttachmentScenario-117009106 None] Lock "cinder-f319e490-f6ba-4041-9455-844f5fc1c54e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:32:20 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-c6c6e22a-4721-4c2f-9f22-73922ecb592f tempest-TestServerVolumeAttachmentScenario-117009106 None] Acquiring lock "cinder-quobyte-f319e490-f6ba-4041-9455-844f5fc1c54e" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:32:20 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-c6c6e22a-4721-4c2f-9f22-73922ecb592f tempest-TestServerVolumeAttachmentScenario-117009106 None] Lock "cinder-quobyte-f319e490-f6ba-4041-9455-844f5fc1c54e" acquired by "delete_volume" :: waited 0.017s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:32:20 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[94eab14d-98a2-4390-b9dc-012869756793]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:32:20 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-c6c6e22a-4721-4c2f-9f22-73922ecb592f tempest-TestServerVolumeAttachmentScenario-117009106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-f319e490-f6ba-4041-9455-844f5fc1c54e {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:32:20 devstack sudo[102272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-f319e490-f6ba-4041-9455-844f5fc1c54e Sep 16 20:32:20 devstack sudo[102272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:32:20 devstack sudo[102272]: pam_unix(sudo:session): session closed for user root Sep 16 20:32:20 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-c6c6e22a-4721-4c2f-9f22-73922ecb592f tempest-TestServerVolumeAttachmentScenario-117009106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-f319e490-f6ba-4041-9455-844f5fc1c54e" returned: 0 in 0.356s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:32:20 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-c6c6e22a-4721-4c2f-9f22-73922ecb592f tempest-TestServerVolumeAttachmentScenario-117009106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-f319e490-f6ba-4041-9455-844f5fc1c54e {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:32:20 devstack sudo[102277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-f319e490-f6ba-4041-9455-844f5fc1c54e Sep 16 20:32:20 devstack sudo[102277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:32:20 devstack sudo[102277]: pam_unix(sudo:session): session closed for user root Sep 16 20:32:20 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-c6c6e22a-4721-4c2f-9f22-73922ecb592f tempest-TestServerVolumeAttachmentScenario-117009106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-f319e490-f6ba-4041-9455-844f5fc1c54e" returned: 0 in 0.253s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:32:20 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-c6c6e22a-4721-4c2f-9f22-73922ecb592f tempest-TestServerVolumeAttachmentScenario-117009106 None] Lock "cinder-quobyte-f319e490-f6ba-4041-9455-844f5fc1c54e" released by "delete_volume" :: held 0.657s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:32:20 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-c6c6e22a-4721-4c2f-9f22-73922ecb592f tempest-TestServerVolumeAttachmentScenario-117009106 None] Created reservations ['b3130f1c-54ab-43ab-bdbd-c5971a997651', '216f2a2a-88d2-4b7c-adc6-a801cc4a7402', '088907c4-d6ab-42be-b838-1b1298d790c5', 'fe312cea-f007-4d04-9cec-d3757a237207'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:32:21 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-c6c6e22a-4721-4c2f-9f22-73922ecb592f tempest-TestServerVolumeAttachmentScenario-117009106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:32:21 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-c6c6e22a-4721-4c2f-9f22-73922ecb592f tempest-TestServerVolumeAttachmentScenario-117009106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:32:21 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-c6c6e22a-4721-4c2f-9f22-73922ecb592f tempest-TestServerVolumeAttachmentScenario-117009106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:32:21 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-c6c6e22a-4721-4c2f-9f22-73922ecb592f tempest-TestServerVolumeAttachmentScenario-117009106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:32:21 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-c6c6e22a-4721-4c2f-9f22-73922ecb592f tempest-TestServerVolumeAttachmentScenario-117009106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:32:21 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-c6c6e22a-4721-4c2f-9f22-73922ecb592f tempest-TestServerVolumeAttachmentScenario-117009106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:32:21 devstack sudo[102280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:32:21 devstack sudo[102280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:32:21 devstack sudo[102280]: pam_unix(sudo:session): session closed for user root Sep 16 20:32:21 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-c6c6e22a-4721-4c2f-9f22-73922ecb592f tempest-TestServerVolumeAttachmentScenario-117009106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.264s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:32:21 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-c6c6e22a-4721-4c2f-9f22-73922ecb592f tempest-TestServerVolumeAttachmentScenario-117009106 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:32:21 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-c6c6e22a-4721-4c2f-9f22-73922ecb592f tempest-TestServerVolumeAttachmentScenario-117009106 None] Deleted volume successfully. Sep 16 20:32:21 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-c6c6e22a-4721-4c2f-9f22-73922ecb592f tempest-TestServerVolumeAttachmentScenario-117009106 None] Lock "cinder-f319e490-f6ba-4041-9455-844f5fc1c54e-delete_volume" released by "delete_volume" :: held 1.148s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:32:21 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-eed08ecc-5708-427c-99a8-7f77b4eaca94 tempest-TestServerVolumeAttachmentScenario-117009106 None] Acquiring lock "cinder-930e07b9-1719-4098-b8fd-6023842fd7ab-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:32:21 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-eed08ecc-5708-427c-99a8-7f77b4eaca94 tempest-TestServerVolumeAttachmentScenario-117009106 None] Lock "cinder-930e07b9-1719-4098-b8fd-6023842fd7ab-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:32:21 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-eed08ecc-5708-427c-99a8-7f77b4eaca94 tempest-TestServerVolumeAttachmentScenario-117009106 None] Acquiring lock "cinder-quobyte-930e07b9-1719-4098-b8fd-6023842fd7ab" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:32:21 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-eed08ecc-5708-427c-99a8-7f77b4eaca94 tempest-TestServerVolumeAttachmentScenario-117009106 None] Lock "cinder-quobyte-930e07b9-1719-4098-b8fd-6023842fd7ab" acquired by "delete_volume" :: waited 0.018s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:32:21 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bd4147e-bc96-4bf5-9c82-58c0df6974c6]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:32:21 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-eed08ecc-5708-427c-99a8-7f77b4eaca94 tempest-TestServerVolumeAttachmentScenario-117009106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-930e07b9-1719-4098-b8fd-6023842fd7ab {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:32:21 devstack sudo[102283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-930e07b9-1719-4098-b8fd-6023842fd7ab Sep 16 20:32:21 devstack sudo[102283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:32:21 devstack sudo[102283]: pam_unix(sudo:session): session closed for user root Sep 16 20:32:21 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-eed08ecc-5708-427c-99a8-7f77b4eaca94 tempest-TestServerVolumeAttachmentScenario-117009106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-930e07b9-1719-4098-b8fd-6023842fd7ab" returned: 0 in 0.379s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:32:21 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-eed08ecc-5708-427c-99a8-7f77b4eaca94 tempest-TestServerVolumeAttachmentScenario-117009106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-930e07b9-1719-4098-b8fd-6023842fd7ab {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:32:21 devstack sudo[102288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-930e07b9-1719-4098-b8fd-6023842fd7ab Sep 16 20:32:21 devstack sudo[102288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:32:22 devstack sudo[102288]: pam_unix(sudo:session): session closed for user root Sep 16 20:32:22 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-eed08ecc-5708-427c-99a8-7f77b4eaca94 tempest-TestServerVolumeAttachmentScenario-117009106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-930e07b9-1719-4098-b8fd-6023842fd7ab" returned: 0 in 0.283s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:32:22 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-eed08ecc-5708-427c-99a8-7f77b4eaca94 tempest-TestServerVolumeAttachmentScenario-117009106 None] Lock "cinder-quobyte-930e07b9-1719-4098-b8fd-6023842fd7ab" released by "delete_volume" :: held 0.710s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:32:22 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-eed08ecc-5708-427c-99a8-7f77b4eaca94 tempest-TestServerVolumeAttachmentScenario-117009106 None] Created reservations ['8e72a2af-0221-4241-b52e-ec4a7fa520c1', 'e5301472-fd77-4f90-86a0-9728a5e0b62e', '3d455b70-1e08-41db-b801-865c8f42d69c', '9d548347-06c8-4561-8499-0d8ab02486ad'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:32:22 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-eed08ecc-5708-427c-99a8-7f77b4eaca94 tempest-TestServerVolumeAttachmentScenario-117009106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:32:22 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-eed08ecc-5708-427c-99a8-7f77b4eaca94 tempest-TestServerVolumeAttachmentScenario-117009106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:32:22 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-eed08ecc-5708-427c-99a8-7f77b4eaca94 tempest-TestServerVolumeAttachmentScenario-117009106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:32:22 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-eed08ecc-5708-427c-99a8-7f77b4eaca94 tempest-TestServerVolumeAttachmentScenario-117009106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:32:22 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-eed08ecc-5708-427c-99a8-7f77b4eaca94 tempest-TestServerVolumeAttachmentScenario-117009106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:32:22 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-eed08ecc-5708-427c-99a8-7f77b4eaca94 tempest-TestServerVolumeAttachmentScenario-117009106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:32:22 devstack sudo[102291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:32:22 devstack sudo[102291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:32:22 devstack sudo[102291]: pam_unix(sudo:session): session closed for user root Sep 16 20:32:22 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-eed08ecc-5708-427c-99a8-7f77b4eaca94 tempest-TestServerVolumeAttachmentScenario-117009106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.254s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:32:22 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-eed08ecc-5708-427c-99a8-7f77b4eaca94 tempest-TestServerVolumeAttachmentScenario-117009106 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:32:22 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-eed08ecc-5708-427c-99a8-7f77b4eaca94 tempest-TestServerVolumeAttachmentScenario-117009106 None] Deleted volume successfully. Sep 16 20:32:22 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-eed08ecc-5708-427c-99a8-7f77b4eaca94 tempest-TestServerVolumeAttachmentScenario-117009106 None] Lock "cinder-930e07b9-1719-4098-b8fd-6023842fd7ab-delete_volume" released by "delete_volume" :: held 1.180s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:32:32 devstack cinder-volume[86188]: DEBUG dbcounter [-] [86188] Writing DB stats cinder:SELECT=26,cinder:UPDATE=16,cinder:INSERT=4,cinder:DELETE=1 {{(pid=86188) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 20:32:32 devstack cinder-volume[86188]: DEBUG dbcounter [-] [86188] Writing DB stats cinder:UPDATE=22,cinder:SELECT=22,cinder:INSERT=4,cinder:DELETE=1 {{(pid=86188) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 20:32:45 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3b1dda0-a76b-40a0-90f3-4ca59712f7c6 tempest-TestShelveInstance-1578816192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:32:45 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-c3b1dda0-a76b-40a0-90f3-4ca59712f7c6 tempest-TestShelveInstance-1578816192 None] Flow 'volume_create_manager' (568d1d6e-dc26-4e54-8efa-49c741ec7b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:32:45 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-c3b1dda0-a76b-40a0-90f3-4ca59712f7c6 tempest-TestShelveInstance-1578816192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63b55a9f-12ac-43ca-958f-b48519495dbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:32:45 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-c3b1dda0-a76b-40a0-90f3-4ca59712f7c6 tempest-TestShelveInstance-1578816192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63b55a9f-12ac-43ca-958f-b48519495dbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:32:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1637857938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84a61fd6-7a7e-4b77-9020-a29c5ad9c695,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='906d845fa7874522b4cdfe4719a71bfe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:32:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:32:45Z,use_quota=True,user_id='f00275cdd7fc455783718a6cc467ede7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:32:45 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-c3b1dda0-a76b-40a0-90f3-4ca59712f7c6 tempest-TestShelveInstance-1578816192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41df2ef5-c067-4c0e-8f46-2754a4578ca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:32:45 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-c3b1dda0-a76b-40a0-90f3-4ca59712f7c6 tempest-TestShelveInstance-1578816192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41df2ef5-c067-4c0e-8f46-2754a4578ca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:32:45 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-c3b1dda0-a76b-40a0-90f3-4ca59712f7c6 tempest-TestShelveInstance-1578816192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9199102e-b43a-4903-b15d-59943e2833c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:32:45 devstack cinder-volume[86188]: DEBUG cinder.image.glance [None req-c3b1dda0-a76b-40a0-90f3-4ca59712f7c6 tempest-TestShelveInstance-1578816192 None] Creating Keystone auth plugin from conf {{(pid=86188) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 16 20:32:45 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-c3b1dda0-a76b-40a0-90f3-4ca59712f7c6 tempest-TestShelveInstance-1578816192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9199102e-b43a-4903-b15d-59943e2833c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '84a61fd6-7a7e-4b77-9020-a29c5ad9c695', 'volume_name': 'volume-84a61fd6-7a7e-4b77-9020-a29c5ad9c695', 'volume_size': 1, 'image_id': 'b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5c9c8eab814247029b6d508a74a1d19e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e', 'created_at': datetime.datetime(2026, 9, 16, 18, 12, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 18, 12, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:32:45 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-c3b1dda0-a76b-40a0-90f3-4ca59712f7c6 tempest-TestShelveInstance-1578816192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06e8338f-8e4d-418b-9ca0-3e2bf65662fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:32:45 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-c3b1dda0-a76b-40a0-90f3-4ca59712f7c6 tempest-TestShelveInstance-1578816192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06e8338f-8e4d-418b-9ca0-3e2bf65662fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:32:45 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-c3b1dda0-a76b-40a0-90f3-4ca59712f7c6 tempest-TestShelveInstance-1578816192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c30b773d-bc1e-4937-83a5-b820bf36d16d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:32:45 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-c3b1dda0-a76b-40a0-90f3-4ca59712f7c6 tempest-TestShelveInstance-1578816192 None] Volume 84a61fd6-7a7e-4b77-9020-a29c5ad9c695: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-84a61fd6-7a7e-4b77-9020-a29c5ad9c695', 'volume_size': 1, 'image_id': 'b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5c9c8eab814247029b6d508a74a1d19e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e', 'created_at': datetime.datetime(2026, 9, 16, 18, 12, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 18, 12, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 16 20:32:45 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3b1dda0-a76b-40a0-90f3-4ca59712f7c6 tempest-TestShelveInstance-1578816192 None] Trying to clone 84a61fd6-7a7e-4b77-9020-a29c5ad9c695 from image b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e at location (None, [{'url': 'file:///opt/stack/data/glance/images/b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e', 'metadata': {}}]). {{(pid=86188) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 16 20:32:46 devstack cinder-volume[86188]: DEBUG cinder.image.image_utils [None req-c3b1dda0-a76b-40a0-90f3-4ca59712f7c6 tempest-TestShelveInstance-1578816192 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e_3n7xy27odevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86188) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 16 20:32:46 devstack cinder-volume[86188]: INFO cinder.image.image_utils [None req-c3b1dda0-a76b-40a0-90f3-4ca59712f7c6 tempest-TestShelveInstance-1578816192 None] Image download 20.69 MB at 20.69 MB/s Sep 16 20:32:46 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[efc0f537-12c3-4a98-ba14-035b449d9f86]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:32:46 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-c3b1dda0-a76b-40a0-90f3-4ca59712f7c6 tempest-TestShelveInstance-1578816192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e_3n7xy27odevstack@QuobyteHD {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:32:46 devstack sudo[102305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e_3n7xy27odevstack@QuobyteHD Sep 16 20:32:46 devstack sudo[102305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:32:46 devstack sudo[102305]: pam_unix(sudo:session): session closed for user root Sep 16 20:32:46 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-c3b1dda0-a76b-40a0-90f3-4ca59712f7c6 tempest-TestShelveInstance-1578816192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e_3n7xy27odevstack@QuobyteHD" returned: 0 in 0.388s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:32:46 devstack cinder-volume[86188]: DEBUG cinder.image.image_utils [None req-c3b1dda0-a76b-40a0-90f3-4ca59712f7c6 tempest-TestShelveInstance-1578816192 None] Temporary image b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e is fetched for user f00275cdd7fc455783718a6cc467ede7. {{(pid=86188) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 16 20:32:46 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddbad1e1-5dae-4fee-90b9-0aba44a8919f]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:32:46 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-c3b1dda0-a76b-40a0-90f3-4ca59712f7c6 tempest-TestShelveInstance-1578816192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e_3n7xy27odevstack@QuobyteHD {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:32:46 devstack sudo[102310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e_3n7xy27odevstack@QuobyteHD Sep 16 20:32:46 devstack sudo[102310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:32:47 devstack sudo[102310]: pam_unix(sudo:session): session closed for user root Sep 16 20:32:47 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-c3b1dda0-a76b-40a0-90f3-4ca59712f7c6 tempest-TestShelveInstance-1578816192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e_3n7xy27odevstack@QuobyteHD" returned: 0 in 0.330s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:32:47 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-c3b1dda0-a76b-40a0-90f3-4ca59712f7c6 tempest-TestShelveInstance-1578816192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:32:47 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-c3b1dda0-a76b-40a0-90f3-4ca59712f7c6 tempest-TestShelveInstance-1578816192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:32:47 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-c3b1dda0-a76b-40a0-90f3-4ca59712f7c6 tempest-TestShelveInstance-1578816192 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:32:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1637857938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84a61fd6-7a7e-4b77-9020-a29c5ad9c695,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='906d845fa7874522b4cdfe4719a71bfe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:32:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:32:45Z,use_quota=True,user_id='f00275cdd7fc455783718a6cc467ede7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:32:47 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-c3b1dda0-a76b-40a0-90f3-4ca59712f7c6 tempest-TestShelveInstance-1578816192 None] Creating volume 84a61fd6-7a7e-4b77-9020-a29c5ad9c695 {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:32:47 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-c3b1dda0-a76b-40a0-90f3-4ca59712f7c6 tempest-TestShelveInstance-1578816192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:32:47 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-c3b1dda0-a76b-40a0-90f3-4ca59712f7c6 tempest-TestShelveInstance-1578816192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:32:47 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-c3b1dda0-a76b-40a0-90f3-4ca59712f7c6 tempest-TestShelveInstance-1578816192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:32:47 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-c3b1dda0-a76b-40a0-90f3-4ca59712f7c6 tempest-TestShelveInstance-1578816192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:32:47 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-c3b1dda0-a76b-40a0-90f3-4ca59712f7c6 tempest-TestShelveInstance-1578816192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:32:47 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-c3b1dda0-a76b-40a0-90f3-4ca59712f7c6 tempest-TestShelveInstance-1578816192 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:32:47 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-c3b1dda0-a76b-40a0-90f3-4ca59712f7c6 tempest-TestShelveInstance-1578816192 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:32:47 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-c3b1dda0-a76b-40a0-90f3-4ca59712f7c6 tempest-TestShelveInstance-1578816192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-84a61fd6-7a7e-4b77-9020-a29c5ad9c695 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:32:47 devstack sudo[102316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-84a61fd6-7a7e-4b77-9020-a29c5ad9c695 1073741824 Sep 16 20:32:47 devstack sudo[102316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:32:47 devstack sudo[102316]: pam_unix(sudo:session): session closed for user root Sep 16 20:32:47 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-c3b1dda0-a76b-40a0-90f3-4ca59712f7c6 tempest-TestShelveInstance-1578816192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-84a61fd6-7a7e-4b77-9020-a29c5ad9c695 1073741824" returned: 0 in 0.449s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:32:47 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-c3b1dda0-a76b-40a0-90f3-4ca59712f7c6 tempest-TestShelveInstance-1578816192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-84a61fd6-7a7e-4b77-9020-a29c5ad9c695 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:32:47 devstack sudo[102322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-84a61fd6-7a7e-4b77-9020-a29c5ad9c695 Sep 16 20:32:47 devstack sudo[102322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:32:47 devstack sudo[102322]: pam_unix(sudo:session): session closed for user root Sep 16 20:32:47 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-c3b1dda0-a76b-40a0-90f3-4ca59712f7c6 tempest-TestShelveInstance-1578816192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-84a61fd6-7a7e-4b77-9020-a29c5ad9c695" returned: 0 in 0.255s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:32:47 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-c3b1dda0-a76b-40a0-90f3-4ca59712f7c6 tempest-TestShelveInstance-1578816192 None] <== create_volume: return (772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:32:47 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-c3b1dda0-a76b-40a0-90f3-4ca59712f7c6 tempest-TestShelveInstance-1578816192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.775s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:32:47 devstack cinder-volume[86188]: DEBUG cinder.volume.volume_utils [None req-c3b1dda0-a76b-40a0-90f3-4ca59712f7c6 tempest-TestShelveInstance-1578816192 None] Attempting download of b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e ((None, [{'url': 'file:///opt/stack/data/glance/images/b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e', 'metadata': {}}])) to volume 84a61fd6-7a7e-4b77-9020-a29c5ad9c695. {{(pid=86188) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 16 20:32:48 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3e19469-d3cd-4131-93ad-ae4efa5aa7e4]: (4, 'raw') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:32:48 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-c3b1dda0-a76b-40a0-90f3-4ca59712f7c6 tempest-TestShelveInstance-1578816192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e_44y5e4j0 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:32:48 devstack sudo[102325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e_44y5e4j0 Sep 16 20:32:48 devstack sudo[102325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:32:48 devstack sudo[102325]: pam_unix(sudo:session): session closed for user root Sep 16 20:32:48 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-c3b1dda0-a76b-40a0-90f3-4ca59712f7c6 tempest-TestShelveInstance-1578816192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e_44y5e4j0" returned: 0 in 0.341s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:32:48 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-c3b1dda0-a76b-40a0-90f3-4ca59712f7c6 tempest-TestShelveInstance-1578816192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e_44y5e4j0 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:32:48 devstack sudo[102329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e_44y5e4j0 Sep 16 20:32:48 devstack sudo[102329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:32:48 devstack sudo[102329]: pam_unix(sudo:session): session closed for user root Sep 16 20:32:48 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-c3b1dda0-a76b-40a0-90f3-4ca59712f7c6 tempest-TestShelveInstance-1578816192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e_44y5e4j0" returned: 1 in 0.345s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:32:48 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-c3b1dda0-a76b-40a0-90f3-4ca59712f7c6 tempest-TestShelveInstance-1578816192 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e_44y5e4j0' failed. Not Retrying. {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 16 20:32:48 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[38f69992-3d39-498e-a507-73bcf5a04740]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:32:48 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-c3b1dda0-a76b-40a0-90f3-4ca59712f7c6 tempest-TestShelveInstance-1578816192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e_3n7xy27odevstack@QuobyteHD {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:32:48 devstack sudo[102333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e_3n7xy27odevstack@QuobyteHD Sep 16 20:32:48 devstack sudo[102333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:32:49 devstack sudo[102333]: pam_unix(sudo:session): session closed for user root Sep 16 20:32:49 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-c3b1dda0-a76b-40a0-90f3-4ca59712f7c6 tempest-TestShelveInstance-1578816192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e_3n7xy27odevstack@QuobyteHD" returned: 0 in 0.335s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:32:49 devstack cinder-volume[86188]: DEBUG cinder.image.image_utils [None req-c3b1dda0-a76b-40a0-90f3-4ca59712f7c6 tempest-TestShelveInstance-1578816192 None] b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e was qcow2, converting to qcow2 {{(pid=86188) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 16 20:32:49 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-c3b1dda0-a76b-40a0-90f3-4ca59712f7c6 tempest-TestShelveInstance-1578816192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e_3n7xy27odevstack@QuobyteHD /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-84a61fd6-7a7e-4b77-9020-a29c5ad9c695 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:32:49 devstack sudo[102339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e_3n7xy27odevstack@QuobyteHD /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-84a61fd6-7a7e-4b77-9020-a29c5ad9c695 Sep 16 20:32:49 devstack sudo[102339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:32:50 devstack sudo[102339]: pam_unix(sudo:session): session closed for user root Sep 16 20:32:50 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-c3b1dda0-a76b-40a0-90f3-4ca59712f7c6 tempest-TestShelveInstance-1578816192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e_3n7xy27odevstack@QuobyteHD /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-84a61fd6-7a7e-4b77-9020-a29c5ad9c695" returned: 0 in 1.907s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:32:50 devstack cinder-volume[86188]: DEBUG cinder.image.image_utils [None req-c3b1dda0-a76b-40a0-90f3-4ca59712f7c6 tempest-TestShelveInstance-1578816192 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e_3n7xy27odevstack@QuobyteHD, size 112.00 MB, duration 1.91 sec, destination /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-84a61fd6-7a7e-4b77-9020-a29c5ad9c695 {{(pid=86188) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 16 20:32:50 devstack cinder-volume[86188]: INFO cinder.image.image_utils [None req-c3b1dda0-a76b-40a0-90f3-4ca59712f7c6 tempest-TestShelveInstance-1578816192 None] Converted 112.00 MB image at 58.70 MB/s Sep 16 20:32:50 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-c3b1dda0-a76b-40a0-90f3-4ca59712f7c6 tempest-TestShelveInstance-1578816192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-84a61fd6-7a7e-4b77-9020-a29c5ad9c695 1G {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:32:50 devstack sudo[102348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-84a61fd6-7a7e-4b77-9020-a29c5ad9c695 1G Sep 16 20:32:50 devstack sudo[102348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:32:51 devstack sudo[102348]: pam_unix(sudo:session): session closed for user root Sep 16 20:32:51 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-c3b1dda0-a76b-40a0-90f3-4ca59712f7c6 tempest-TestShelveInstance-1578816192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-84a61fd6-7a7e-4b77-9020-a29c5ad9c695 1G" returned: 0 in 0.433s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:32:51 devstack cinder-volume[86188]: DEBUG cinder.volume.volume_utils [None req-c3b1dda0-a76b-40a0-90f3-4ca59712f7c6 tempest-TestShelveInstance-1578816192 None] Downloaded image b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e ((None, [{'url': 'file:///opt/stack/data/glance/images/b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e', 'metadata': {}}])) to volume 84a61fd6-7a7e-4b77-9020-a29c5ad9c695 successfully. {{(pid=86188) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 16 20:32:51 devstack cinder-volume[86188]: DEBUG cinder.image.image_utils [None req-c3b1dda0-a76b-40a0-90f3-4ca59712f7c6 tempest-TestShelveInstance-1578816192 None] Temporary image b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e for user f00275cdd7fc455783718a6cc467ede7 is deleted. {{(pid=86188) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 16 20:32:51 devstack cinder-volume[86188]: DEBUG cinder.volume.volume_utils [None req-c3b1dda0-a76b-40a0-90f3-4ca59712f7c6 tempest-TestShelveInstance-1578816192 None] Marking volume 84a61fd6-7a7e-4b77-9020-a29c5ad9c695 as bootable. {{(pid=86188) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 16 20:32:51 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3b1dda0-a76b-40a0-90f3-4ca59712f7c6 tempest-TestShelveInstance-1578816192 None] Copying metadata from image b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e to 84a61fd6-7a7e-4b77-9020-a29c5ad9c695. {{(pid=86188) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 16 20:32:51 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3b1dda0-a76b-40a0-90f3-4ca59712f7c6 tempest-TestShelveInstance-1578816192 None] Creating volume glance metadata for volume 84a61fd6-7a7e-4b77-9020-a29c5ad9c695 backed by image b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86188) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 16 20:32:51 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-c3b1dda0-a76b-40a0-90f3-4ca59712f7c6 tempest-TestShelveInstance-1578816192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c30b773d-bc1e-4937-83a5-b820bf36d16d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84a61fd6-7a7e-4b77-9020-a29c5ad9c695', 'volume_size': 1, 'image_id': 'b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5c9c8eab814247029b6d508a74a1d19e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e', 'created_at': datetime.datetime(2026, 9, 16, 18, 12, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 18, 12, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b0d09d8b-6b3e-4ddd-ae86-db6864e83f2e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:32:51 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-c3b1dda0-a76b-40a0-90f3-4ca59712f7c6 tempest-TestShelveInstance-1578816192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f9b8362-ac50-4c15-94d8-d18e49089175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:32:51 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-c3b1dda0-a76b-40a0-90f3-4ca59712f7c6 tempest-TestShelveInstance-1578816192 None] Volume volume-84a61fd6-7a7e-4b77-9020-a29c5ad9c695 (84a61fd6-7a7e-4b77-9020-a29c5ad9c695): created successfully Sep 16 20:32:51 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-c3b1dda0-a76b-40a0-90f3-4ca59712f7c6 tempest-TestShelveInstance-1578816192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f9b8362-ac50-4c15-94d8-d18e49089175) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:32:51 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-c3b1dda0-a76b-40a0-90f3-4ca59712f7c6 tempest-TestShelveInstance-1578816192 None] Flow 'volume_create_manager' (568d1d6e-dc26-4e54-8efa-49c741ec7b23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:32:51 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-c3b1dda0-a76b-40a0-90f3-4ca59712f7c6 tempest-TestShelveInstance-1578816192 None] Created volume successfully. Sep 16 20:32:53 devstack cinder-volume[86188]: DEBUG oslo_service.periodic_task [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86188) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 20:32:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:32:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:32:53 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:32:53 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:32:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:32:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:32:53 devstack sudo[102356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:32:53 devstack sudo[102356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:32:53 devstack sudo[102356]: pam_unix(sudo:session): session closed for user root Sep 16 20:32:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.283s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:32:53 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:32:53 devstack cinder-volume[86188]: DEBUG oslo_service.periodic_task [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Running periodic task VolumeManager._thread_info {{(pid=86188) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 20:32:53 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] thread count: 28 {{(pid=86188) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 16 20:32:53 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] thread info: [<_MainThread(MainThread, started 139858124406912)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86188) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 16 20:32:54 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [req-c7afe299-315c-4616-9a9a-f8006a00c689 req-e73b1321-ff4e-4ff5-86bd-0a42b8e96cee tempest-TestShelveInstance-1578816192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:32:54 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [req-c7afe299-315c-4616-9a9a-f8006a00c689 req-e73b1321-ff4e-4ff5-86bd-0a42b8e96cee tempest-TestShelveInstance-1578816192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:32:54 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [req-c7afe299-315c-4616-9a9a-f8006a00c689 req-e73b1321-ff4e-4ff5-86bd-0a42b8e96cee tempest-TestShelveInstance-1578816192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:32:54 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [req-c7afe299-315c-4616-9a9a-f8006a00c689 req-e73b1321-ff4e-4ff5-86bd-0a42b8e96cee tempest-TestShelveInstance-1578816192 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81', 'name': 'volume-84a61fd6-7a7e-4b77-9020-a29c5ad9c695', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0e1dec0e-4fff-4a60-aae5-61aaf62b3f3d', 'enforce_multipath': True} {{(pid=86188) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 16 20:32:54 devstack cinder-volume[86188]: INFO cinder.volume.manager [req-c7afe299-315c-4616-9a9a-f8006a00c689 req-e73b1321-ff4e-4ff5-86bd-0a42b8e96cee tempest-TestShelveInstance-1578816192 None] attachment_update completed successfully. Sep 16 20:32:59 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-65b80d13-5052-4066-a57a-0b76d257ec30 tempest-TestImageHashVerification-307467644 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:32:59 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-65b80d13-5052-4066-a57a-0b76d257ec30 tempest-TestImageHashVerification-307467644 None] Flow 'volume_create_manager' (397e8fb7-b345-40dc-94d1-355b95204518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:32:59 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-65b80d13-5052-4066-a57a-0b76d257ec30 tempest-TestImageHashVerification-307467644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3df2a624-637a-4a74-873a-1f3b7e3c20c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:32:59 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-65b80d13-5052-4066-a57a-0b76d257ec30 tempest-TestImageHashVerification-307467644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3df2a624-637a-4a74-873a-1f3b7e3c20c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:32:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1291656345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea994442-ea80-42f8-90e9-24e0966dace9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18878bdc42c84f7796380de8168fb0cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:32:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:32:59Z,use_quota=True,user_id='95320cf7c62049709515ad43333d0705',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:32:59 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-65b80d13-5052-4066-a57a-0b76d257ec30 tempest-TestImageHashVerification-307467644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd757972-6782-42d9-9db3-2492694c0278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:32:59 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-65b80d13-5052-4066-a57a-0b76d257ec30 tempest-TestImageHashVerification-307467644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd757972-6782-42d9-9db3-2492694c0278) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:32:59 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-65b80d13-5052-4066-a57a-0b76d257ec30 tempest-TestImageHashVerification-307467644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a87d3201-cee1-4c0f-b4f1-7115ef09bd04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:32:59 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-65b80d13-5052-4066-a57a-0b76d257ec30 tempest-TestImageHashVerification-307467644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a87d3201-cee1-4c0f-b4f1-7115ef09bd04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea994442-ea80-42f8-90e9-24e0966dace9', 'volume_name': 'volume-ea994442-ea80-42f8-90e9-24e0966dace9', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:32:59 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-65b80d13-5052-4066-a57a-0b76d257ec30 tempest-TestImageHashVerification-307467644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab3c7806-d234-4d12-9213-6e1be608f641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:32:59 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-65b80d13-5052-4066-a57a-0b76d257ec30 tempest-TestImageHashVerification-307467644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab3c7806-d234-4d12-9213-6e1be608f641) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:32:59 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-65b80d13-5052-4066-a57a-0b76d257ec30 tempest-TestImageHashVerification-307467644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e662d7cc-5fca-43f5-8815-09615a57af61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:32:59 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-65b80d13-5052-4066-a57a-0b76d257ec30 tempest-TestImageHashVerification-307467644 None] Volume ea994442-ea80-42f8-90e9-24e0966dace9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea994442-ea80-42f8-90e9-24e0966dace9', 'volume_size': 1} Sep 16 20:32:59 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-65b80d13-5052-4066-a57a-0b76d257ec30 tempest-TestImageHashVerification-307467644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:32:59 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-65b80d13-5052-4066-a57a-0b76d257ec30 tempest-TestImageHashVerification-307467644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:32:59 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-65b80d13-5052-4066-a57a-0b76d257ec30 tempest-TestImageHashVerification-307467644 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:32:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1291656345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea994442-ea80-42f8-90e9-24e0966dace9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18878bdc42c84f7796380de8168fb0cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:32:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:32:59Z,use_quota=True,user_id='95320cf7c62049709515ad43333d0705',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:32:59 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-65b80d13-5052-4066-a57a-0b76d257ec30 tempest-TestImageHashVerification-307467644 None] Creating volume ea994442-ea80-42f8-90e9-24e0966dace9 {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:32:59 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-65b80d13-5052-4066-a57a-0b76d257ec30 tempest-TestImageHashVerification-307467644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:32:59 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-65b80d13-5052-4066-a57a-0b76d257ec30 tempest-TestImageHashVerification-307467644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:32:59 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-65b80d13-5052-4066-a57a-0b76d257ec30 tempest-TestImageHashVerification-307467644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:32:59 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-65b80d13-5052-4066-a57a-0b76d257ec30 tempest-TestImageHashVerification-307467644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:32:59 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-65b80d13-5052-4066-a57a-0b76d257ec30 tempest-TestImageHashVerification-307467644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:32:59 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-65b80d13-5052-4066-a57a-0b76d257ec30 tempest-TestImageHashVerification-307467644 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:32:59 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-65b80d13-5052-4066-a57a-0b76d257ec30 tempest-TestImageHashVerification-307467644 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:32:59 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-65b80d13-5052-4066-a57a-0b76d257ec30 tempest-TestImageHashVerification-307467644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ea994442-ea80-42f8-90e9-24e0966dace9 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:32:59 devstack sudo[102883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ea994442-ea80-42f8-90e9-24e0966dace9 1073741824 Sep 16 20:32:59 devstack sudo[102883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:32:59 devstack sudo[102883]: pam_unix(sudo:session): session closed for user root Sep 16 20:32:59 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-65b80d13-5052-4066-a57a-0b76d257ec30 tempest-TestImageHashVerification-307467644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ea994442-ea80-42f8-90e9-24e0966dace9 1073741824" returned: 0 in 0.463s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:32:59 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-65b80d13-5052-4066-a57a-0b76d257ec30 tempest-TestImageHashVerification-307467644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ea994442-ea80-42f8-90e9-24e0966dace9 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:32:59 devstack sudo[102888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ea994442-ea80-42f8-90e9-24e0966dace9 Sep 16 20:32:59 devstack sudo[102888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:33:00 devstack sudo[102888]: pam_unix(sudo:session): session closed for user root Sep 16 20:33:00 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-65b80d13-5052-4066-a57a-0b76d257ec30 tempest-TestImageHashVerification-307467644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ea994442-ea80-42f8-90e9-24e0966dace9" returned: 0 in 0.250s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:33:00 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-65b80d13-5052-4066-a57a-0b76d257ec30 tempest-TestImageHashVerification-307467644 None] <== create_volume: return (756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:33:00 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-65b80d13-5052-4066-a57a-0b76d257ec30 tempest-TestImageHashVerification-307467644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.759s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:33:00 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-65b80d13-5052-4066-a57a-0b76d257ec30 tempest-TestImageHashVerification-307467644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e662d7cc-5fca-43f5-8815-09615a57af61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea994442-ea80-42f8-90e9-24e0966dace9', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:33:00 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-65b80d13-5052-4066-a57a-0b76d257ec30 tempest-TestImageHashVerification-307467644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b34ac83a-afd5-46b6-829a-62e015f10a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:33:00 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-65b80d13-5052-4066-a57a-0b76d257ec30 tempest-TestImageHashVerification-307467644 None] Volume volume-ea994442-ea80-42f8-90e9-24e0966dace9 (ea994442-ea80-42f8-90e9-24e0966dace9): created successfully Sep 16 20:33:00 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-65b80d13-5052-4066-a57a-0b76d257ec30 tempest-TestImageHashVerification-307467644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b34ac83a-afd5-46b6-829a-62e015f10a5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:33:00 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-65b80d13-5052-4066-a57a-0b76d257ec30 tempest-TestImageHashVerification-307467644 None] Flow 'volume_create_manager' (397e8fb7-b345-40dc-94d1-355b95204518) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:33:00 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-65b80d13-5052-4066-a57a-0b76d257ec30 tempest-TestImageHashVerification-307467644 None] Created volume successfully. Sep 16 20:33:01 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-bd7a62a8-6fec-4418-9a5e-78bf1cebcbb4 tempest-TestImageHashVerification-307467644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:33:01 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-bd7a62a8-6fec-4418-9a5e-78bf1cebcbb4 tempest-TestImageHashVerification-307467644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:33:01 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eb116d4-746e-4dd3-b29a-e575358863ca]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:33:01 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-bd7a62a8-6fec-4418-9a5e-78bf1cebcbb4 tempest-TestImageHashVerification-307467644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ea994442-ea80-42f8-90e9-24e0966dace9 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:33:01 devstack sudo[102891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ea994442-ea80-42f8-90e9-24e0966dace9 Sep 16 20:33:01 devstack sudo[102891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:33:01 devstack sudo[102891]: pam_unix(sudo:session): session closed for user root Sep 16 20:33:01 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-bd7a62a8-6fec-4418-9a5e-78bf1cebcbb4 tempest-TestImageHashVerification-307467644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ea994442-ea80-42f8-90e9-24e0966dace9" returned: 0 in 0.399s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:33:01 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[b94daeac-162e-4b3a-8bf1-ac27d2fa7010]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:33:01 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-bd7a62a8-6fec-4418-9a5e-78bf1cebcbb4 tempest-TestImageHashVerification-307467644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ea994442-ea80-42f8-90e9-24e0966dace9 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:33:01 devstack sudo[102897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ea994442-ea80-42f8-90e9-24e0966dace9 Sep 16 20:33:01 devstack sudo[102897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:33:02 devstack sudo[102897]: pam_unix(sudo:session): session closed for user root Sep 16 20:33:02 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-bd7a62a8-6fec-4418-9a5e-78bf1cebcbb4 tempest-TestImageHashVerification-307467644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ea994442-ea80-42f8-90e9-24e0966dace9" returned: 0 in 0.433s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:33:02 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-bd7a62a8-6fec-4418-9a5e-78bf1cebcbb4 tempest-TestImageHashVerification-307467644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ea994442-ea80-42f8-90e9-24e0966dace9 /opt/stack/data/cinder/conversion/ea994442-ea80-42f8-90e9-24e0966dace9.temp_image.284b071f-e1dc-48aa-8761-cf26183878bdn1bg2iu7.img {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:33:02 devstack sudo[102902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ea994442-ea80-42f8-90e9-24e0966dace9 /opt/stack/data/cinder/conversion/ea994442-ea80-42f8-90e9-24e0966dace9.temp_image.284b071f-e1dc-48aa-8761-cf26183878bdn1bg2iu7.img Sep 16 20:33:02 devstack sudo[102902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:33:09 devstack sudo[102902]: pam_unix(sudo:session): session closed for user root Sep 16 20:33:09 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-bd7a62a8-6fec-4418-9a5e-78bf1cebcbb4 tempest-TestImageHashVerification-307467644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ea994442-ea80-42f8-90e9-24e0966dace9 /opt/stack/data/cinder/conversion/ea994442-ea80-42f8-90e9-24e0966dace9.temp_image.284b071f-e1dc-48aa-8761-cf26183878bdn1bg2iu7.img" returned: 0 in 7.610s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:33:09 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[95523240-7939-4980-aa8f-85dc3af96f55]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:33:09 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-bd7a62a8-6fec-4418-9a5e-78bf1cebcbb4 tempest-TestImageHashVerification-307467644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ea994442-ea80-42f8-90e9-24e0966dace9 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:33:09 devstack sudo[102927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ea994442-ea80-42f8-90e9-24e0966dace9 Sep 16 20:33:09 devstack sudo[102927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:33:10 devstack sudo[102927]: pam_unix(sudo:session): session closed for user root Sep 16 20:33:10 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-bd7a62a8-6fec-4418-9a5e-78bf1cebcbb4 tempest-TestImageHashVerification-307467644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ea994442-ea80-42f8-90e9-24e0966dace9" returned: 0 in 0.539s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:33:10 devstack cinder-volume[86188]: DEBUG cinder.image.image_utils [None req-bd7a62a8-6fec-4418-9a5e-78bf1cebcbb4 tempest-TestImageHashVerification-307467644 None] Image conversion details: src /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ea994442-ea80-42f8-90e9-24e0966dace9, size 1024.00 MB, duration 7.61 sec, destination /opt/stack/data/cinder/conversion/ea994442-ea80-42f8-90e9-24e0966dace9.temp_image.284b071f-e1dc-48aa-8761-cf26183878bdn1bg2iu7.img {{(pid=86188) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 16 20:33:10 devstack cinder-volume[86188]: INFO cinder.image.image_utils [None req-bd7a62a8-6fec-4418-9a5e-78bf1cebcbb4 tempest-TestImageHashVerification-307467644 None] Converted 1024.00 MB image at 134.54 MB/s Sep 16 20:33:10 devstack cinder-volume[86188]: DEBUG cinder.image.image_utils [None req-bd7a62a8-6fec-4418-9a5e-78bf1cebcbb4 tempest-TestImageHashVerification-307467644 None] 284b071f-e1dc-48aa-8761-cf26183878bd was raw, no need to convert to raw {{(pid=86188) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 16 20:33:20 devstack cinder-volume[86188]: DEBUG dbcounter [-] [86188] Writing DB stats cinder:SELECT=18,cinder:INSERT=10,cinder:UPDATE=9,cinder:DELETE=1 {{(pid=86188) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 20:33:20 devstack cinder-volume[86188]: DEBUG dbcounter [-] [86188] Writing DB stats cinder:UPDATE=10,cinder:SELECT=22,cinder:INSERT=5,cinder:DELETE=1 {{(pid=86188) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 20:33:28 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-bd7a62a8-6fec-4418-9a5e-78bf1cebcbb4 tempest-TestImageHashVerification-307467644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 27.393s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:33:28 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-bd7a62a8-6fec-4418-9a5e-78bf1cebcbb4 tempest-TestImageHashVerification-307467644 None] Uploaded volume to glance image-id: 284b071f-e1dc-48aa-8761-cf26183878bd. {{(pid=86188) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 16 20:33:28 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-bd7a62a8-6fec-4418-9a5e-78bf1cebcbb4 tempest-TestImageHashVerification-307467644 None] Copy volume to image completed successfully. Sep 16 20:33:29 devstack cinder-volume[86188]: INFO cinder.volume.manager [req-fc626675-b5b5-4110-b1b1-6db91cda6a4b req-882f7a60-cb3e-453e-aa32-3176beba32bb tempest-TestShelveInstance-1578816192 None] Terminate volume connection completed successfully. Sep 16 20:33:29 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [req-fc626675-b5b5-4110-b1b1-6db91cda6a4b req-882f7a60-cb3e-453e-aa32-3176beba32bb tempest-TestShelveInstance-1578816192 None] Deleting attachment 0e1dec0e-4fff-4a60-aae5-61aaf62b3f3d. {{(pid=86188) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 16 20:33:30 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-c280c674-f873-40ea-951a-0a8b26bd7211 tempest-TestImageHashVerification-307467644 None] Acquiring lock "cinder-ea994442-ea80-42f8-90e9-24e0966dace9-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:33:30 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-c280c674-f873-40ea-951a-0a8b26bd7211 tempest-TestImageHashVerification-307467644 None] Lock "cinder-ea994442-ea80-42f8-90e9-24e0966dace9-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:33:30 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-c280c674-f873-40ea-951a-0a8b26bd7211 tempest-TestImageHashVerification-307467644 None] Acquiring lock "cinder-quobyte-ea994442-ea80-42f8-90e9-24e0966dace9" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:33:30 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-c280c674-f873-40ea-951a-0a8b26bd7211 tempest-TestImageHashVerification-307467644 None] Lock "cinder-quobyte-ea994442-ea80-42f8-90e9-24e0966dace9" acquired by "delete_volume" :: waited 0.018s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:33:30 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[da267a62-fe26-48bc-80b4-6ca46974d9b5]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:33:30 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-c280c674-f873-40ea-951a-0a8b26bd7211 tempest-TestImageHashVerification-307467644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ea994442-ea80-42f8-90e9-24e0966dace9 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:33:30 devstack sudo[103010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ea994442-ea80-42f8-90e9-24e0966dace9 Sep 16 20:33:30 devstack sudo[103010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:33:30 devstack sudo[103010]: pam_unix(sudo:session): session closed for user root Sep 16 20:33:30 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-c280c674-f873-40ea-951a-0a8b26bd7211 tempest-TestImageHashVerification-307467644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ea994442-ea80-42f8-90e9-24e0966dace9" returned: 0 in 0.391s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:33:30 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-c280c674-f873-40ea-951a-0a8b26bd7211 tempest-TestImageHashVerification-307467644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ea994442-ea80-42f8-90e9-24e0966dace9 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:33:30 devstack sudo[103019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ea994442-ea80-42f8-90e9-24e0966dace9 Sep 16 20:33:30 devstack sudo[103019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:33:30 devstack sudo[103019]: pam_unix(sudo:session): session closed for user root Sep 16 20:33:30 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-c280c674-f873-40ea-951a-0a8b26bd7211 tempest-TestImageHashVerification-307467644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ea994442-ea80-42f8-90e9-24e0966dace9" returned: 0 in 0.249s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:33:30 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-c280c674-f873-40ea-951a-0a8b26bd7211 tempest-TestImageHashVerification-307467644 None] Lock "cinder-quobyte-ea994442-ea80-42f8-90e9-24e0966dace9" released by "delete_volume" :: held 0.684s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:33:30 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-c280c674-f873-40ea-951a-0a8b26bd7211 tempest-TestImageHashVerification-307467644 None] Created reservations ['866dd7f3-ea7d-4dd1-bee0-9c7b83d7c09d', '0b9d55f2-4786-4fa5-97aa-a1dabc93310b', 'e1dcd06e-8c93-4a5e-abb2-6f5ebe66b48b', 'eeb4d6e8-34ec-4055-84ef-4d59d7acb306'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:33:30 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-c280c674-f873-40ea-951a-0a8b26bd7211 tempest-TestImageHashVerification-307467644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:33:30 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-c280c674-f873-40ea-951a-0a8b26bd7211 tempest-TestImageHashVerification-307467644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:33:30 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-c280c674-f873-40ea-951a-0a8b26bd7211 tempest-TestImageHashVerification-307467644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:33:30 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-c280c674-f873-40ea-951a-0a8b26bd7211 tempest-TestImageHashVerification-307467644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:33:30 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-c280c674-f873-40ea-951a-0a8b26bd7211 tempest-TestImageHashVerification-307467644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:33:30 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-c280c674-f873-40ea-951a-0a8b26bd7211 tempest-TestImageHashVerification-307467644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:33:30 devstack sudo[103022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:33:30 devstack sudo[103022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:33:31 devstack sudo[103022]: pam_unix(sudo:session): session closed for user root Sep 16 20:33:31 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-c280c674-f873-40ea-951a-0a8b26bd7211 tempest-TestImageHashVerification-307467644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.275s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:33:31 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-c280c674-f873-40ea-951a-0a8b26bd7211 tempest-TestImageHashVerification-307467644 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:33:31 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-c280c674-f873-40ea-951a-0a8b26bd7211 tempest-TestImageHashVerification-307467644 None] Deleted volume successfully. Sep 16 20:33:31 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-c280c674-f873-40ea-951a-0a8b26bd7211 tempest-TestImageHashVerification-307467644 None] Lock "cinder-ea994442-ea80-42f8-90e9-24e0966dace9-delete_volume" released by "delete_volume" :: held 1.202s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:33:31 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [req-b01c8667-ad37-42aa-b3f7-1cfd06a3392a req-b4756bcd-7f3a-459e-a00a-e36d985f4dba tempest-TestShelveInstance-1578816192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:33:31 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [req-b01c8667-ad37-42aa-b3f7-1cfd06a3392a req-b4756bcd-7f3a-459e-a00a-e36d985f4dba tempest-TestShelveInstance-1578816192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:33:31 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [req-b01c8667-ad37-42aa-b3f7-1cfd06a3392a req-b4756bcd-7f3a-459e-a00a-e36d985f4dba tempest-TestShelveInstance-1578816192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:33:31 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [req-b01c8667-ad37-42aa-b3f7-1cfd06a3392a req-b4756bcd-7f3a-459e-a00a-e36d985f4dba tempest-TestShelveInstance-1578816192 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81', 'name': 'volume-84a61fd6-7a7e-4b77-9020-a29c5ad9c695', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ab7c4f7f-c1e6-4f45-b8ea-45b1e53d0a55', 'enforce_multipath': True} {{(pid=86188) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 16 20:33:31 devstack cinder-volume[86188]: INFO cinder.volume.manager [req-b01c8667-ad37-42aa-b3f7-1cfd06a3392a req-b4756bcd-7f3a-459e-a00a-e36d985f4dba tempest-TestShelveInstance-1578816192 None] attachment_update completed successfully. Sep 16 20:33:41 devstack cinder-volume[86188]: DEBUG dbcounter [-] [86188] Writing DB stats cinder:SELECT=15,cinder:UPDATE=9,cinder:INSERT=2,cinder:DELETE=1 {{(pid=86188) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 20:33:41 devstack cinder-volume[86188]: DEBUG dbcounter [-] [86188] Writing DB stats cinder:SELECT=11,cinder:INSERT=2,cinder:UPDATE=11 {{(pid=86188) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 20:33:43 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc0cf8e6-310e-41ce-a33b-d8f1a7436b97 tempest-VolumeDependencyTests-2025296234 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:33:43 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-cc0cf8e6-310e-41ce-a33b-d8f1a7436b97 tempest-VolumeDependencyTests-2025296234 None] Flow 'volume_create_manager' (ea2dd020-efb6-42e0-a09a-96e97fc16a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:33:43 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-cc0cf8e6-310e-41ce-a33b-d8f1a7436b97 tempest-VolumeDependencyTests-2025296234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (327a2925-786a-4bb9-b263-5a542f8d946c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:33:43 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-cc0cf8e6-310e-41ce-a33b-d8f1a7436b97 tempest-VolumeDependencyTests-2025296234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (327a2925-786a-4bb9-b263-5a542f8d946c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:33:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-25872900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b570f8e3-539d-4a45-a2cb-149564a1f160,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='870d98c1885642ee8af71c90c68d6cda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:33:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:33:43Z,use_quota=True,user_id='dfd871c2d74b43a7b11e12953352be09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:33:43 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-cc0cf8e6-310e-41ce-a33b-d8f1a7436b97 tempest-VolumeDependencyTests-2025296234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5fddbb3-23ae-4f21-a304-99a87722dfc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:33:43 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-cc0cf8e6-310e-41ce-a33b-d8f1a7436b97 tempest-VolumeDependencyTests-2025296234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5fddbb3-23ae-4f21-a304-99a87722dfc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:33:43 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-cc0cf8e6-310e-41ce-a33b-d8f1a7436b97 tempest-VolumeDependencyTests-2025296234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9208ae1-3f4e-415c-a644-ae1020b87fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:33:43 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-cc0cf8e6-310e-41ce-a33b-d8f1a7436b97 tempest-VolumeDependencyTests-2025296234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9208ae1-3f4e-415c-a644-ae1020b87fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b570f8e3-539d-4a45-a2cb-149564a1f160', 'volume_name': 'volume-b570f8e3-539d-4a45-a2cb-149564a1f160', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:33:43 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-cc0cf8e6-310e-41ce-a33b-d8f1a7436b97 tempest-VolumeDependencyTests-2025296234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89b9a613-a1de-45c8-bf8a-e29762efe38f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:33:43 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-cc0cf8e6-310e-41ce-a33b-d8f1a7436b97 tempest-VolumeDependencyTests-2025296234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89b9a613-a1de-45c8-bf8a-e29762efe38f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:33:43 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-cc0cf8e6-310e-41ce-a33b-d8f1a7436b97 tempest-VolumeDependencyTests-2025296234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a976ca9-1517-4e1f-88b4-cb83a2f62198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:33:43 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-cc0cf8e6-310e-41ce-a33b-d8f1a7436b97 tempest-VolumeDependencyTests-2025296234 None] Volume b570f8e3-539d-4a45-a2cb-149564a1f160: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b570f8e3-539d-4a45-a2cb-149564a1f160', 'volume_size': 1} Sep 16 20:33:43 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-cc0cf8e6-310e-41ce-a33b-d8f1a7436b97 tempest-VolumeDependencyTests-2025296234 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:33:43 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-cc0cf8e6-310e-41ce-a33b-d8f1a7436b97 tempest-VolumeDependencyTests-2025296234 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:33:43 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-cc0cf8e6-310e-41ce-a33b-d8f1a7436b97 tempest-VolumeDependencyTests-2025296234 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:33:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-25872900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b570f8e3-539d-4a45-a2cb-149564a1f160,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='870d98c1885642ee8af71c90c68d6cda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:33:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:33:43Z,use_quota=True,user_id='dfd871c2d74b43a7b11e12953352be09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:33:43 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-cc0cf8e6-310e-41ce-a33b-d8f1a7436b97 tempest-VolumeDependencyTests-2025296234 None] Creating volume b570f8e3-539d-4a45-a2cb-149564a1f160 {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:33:43 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-cc0cf8e6-310e-41ce-a33b-d8f1a7436b97 tempest-VolumeDependencyTests-2025296234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:33:43 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-cc0cf8e6-310e-41ce-a33b-d8f1a7436b97 tempest-VolumeDependencyTests-2025296234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:33:43 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-cc0cf8e6-310e-41ce-a33b-d8f1a7436b97 tempest-VolumeDependencyTests-2025296234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:33:43 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-cc0cf8e6-310e-41ce-a33b-d8f1a7436b97 tempest-VolumeDependencyTests-2025296234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:33:43 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-cc0cf8e6-310e-41ce-a33b-d8f1a7436b97 tempest-VolumeDependencyTests-2025296234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:33:43 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-cc0cf8e6-310e-41ce-a33b-d8f1a7436b97 tempest-VolumeDependencyTests-2025296234 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:33:43 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-cc0cf8e6-310e-41ce-a33b-d8f1a7436b97 tempest-VolumeDependencyTests-2025296234 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:33:43 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-cc0cf8e6-310e-41ce-a33b-d8f1a7436b97 tempest-VolumeDependencyTests-2025296234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b570f8e3-539d-4a45-a2cb-149564a1f160 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:33:43 devstack sudo[103517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b570f8e3-539d-4a45-a2cb-149564a1f160 1073741824 Sep 16 20:33:43 devstack sudo[103517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:33:44 devstack sudo[103517]: pam_unix(sudo:session): session closed for user root Sep 16 20:33:44 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-cc0cf8e6-310e-41ce-a33b-d8f1a7436b97 tempest-VolumeDependencyTests-2025296234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b570f8e3-539d-4a45-a2cb-149564a1f160 1073741824" returned: 0 in 0.439s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:33:44 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-cc0cf8e6-310e-41ce-a33b-d8f1a7436b97 tempest-VolumeDependencyTests-2025296234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b570f8e3-539d-4a45-a2cb-149564a1f160 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:33:44 devstack sudo[103522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b570f8e3-539d-4a45-a2cb-149564a1f160 Sep 16 20:33:44 devstack sudo[103522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:33:44 devstack sudo[103522]: pam_unix(sudo:session): session closed for user root Sep 16 20:33:44 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-cc0cf8e6-310e-41ce-a33b-d8f1a7436b97 tempest-VolumeDependencyTests-2025296234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b570f8e3-539d-4a45-a2cb-149564a1f160" returned: 0 in 0.244s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:33:44 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-cc0cf8e6-310e-41ce-a33b-d8f1a7436b97 tempest-VolumeDependencyTests-2025296234 None] <== create_volume: return (732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:33:44 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-cc0cf8e6-310e-41ce-a33b-d8f1a7436b97 tempest-VolumeDependencyTests-2025296234 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.735s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:33:44 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-cc0cf8e6-310e-41ce-a33b-d8f1a7436b97 tempest-VolumeDependencyTests-2025296234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a976ca9-1517-4e1f-88b4-cb83a2f62198) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b570f8e3-539d-4a45-a2cb-149564a1f160', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:33:44 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-cc0cf8e6-310e-41ce-a33b-d8f1a7436b97 tempest-VolumeDependencyTests-2025296234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9419a9c4-b57c-4982-8882-471c8e108546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:33:44 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-cc0cf8e6-310e-41ce-a33b-d8f1a7436b97 tempest-VolumeDependencyTests-2025296234 None] Volume volume-b570f8e3-539d-4a45-a2cb-149564a1f160 (b570f8e3-539d-4a45-a2cb-149564a1f160): created successfully Sep 16 20:33:44 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-cc0cf8e6-310e-41ce-a33b-d8f1a7436b97 tempest-VolumeDependencyTests-2025296234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9419a9c4-b57c-4982-8882-471c8e108546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:33:44 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-cc0cf8e6-310e-41ce-a33b-d8f1a7436b97 tempest-VolumeDependencyTests-2025296234 None] Flow 'volume_create_manager' (ea2dd020-efb6-42e0-a09a-96e97fc16a25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:33:44 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-cc0cf8e6-310e-41ce-a33b-d8f1a7436b97 tempest-VolumeDependencyTests-2025296234 None] Created volume successfully. Sep 16 20:33:44 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-bd54b985-c21f-4c02-990c-0dc067083c0c tempest-VolumeDependencyTests-2025296234 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:33:44 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-bd54b985-c21f-4c02-990c-0dc067083c0c tempest-VolumeDependencyTests-2025296234 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:33:44 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-bd54b985-c21f-4c02-990c-0dc067083c0c tempest-VolumeDependencyTests-2025296234 None] Creating offline snapshot 25ae3fbc-558e-469f-89e8-abd7cb48a8d3 of volume b570f8e3-539d-4a45-a2cb-149564a1f160 {{(pid=86188) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 20:33:44 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f013cbc-9421-45de-a364-a4d2a5692552]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:33:44 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-bd54b985-c21f-4c02-990c-0dc067083c0c tempest-VolumeDependencyTests-2025296234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b570f8e3-539d-4a45-a2cb-149564a1f160 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:33:44 devstack sudo[103525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b570f8e3-539d-4a45-a2cb-149564a1f160 Sep 16 20:33:44 devstack sudo[103525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:33:45 devstack sudo[103525]: pam_unix(sudo:session): session closed for user root Sep 16 20:33:45 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-bd54b985-c21f-4c02-990c-0dc067083c0c tempest-VolumeDependencyTests-2025296234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b570f8e3-539d-4a45-a2cb-149564a1f160" returned: 0 in 0.363s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:33:45 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-bd54b985-c21f-4c02-990c-0dc067083c0c tempest-VolumeDependencyTests-2025296234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b570f8e3-539d-4a45-a2cb-149564a1f160,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b570f8e3-539d-4a45-a2cb-149564a1f160.25ae3fbc-558e-469f-89e8-abd7cb48a8d3 1G {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:33:45 devstack sudo[103530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b570f8e3-539d-4a45-a2cb-149564a1f160,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b570f8e3-539d-4a45-a2cb-149564a1f160.25ae3fbc-558e-469f-89e8-abd7cb48a8d3 1G Sep 16 20:33:45 devstack sudo[103530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:33:45 devstack sudo[103530]: pam_unix(sudo:session): session closed for user root Sep 16 20:33:45 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-bd54b985-c21f-4c02-990c-0dc067083c0c tempest-VolumeDependencyTests-2025296234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b570f8e3-539d-4a45-a2cb-149564a1f160,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b570f8e3-539d-4a45-a2cb-149564a1f160.25ae3fbc-558e-469f-89e8-abd7cb48a8d3 1G" returned: 0 in 0.401s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:33:45 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-bd54b985-c21f-4c02-990c-0dc067083c0c tempest-VolumeDependencyTests-2025296234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b570f8e3-539d-4a45-a2cb-149564a1f160 -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b570f8e3-539d-4a45-a2cb-149564a1f160.25ae3fbc-558e-469f-89e8-abd7cb48a8d3 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:33:45 devstack sudo[103535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b570f8e3-539d-4a45-a2cb-149564a1f160 -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b570f8e3-539d-4a45-a2cb-149564a1f160.25ae3fbc-558e-469f-89e8-abd7cb48a8d3 Sep 16 20:33:45 devstack sudo[103535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:33:45 devstack sudo[103535]: pam_unix(sudo:session): session closed for user root Sep 16 20:33:45 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-bd54b985-c21f-4c02-990c-0dc067083c0c tempest-VolumeDependencyTests-2025296234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b570f8e3-539d-4a45-a2cb-149564a1f160 -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b570f8e3-539d-4a45-a2cb-149564a1f160.25ae3fbc-558e-469f-89e8-abd7cb48a8d3" returned: 0 in 0.287s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:33:45 devstack cinder-volume[86188]: WARNING cinder.volume.drivers.remotefs [None req-bd54b985-c21f-4c02-990c-0dc067083c0c tempest-VolumeDependencyTests-2025296234 None] /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b570f8e3-539d-4a45-a2cb-149564a1f160.25ae3fbc-558e-469f-89e8-abd7cb48a8d3 is being set with open permissions: ugo+rw Sep 16 20:33:45 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-bd54b985-c21f-4c02-990c-0dc067083c0c tempest-VolumeDependencyTests-2025296234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b570f8e3-539d-4a45-a2cb-149564a1f160.25ae3fbc-558e-469f-89e8-abd7cb48a8d3 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:33:45 devstack sudo[103540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b570f8e3-539d-4a45-a2cb-149564a1f160.25ae3fbc-558e-469f-89e8-abd7cb48a8d3 Sep 16 20:33:45 devstack sudo[103540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:33:46 devstack sudo[103540]: pam_unix(sudo:session): session closed for user root Sep 16 20:33:46 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-bd54b985-c21f-4c02-990c-0dc067083c0c tempest-VolumeDependencyTests-2025296234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b570f8e3-539d-4a45-a2cb-149564a1f160.25ae3fbc-558e-469f-89e8-abd7cb48a8d3" returned: 0 in 0.236s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:33:46 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-bd54b985-c21f-4c02-990c-0dc067083c0c tempest-VolumeDependencyTests-2025296234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b570f8e3-539d-4a45-a2cb-149564a1f160.info {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:33:46 devstack sudo[103543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b570f8e3-539d-4a45-a2cb-149564a1f160.info Sep 16 20:33:46 devstack sudo[103543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:33:46 devstack sudo[103543]: pam_unix(sudo:session): session closed for user root Sep 16 20:33:46 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-bd54b985-c21f-4c02-990c-0dc067083c0c tempest-VolumeDependencyTests-2025296234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b570f8e3-539d-4a45-a2cb-149564a1f160.info" returned: 0 in 0.261s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:33:46 devstack cinder-volume[86188]: WARNING cinder.volume.drivers.remotefs [None req-bd54b985-c21f-4c02-990c-0dc067083c0c tempest-VolumeDependencyTests-2025296234 None] /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b570f8e3-539d-4a45-a2cb-149564a1f160.info is being set with open permissions: ugo+rw Sep 16 20:33:46 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-bd54b985-c21f-4c02-990c-0dc067083c0c tempest-VolumeDependencyTests-2025296234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b570f8e3-539d-4a45-a2cb-149564a1f160.info {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:33:46 devstack sudo[103546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b570f8e3-539d-4a45-a2cb-149564a1f160.info Sep 16 20:33:46 devstack sudo[103546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:33:46 devstack sudo[103546]: pam_unix(sudo:session): session closed for user root Sep 16 20:33:46 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-bd54b985-c21f-4c02-990c-0dc067083c0c tempest-VolumeDependencyTests-2025296234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b570f8e3-539d-4a45-a2cb-149564a1f160.info" returned: 0 in 0.245s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:33:46 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-bd54b985-c21f-4c02-990c-0dc067083c0c tempest-VolumeDependencyTests-2025296234 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.879s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:33:46 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-bd54b985-c21f-4c02-990c-0dc067083c0c tempest-VolumeDependencyTests-2025296234 None] Create snapshot completed successfully Sep 16 20:33:47 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9fa460a-20f6-47ca-a7f0-2a5e77b6874d tempest-VolumeDependencyTests-2025296234 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:33:47 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-d9fa460a-20f6-47ca-a7f0-2a5e77b6874d tempest-VolumeDependencyTests-2025296234 None] Flow 'volume_create_manager' (fcee004a-7f18-4cc2-bcd2-f51b26400701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:33:47 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-d9fa460a-20f6-47ca-a7f0-2a5e77b6874d tempest-VolumeDependencyTests-2025296234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46de6cc2-67b6-4506-accf-5b4796536a22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:33:47 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-d9fa460a-20f6-47ca-a7f0-2a5e77b6874d tempest-VolumeDependencyTests-2025296234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46de6cc2-67b6-4506-accf-5b4796536a22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:33:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1627706561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2029f041-336c-4cb3-888f-d905d7e3fab5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='870d98c1885642ee8af71c90c68d6cda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:33:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=25ae3fbc-558e-469f-89e8-abd7cb48a8d3,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:33:47Z,use_quota=True,user_id='dfd871c2d74b43a7b11e12953352be09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:33:47 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-d9fa460a-20f6-47ca-a7f0-2a5e77b6874d tempest-VolumeDependencyTests-2025296234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3415846-b760-40a7-8d28-bde9dcbcc378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:33:47 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-d9fa460a-20f6-47ca-a7f0-2a5e77b6874d tempest-VolumeDependencyTests-2025296234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3415846-b760-40a7-8d28-bde9dcbcc378) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:33:47 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-d9fa460a-20f6-47ca-a7f0-2a5e77b6874d tempest-VolumeDependencyTests-2025296234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4561eb0c-f6a6-4f71-8a76-aa9d8c6520f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:33:47 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-d9fa460a-20f6-47ca-a7f0-2a5e77b6874d tempest-VolumeDependencyTests-2025296234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4561eb0c-f6a6-4f71-8a76-aa9d8c6520f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2029f041-336c-4cb3-888f-d905d7e3fab5', 'volume_name': 'volume-2029f041-336c-4cb3-888f-d905d7e3fab5', 'volume_size': 1, 'snapshot_id': '25ae3fbc-558e-469f-89e8-abd7cb48a8d3'}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:33:47 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-d9fa460a-20f6-47ca-a7f0-2a5e77b6874d tempest-VolumeDependencyTests-2025296234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b295cd8b-1df5-4a7a-9a9a-46ebe5afb297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:33:47 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-d9fa460a-20f6-47ca-a7f0-2a5e77b6874d tempest-VolumeDependencyTests-2025296234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b295cd8b-1df5-4a7a-9a9a-46ebe5afb297) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:33:47 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-d9fa460a-20f6-47ca-a7f0-2a5e77b6874d tempest-VolumeDependencyTests-2025296234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (129dc2dc-372b-4dda-a069-685dcf305891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:33:47 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-d9fa460a-20f6-47ca-a7f0-2a5e77b6874d tempest-VolumeDependencyTests-2025296234 None] Volume 2029f041-336c-4cb3-888f-d905d7e3fab5: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2029f041-336c-4cb3-888f-d905d7e3fab5', 'volume_size': 1, 'snapshot_id': '25ae3fbc-558e-469f-89e8-abd7cb48a8d3'} Sep 16 20:33:47 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-d9fa460a-20f6-47ca-a7f0-2a5e77b6874d tempest-VolumeDependencyTests-2025296234 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:33:47 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-d9fa460a-20f6-47ca-a7f0-2a5e77b6874d tempest-VolumeDependencyTests-2025296234 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:33:47 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-d9fa460a-20f6-47ca-a7f0-2a5e77b6874d tempest-VolumeDependencyTests-2025296234 None] Acquiring lock "cinder-quobyte-25ae3fbc-558e-469f-89e8-abd7cb48a8d3-2029f041-336c-4cb3-888f-d905d7e3fab5" by "_create_volume_from_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:33:47 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-d9fa460a-20f6-47ca-a7f0-2a5e77b6874d tempest-VolumeDependencyTests-2025296234 None] Lock "cinder-quobyte-25ae3fbc-558e-469f-89e8-abd7cb48a8d3-2029f041-336c-4cb3-888f-d905d7e3fab5" acquired by "_create_volume_from_snapshot" :: waited 0.012s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:33:47 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-d9fa460a-20f6-47ca-a7f0-2a5e77b6874d tempest-VolumeDependencyTests-2025296234 None] Creating volume 2029f041-336c-4cb3-888f-d905d7e3fab5 from snapshot 25ae3fbc-558e-469f-89e8-abd7cb48a8d3 {{(pid=86188) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 16 20:33:47 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-d9fa460a-20f6-47ca-a7f0-2a5e77b6874d tempest-VolumeDependencyTests-2025296234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:33:47 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-d9fa460a-20f6-47ca-a7f0-2a5e77b6874d tempest-VolumeDependencyTests-2025296234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:33:47 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-d9fa460a-20f6-47ca-a7f0-2a5e77b6874d tempest-VolumeDependencyTests-2025296234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:33:47 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-d9fa460a-20f6-47ca-a7f0-2a5e77b6874d tempest-VolumeDependencyTests-2025296234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:33:47 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-d9fa460a-20f6-47ca-a7f0-2a5e77b6874d tempest-VolumeDependencyTests-2025296234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:33:47 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-d9fa460a-20f6-47ca-a7f0-2a5e77b6874d tempest-VolumeDependencyTests-2025296234 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:33:47 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-d9fa460a-20f6-47ca-a7f0-2a5e77b6874d tempest-VolumeDependencyTests-2025296234 None] Acquiring lock "cinder-quobyte-2029f041-336c-4cb3-888f-d905d7e3fab5" by "_copy_volume_from_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:33:47 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-d9fa460a-20f6-47ca-a7f0-2a5e77b6874d tempest-VolumeDependencyTests-2025296234 None] Lock "cinder-quobyte-2029f041-336c-4cb3-888f-d905d7e3fab5" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:33:47 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-d9fa460a-20f6-47ca-a7f0-2a5e77b6874d tempest-VolumeDependencyTests-2025296234 None] snapshot: 25ae3fbc-558e-469f-89e8-abd7cb48a8d3, volume: 2029f041-336c-4cb3-888f-d905d7e3fab5, {{(pid=86188) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 16 20:33:47 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-d9fa460a-20f6-47ca-a7f0-2a5e77b6874d tempest-VolumeDependencyTests-2025296234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:33:47 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-d9fa460a-20f6-47ca-a7f0-2a5e77b6874d tempest-VolumeDependencyTests-2025296234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:33:47 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-d9fa460a-20f6-47ca-a7f0-2a5e77b6874d tempest-VolumeDependencyTests-2025296234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:33:47 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-d9fa460a-20f6-47ca-a7f0-2a5e77b6874d tempest-VolumeDependencyTests-2025296234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:33:47 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-d9fa460a-20f6-47ca-a7f0-2a5e77b6874d tempest-VolumeDependencyTests-2025296234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:33:47 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[e990e5ce-8b67-42b7-9793-ae76b0b1c0fe]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:33:47 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-d9fa460a-20f6-47ca-a7f0-2a5e77b6874d tempest-VolumeDependencyTests-2025296234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b570f8e3-539d-4a45-a2cb-149564a1f160.25ae3fbc-558e-469f-89e8-abd7cb48a8d3 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:33:47 devstack sudo[103549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b570f8e3-539d-4a45-a2cb-149564a1f160.25ae3fbc-558e-469f-89e8-abd7cb48a8d3 Sep 16 20:33:47 devstack sudo[103549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:33:47 devstack sudo[103549]: pam_unix(sudo:session): session closed for user root Sep 16 20:33:47 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-d9fa460a-20f6-47ca-a7f0-2a5e77b6874d tempest-VolumeDependencyTests-2025296234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b570f8e3-539d-4a45-a2cb-149564a1f160.25ae3fbc-558e-469f-89e8-abd7cb48a8d3" returned: 0 in 0.358s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:33:47 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-d9fa460a-20f6-47ca-a7f0-2a5e77b6874d tempest-VolumeDependencyTests-2025296234 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b570f8e3-539d-4a45-a2cb-149564a1f160(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86188) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 20:33:47 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[71b7a856-e32b-4bbc-afbb-5de061fbe3b8]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:33:47 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-d9fa460a-20f6-47ca-a7f0-2a5e77b6874d tempest-VolumeDependencyTests-2025296234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b570f8e3-539d-4a45-a2cb-149564a1f160 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:33:48 devstack sudo[103554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b570f8e3-539d-4a45-a2cb-149564a1f160 Sep 16 20:33:48 devstack sudo[103554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:33:48 devstack sudo[103554]: pam_unix(sudo:session): session closed for user root Sep 16 20:33:48 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-d9fa460a-20f6-47ca-a7f0-2a5e77b6874d tempest-VolumeDependencyTests-2025296234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b570f8e3-539d-4a45-a2cb-149564a1f160" returned: 0 in 0.383s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:33:48 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-d9fa460a-20f6-47ca-a7f0-2a5e77b6874d tempest-VolumeDependencyTests-2025296234 None] will copy from snapshot at /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b570f8e3-539d-4a45-a2cb-149564a1f160 {{(pid=86188) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 16 20:33:48 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-d9fa460a-20f6-47ca-a7f0-2a5e77b6874d tempest-VolumeDependencyTests-2025296234 None] Creating direct copy from snapshot {{(pid=86188) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 16 20:33:48 devstack cinder-volume[86188]: DEBUG cinder.utils [None req-d9fa460a-20f6-47ca-a7f0-2a5e77b6874d tempest-VolumeDependencyTests-2025296234 None] Path /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-2029f041-336c-4cb3-888f-d905d7e3fab5 not found in is_blk_device check {{(pid=86188) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 16 20:33:48 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-d9fa460a-20f6-47ca-a7f0-2a5e77b6874d tempest-VolumeDependencyTests-2025296234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b570f8e3-539d-4a45-a2cb-149564a1f160 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-2029f041-336c-4cb3-888f-d905d7e3fab5 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:33:48 devstack sudo[103559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b570f8e3-539d-4a45-a2cb-149564a1f160 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-2029f041-336c-4cb3-888f-d905d7e3fab5 Sep 16 20:33:48 devstack sudo[103559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:33:53 devstack cinder-volume[86188]: DEBUG oslo_service.periodic_task [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86188) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 20:33:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:33:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:33:53 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:33:53 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:33:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:33:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:33:53 devstack sudo[103585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:33:53 devstack sudo[103585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:33:53 devstack sudo[103585]: pam_unix(sudo:session): session closed for user root Sep 16 20:33:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.485s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:33:53 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:33:53 devstack cinder-volume[86188]: DEBUG oslo_service.periodic_task [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Running periodic task VolumeManager._thread_info {{(pid=86188) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 20:33:53 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] thread count: 28 {{(pid=86188) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 16 20:33:53 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] thread info: [<_MainThread(MainThread, started 139858124406912)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86188) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 16 20:33:54 devstack sudo[103559]: pam_unix(sudo:session): session closed for user root Sep 16 20:33:54 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-d9fa460a-20f6-47ca-a7f0-2a5e77b6874d tempest-VolumeDependencyTests-2025296234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b570f8e3-539d-4a45-a2cb-149564a1f160 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-2029f041-336c-4cb3-888f-d905d7e3fab5" returned: 0 in 6.508s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:33:54 devstack cinder-volume[86188]: DEBUG cinder.image.image_utils [None req-d9fa460a-20f6-47ca-a7f0-2a5e77b6874d tempest-VolumeDependencyTests-2025296234 None] Image conversion details: src /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b570f8e3-539d-4a45-a2cb-149564a1f160, size 1024.00 MB, duration 6.51 sec, destination /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-2029f041-336c-4cb3-888f-d905d7e3fab5 {{(pid=86188) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 16 20:33:54 devstack cinder-volume[86188]: INFO cinder.image.image_utils [None req-d9fa460a-20f6-47ca-a7f0-2a5e77b6874d tempest-VolumeDependencyTests-2025296234 None] Converted 1024.00 MB image at 157.30 MB/s Sep 16 20:33:54 devstack cinder-volume[86188]: WARNING cinder.volume.drivers.remotefs [None req-d9fa460a-20f6-47ca-a7f0-2a5e77b6874d tempest-VolumeDependencyTests-2025296234 None] /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-2029f041-336c-4cb3-888f-d905d7e3fab5 is being set with open permissions: ugo+rw Sep 16 20:33:54 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-d9fa460a-20f6-47ca-a7f0-2a5e77b6874d tempest-VolumeDependencyTests-2025296234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-2029f041-336c-4cb3-888f-d905d7e3fab5 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:33:54 devstack sudo[103612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-2029f041-336c-4cb3-888f-d905d7e3fab5 Sep 16 20:33:54 devstack sudo[103612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:33:55 devstack sudo[103612]: pam_unix(sudo:session): session closed for user root Sep 16 20:33:55 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-d9fa460a-20f6-47ca-a7f0-2a5e77b6874d tempest-VolumeDependencyTests-2025296234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-2029f041-336c-4cb3-888f-d905d7e3fab5" returned: 0 in 0.245s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:33:55 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-d9fa460a-20f6-47ca-a7f0-2a5e77b6874d tempest-VolumeDependencyTests-2025296234 None] Lock "cinder-quobyte-2029f041-336c-4cb3-888f-d905d7e3fab5" released by "_copy_volume_from_snapshot" :: held 7.572s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:33:55 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-d9fa460a-20f6-47ca-a7f0-2a5e77b6874d tempest-VolumeDependencyTests-2025296234 None] Lock "cinder-quobyte-25ae3fbc-558e-469f-89e8-abd7cb48a8d3-2029f041-336c-4cb3-888f-d905d7e3fab5" released by "_create_volume_from_snapshot" :: held 7.628s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:33:55 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-d9fa460a-20f6-47ca-a7f0-2a5e77b6874d tempest-VolumeDependencyTests-2025296234 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.641s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:33:55 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-d9fa460a-20f6-47ca-a7f0-2a5e77b6874d tempest-VolumeDependencyTests-2025296234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (129dc2dc-372b-4dda-a069-685dcf305891) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2029f041-336c-4cb3-888f-d905d7e3fab5', 'volume_size': 1, 'snapshot_id': '25ae3fbc-558e-469f-89e8-abd7cb48a8d3'}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:33:55 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-d9fa460a-20f6-47ca-a7f0-2a5e77b6874d tempest-VolumeDependencyTests-2025296234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f54555be-785a-4f7f-a66e-c9277138f6ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:33:55 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-d9fa460a-20f6-47ca-a7f0-2a5e77b6874d tempest-VolumeDependencyTests-2025296234 None] Volume volume-2029f041-336c-4cb3-888f-d905d7e3fab5 (2029f041-336c-4cb3-888f-d905d7e3fab5): created successfully Sep 16 20:33:55 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-d9fa460a-20f6-47ca-a7f0-2a5e77b6874d tempest-VolumeDependencyTests-2025296234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f54555be-785a-4f7f-a66e-c9277138f6ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:33:55 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-d9fa460a-20f6-47ca-a7f0-2a5e77b6874d tempest-VolumeDependencyTests-2025296234 None] Flow 'volume_create_manager' (fcee004a-7f18-4cc2-bcd2-f51b26400701) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:33:55 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-d9fa460a-20f6-47ca-a7f0-2a5e77b6874d tempest-VolumeDependencyTests-2025296234 None] Created volume successfully. Sep 16 20:33:56 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-bbc8a6bb-36e3-4ec4-b192-2f57dc9e4ea9 tempest-VolumeDependencyTests-2025296234 None] Acquiring lock "cinder-25ae3fbc-558e-469f-89e8-abd7cb48a8d3-delete_snapshot" by "delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:33:56 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-bbc8a6bb-36e3-4ec4-b192-2f57dc9e4ea9 tempest-VolumeDependencyTests-2025296234 None] Lock "cinder-25ae3fbc-558e-469f-89e8-abd7cb48a8d3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:33:56 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-bbc8a6bb-36e3-4ec4-b192-2f57dc9e4ea9 tempest-VolumeDependencyTests-2025296234 None] Acquiring lock "cinder-quobyte-b570f8e3-539d-4a45-a2cb-149564a1f160" by "delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:33:56 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-bbc8a6bb-36e3-4ec4-b192-2f57dc9e4ea9 tempest-VolumeDependencyTests-2025296234 None] Lock "cinder-quobyte-b570f8e3-539d-4a45-a2cb-149564a1f160" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:33:56 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-bbc8a6bb-36e3-4ec4-b192-2f57dc9e4ea9 tempest-VolumeDependencyTests-2025296234 None] Acquiring lock "cinder-quobyte-25ae3fbc-558e-469f-89e8-abd7cb48a8d3" by "_delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:33:56 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-bbc8a6bb-36e3-4ec4-b192-2f57dc9e4ea9 tempest-VolumeDependencyTests-2025296234 None] Lock "cinder-quobyte-25ae3fbc-558e-469f-89e8-abd7cb48a8d3" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:33:56 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-bbc8a6bb-36e3-4ec4-b192-2f57dc9e4ea9 tempest-VolumeDependencyTests-2025296234 None] Deleting offline snapshot 25ae3fbc-558e-469f-89e8-abd7cb48a8d3 of volume b570f8e3-539d-4a45-a2cb-149564a1f160 {{(pid=86188) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 20:33:56 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-bbc8a6bb-36e3-4ec4-b192-2f57dc9e4ea9 tempest-VolumeDependencyTests-2025296234 None] snapshot_file for this snap is: volume-b570f8e3-539d-4a45-a2cb-149564a1f160.25ae3fbc-558e-469f-89e8-abd7cb48a8d3 {{(pid=86188) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 20:33:56 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[078e7077-5759-4724-b0d3-f8ae1e2691a9]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:33:56 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-bbc8a6bb-36e3-4ec4-b192-2f57dc9e4ea9 tempest-VolumeDependencyTests-2025296234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b570f8e3-539d-4a45-a2cb-149564a1f160.25ae3fbc-558e-469f-89e8-abd7cb48a8d3 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:33:56 devstack sudo[103615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b570f8e3-539d-4a45-a2cb-149564a1f160.25ae3fbc-558e-469f-89e8-abd7cb48a8d3 Sep 16 20:33:56 devstack sudo[103615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:33:56 devstack sudo[103615]: pam_unix(sudo:session): session closed for user root Sep 16 20:33:56 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-bbc8a6bb-36e3-4ec4-b192-2f57dc9e4ea9 tempest-VolumeDependencyTests-2025296234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b570f8e3-539d-4a45-a2cb-149564a1f160.25ae3fbc-558e-469f-89e8-abd7cb48a8d3" returned: 0 in 0.351s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:33:56 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-bbc8a6bb-36e3-4ec4-b192-2f57dc9e4ea9 tempest-VolumeDependencyTests-2025296234 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b570f8e3-539d-4a45-a2cb-149564a1f160(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86188) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 20:33:56 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[457bfa05-0b45-41cc-8c45-721eb07b840a]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:33:56 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-bbc8a6bb-36e3-4ec4-b192-2f57dc9e4ea9 tempest-VolumeDependencyTests-2025296234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b570f8e3-539d-4a45-a2cb-149564a1f160 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:33:56 devstack sudo[103620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b570f8e3-539d-4a45-a2cb-149564a1f160 Sep 16 20:33:56 devstack sudo[103620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:33:57 devstack sudo[103620]: pam_unix(sudo:session): session closed for user root Sep 16 20:33:57 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-bbc8a6bb-36e3-4ec4-b192-2f57dc9e4ea9 tempest-VolumeDependencyTests-2025296234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b570f8e3-539d-4a45-a2cb-149564a1f160" returned: 0 in 0.524s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:33:57 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-bbc8a6bb-36e3-4ec4-b192-2f57dc9e4ea9 tempest-VolumeDependencyTests-2025296234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b570f8e3-539d-4a45-a2cb-149564a1f160.25ae3fbc-558e-469f-89e8-abd7cb48a8d3 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:33:57 devstack sudo[103625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b570f8e3-539d-4a45-a2cb-149564a1f160.25ae3fbc-558e-469f-89e8-abd7cb48a8d3 Sep 16 20:33:57 devstack sudo[103625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:33:57 devstack sudo[103625]: pam_unix(sudo:session): session closed for user root Sep 16 20:33:57 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-bbc8a6bb-36e3-4ec4-b192-2f57dc9e4ea9 tempest-VolumeDependencyTests-2025296234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b570f8e3-539d-4a45-a2cb-149564a1f160.25ae3fbc-558e-469f-89e8-abd7cb48a8d3" returned: 0 in 0.335s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:33:57 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-bbc8a6bb-36e3-4ec4-b192-2f57dc9e4ea9 tempest-VolumeDependencyTests-2025296234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b570f8e3-539d-4a45-a2cb-149564a1f160.25ae3fbc-558e-469f-89e8-abd7cb48a8d3 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:33:57 devstack sudo[103630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b570f8e3-539d-4a45-a2cb-149564a1f160.25ae3fbc-558e-469f-89e8-abd7cb48a8d3 Sep 16 20:33:57 devstack sudo[103630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:33:57 devstack sudo[103630]: pam_unix(sudo:session): session closed for user root Sep 16 20:33:57 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-bbc8a6bb-36e3-4ec4-b192-2f57dc9e4ea9 tempest-VolumeDependencyTests-2025296234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b570f8e3-539d-4a45-a2cb-149564a1f160.25ae3fbc-558e-469f-89e8-abd7cb48a8d3" returned: 0 in 0.247s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:33:57 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-bbc8a6bb-36e3-4ec4-b192-2f57dc9e4ea9 tempest-VolumeDependencyTests-2025296234 None] Lock "cinder-quobyte-25ae3fbc-558e-469f-89e8-abd7cb48a8d3" released by "_delete_snapshot" :: held 1.560s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:33:57 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-bbc8a6bb-36e3-4ec4-b192-2f57dc9e4ea9 tempest-VolumeDependencyTests-2025296234 None] Lock "cinder-quobyte-b570f8e3-539d-4a45-a2cb-149564a1f160" released by "delete_snapshot" :: held 1.581s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:33:57 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-bbc8a6bb-36e3-4ec4-b192-2f57dc9e4ea9 tempest-VolumeDependencyTests-2025296234 None] Created reservations ['89149824-7c25-42a3-a97d-a9f32be4349a', '52f7b3ca-a09e-489a-8f59-f1af84780379', '0dca58ce-88f7-4977-a52a-e7f6f24c5e42', 'e2d20476-f630-49f6-9f83-fcef33292f26'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:33:57 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-bbc8a6bb-36e3-4ec4-b192-2f57dc9e4ea9 tempest-VolumeDependencyTests-2025296234 None] Delete snapshot completed successfully. Sep 16 20:33:57 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-bbc8a6bb-36e3-4ec4-b192-2f57dc9e4ea9 tempest-VolumeDependencyTests-2025296234 None] Lock "cinder-25ae3fbc-558e-469f-89e8-abd7cb48a8d3-delete_snapshot" released by "delete_snapshot" :: held 1.708s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:33:58 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-80bf970f-7cf4-4cb0-a048-7c5d1f1ba5e2 tempest-VolumeDependencyTests-2025296234 None] Acquiring lock "cinder-b570f8e3-539d-4a45-a2cb-149564a1f160-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:33:58 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-80bf970f-7cf4-4cb0-a048-7c5d1f1ba5e2 tempest-VolumeDependencyTests-2025296234 None] Lock "cinder-b570f8e3-539d-4a45-a2cb-149564a1f160-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:33:58 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-80bf970f-7cf4-4cb0-a048-7c5d1f1ba5e2 tempest-VolumeDependencyTests-2025296234 None] Acquiring lock "cinder-quobyte-b570f8e3-539d-4a45-a2cb-149564a1f160" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:33:58 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-80bf970f-7cf4-4cb0-a048-7c5d1f1ba5e2 tempest-VolumeDependencyTests-2025296234 None] Lock "cinder-quobyte-b570f8e3-539d-4a45-a2cb-149564a1f160" acquired by "delete_volume" :: waited 0.018s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:33:58 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[eabfc95f-9aae-467d-b4e6-7ba7e70ca270]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:33:58 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-80bf970f-7cf4-4cb0-a048-7c5d1f1ba5e2 tempest-VolumeDependencyTests-2025296234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b570f8e3-539d-4a45-a2cb-149564a1f160 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:33:58 devstack sudo[103633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b570f8e3-539d-4a45-a2cb-149564a1f160 Sep 16 20:33:58 devstack sudo[103633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:33:58 devstack sudo[103633]: pam_unix(sudo:session): session closed for user root Sep 16 20:33:58 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-80bf970f-7cf4-4cb0-a048-7c5d1f1ba5e2 tempest-VolumeDependencyTests-2025296234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b570f8e3-539d-4a45-a2cb-149564a1f160" returned: 0 in 0.390s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:33:58 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-80bf970f-7cf4-4cb0-a048-7c5d1f1ba5e2 tempest-VolumeDependencyTests-2025296234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b570f8e3-539d-4a45-a2cb-149564a1f160 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:33:58 devstack sudo[103638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b570f8e3-539d-4a45-a2cb-149564a1f160 Sep 16 20:33:58 devstack sudo[103638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:33:59 devstack sudo[103638]: pam_unix(sudo:session): session closed for user root Sep 16 20:33:59 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-80bf970f-7cf4-4cb0-a048-7c5d1f1ba5e2 tempest-VolumeDependencyTests-2025296234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b570f8e3-539d-4a45-a2cb-149564a1f160" returned: 0 in 0.296s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:33:59 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-80bf970f-7cf4-4cb0-a048-7c5d1f1ba5e2 tempest-VolumeDependencyTests-2025296234 None] Lock "cinder-quobyte-b570f8e3-539d-4a45-a2cb-149564a1f160" released by "delete_volume" :: held 0.753s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:33:59 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-80bf970f-7cf4-4cb0-a048-7c5d1f1ba5e2 tempest-VolumeDependencyTests-2025296234 None] Created reservations ['7c95f295-f690-435a-bf71-c77b1cd32fab', 'c5abc201-2759-4242-8876-ff5de3a76c75', '13de5ff1-dbbc-4009-a27c-1c9c937de9a8', 'c017f7d8-abca-4a42-a823-2e9dfc29b300'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:33:59 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-80bf970f-7cf4-4cb0-a048-7c5d1f1ba5e2 tempest-VolumeDependencyTests-2025296234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:33:59 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-80bf970f-7cf4-4cb0-a048-7c5d1f1ba5e2 tempest-VolumeDependencyTests-2025296234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:33:59 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-80bf970f-7cf4-4cb0-a048-7c5d1f1ba5e2 tempest-VolumeDependencyTests-2025296234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:33:59 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-80bf970f-7cf4-4cb0-a048-7c5d1f1ba5e2 tempest-VolumeDependencyTests-2025296234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:33:59 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-80bf970f-7cf4-4cb0-a048-7c5d1f1ba5e2 tempest-VolumeDependencyTests-2025296234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:33:59 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-80bf970f-7cf4-4cb0-a048-7c5d1f1ba5e2 tempest-VolumeDependencyTests-2025296234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:33:59 devstack sudo[103677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:33:59 devstack sudo[103677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:33:59 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-e2dda11b-dd5b-4dcc-b74d-b51a23277a7e tempest-VolumeDependencyTests-2025296234 None] Acquiring lock "cinder-2029f041-336c-4cb3-888f-d905d7e3fab5-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:33:59 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-e2dda11b-dd5b-4dcc-b74d-b51a23277a7e tempest-VolumeDependencyTests-2025296234 None] Lock "cinder-2029f041-336c-4cb3-888f-d905d7e3fab5-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:33:59 devstack sudo[103677]: pam_unix(sudo:session): session closed for user root Sep 16 20:33:59 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-80bf970f-7cf4-4cb0-a048-7c5d1f1ba5e2 tempest-VolumeDependencyTests-2025296234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.285s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:33:59 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-80bf970f-7cf4-4cb0-a048-7c5d1f1ba5e2 tempest-VolumeDependencyTests-2025296234 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:33:59 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-e2dda11b-dd5b-4dcc-b74d-b51a23277a7e tempest-VolumeDependencyTests-2025296234 None] Acquiring lock "cinder-quobyte-2029f041-336c-4cb3-888f-d905d7e3fab5" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:33:59 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-80bf970f-7cf4-4cb0-a048-7c5d1f1ba5e2 tempest-VolumeDependencyTests-2025296234 None] Deleted volume successfully. Sep 16 20:33:59 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-e2dda11b-dd5b-4dcc-b74d-b51a23277a7e tempest-VolumeDependencyTests-2025296234 None] Lock "cinder-quobyte-2029f041-336c-4cb3-888f-d905d7e3fab5" acquired by "delete_volume" :: waited 0.025s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:33:59 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-80bf970f-7cf4-4cb0-a048-7c5d1f1ba5e2 tempest-VolumeDependencyTests-2025296234 None] Lock "cinder-b570f8e3-539d-4a45-a2cb-149564a1f160-delete_volume" released by "delete_volume" :: held 1.282s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:33:59 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb226c49-7947-49ac-9c82-8d614f56f53f]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:33:59 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e2dda11b-dd5b-4dcc-b74d-b51a23277a7e tempest-VolumeDependencyTests-2025296234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-2029f041-336c-4cb3-888f-d905d7e3fab5 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:33:59 devstack sudo[103681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-2029f041-336c-4cb3-888f-d905d7e3fab5 Sep 16 20:33:59 devstack sudo[103681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:33:59 devstack sudo[103681]: pam_unix(sudo:session): session closed for user root Sep 16 20:33:59 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e2dda11b-dd5b-4dcc-b74d-b51a23277a7e tempest-VolumeDependencyTests-2025296234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-2029f041-336c-4cb3-888f-d905d7e3fab5" returned: 0 in 0.373s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:33:59 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e2dda11b-dd5b-4dcc-b74d-b51a23277a7e tempest-VolumeDependencyTests-2025296234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-2029f041-336c-4cb3-888f-d905d7e3fab5 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:33:59 devstack sudo[103686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-2029f041-336c-4cb3-888f-d905d7e3fab5 Sep 16 20:33:59 devstack sudo[103686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:34:00 devstack sudo[103686]: pam_unix(sudo:session): session closed for user root Sep 16 20:34:00 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e2dda11b-dd5b-4dcc-b74d-b51a23277a7e tempest-VolumeDependencyTests-2025296234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-2029f041-336c-4cb3-888f-d905d7e3fab5" returned: 0 in 0.242s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:34:00 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-e2dda11b-dd5b-4dcc-b74d-b51a23277a7e tempest-VolumeDependencyTests-2025296234 None] Lock "cinder-quobyte-2029f041-336c-4cb3-888f-d905d7e3fab5" released by "delete_volume" :: held 0.666s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:34:00 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-e2dda11b-dd5b-4dcc-b74d-b51a23277a7e tempest-VolumeDependencyTests-2025296234 None] Created reservations ['ee2dfa46-e044-4562-86f8-a6a4970751ed', '091c3c04-5088-44e9-82bc-3a285d560210', '0e9460f9-9cc5-48ca-b1ee-6162fcc44736', 'ad6fc62d-54e6-46f0-a8ef-c872ac3c348c'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:34:00 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-e2dda11b-dd5b-4dcc-b74d-b51a23277a7e tempest-VolumeDependencyTests-2025296234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:34:00 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-e2dda11b-dd5b-4dcc-b74d-b51a23277a7e tempest-VolumeDependencyTests-2025296234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:34:00 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-e2dda11b-dd5b-4dcc-b74d-b51a23277a7e tempest-VolumeDependencyTests-2025296234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:34:00 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-e2dda11b-dd5b-4dcc-b74d-b51a23277a7e tempest-VolumeDependencyTests-2025296234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:34:00 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-e2dda11b-dd5b-4dcc-b74d-b51a23277a7e tempest-VolumeDependencyTests-2025296234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:34:00 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e2dda11b-dd5b-4dcc-b74d-b51a23277a7e tempest-VolumeDependencyTests-2025296234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:34:00 devstack sudo[103689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:34:00 devstack sudo[103689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:34:00 devstack sudo[103689]: pam_unix(sudo:session): session closed for user root Sep 16 20:34:00 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e2dda11b-dd5b-4dcc-b74d-b51a23277a7e tempest-VolumeDependencyTests-2025296234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.238s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:34:00 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-e2dda11b-dd5b-4dcc-b74d-b51a23277a7e tempest-VolumeDependencyTests-2025296234 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:34:00 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-e2dda11b-dd5b-4dcc-b74d-b51a23277a7e tempest-VolumeDependencyTests-2025296234 None] Deleted volume successfully. Sep 16 20:34:00 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-e2dda11b-dd5b-4dcc-b74d-b51a23277a7e tempest-VolumeDependencyTests-2025296234 None] Lock "cinder-2029f041-336c-4cb3-888f-d905d7e3fab5-delete_volume" released by "delete_volume" :: held 1.113s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:34:10 devstack cinder-volume[86188]: DEBUG dbcounter [-] [86188] Writing DB stats cinder:SELECT=29,cinder:UPDATE=24,cinder:INSERT=8,cinder:DELETE=1 {{(pid=86188) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 20:34:10 devstack cinder-volume[86188]: DEBUG dbcounter [-] [86188] Writing DB stats cinder:SELECT=20,cinder:UPDATE=34,cinder:INSERT=7,cinder:DELETE=4 {{(pid=86188) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 20:34:16 devstack cinder-volume[86188]: INFO cinder.volume.manager [req-9a4f93db-6e38-40fd-bad0-c634ed5bc6ef req-53d1e103-e673-421e-9a1e-7da6dedd22db tempest-TestShelveInstance-1578816192 None] Terminate volume connection completed successfully. Sep 16 20:34:16 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [req-9a4f93db-6e38-40fd-bad0-c634ed5bc6ef req-53d1e103-e673-421e-9a1e-7da6dedd22db tempest-TestShelveInstance-1578816192 None] Deleting attachment ab7c4f7f-c1e6-4f45-b8ea-45b1e53d0a55. {{(pid=86188) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 16 20:34:16 devstack cinder-volume[86188]: DEBUG cinder.coordination [req-9a4f93db-6e38-40fd-bad0-c634ed5bc6ef req-63df06b3-a397-41a3-a140-5d633a1b822f tempest-TestShelveInstance-1578816192 None] Acquiring lock "cinder-84a61fd6-7a7e-4b77-9020-a29c5ad9c695-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:34:16 devstack cinder-volume[86188]: DEBUG cinder.coordination [req-9a4f93db-6e38-40fd-bad0-c634ed5bc6ef req-63df06b3-a397-41a3-a140-5d633a1b822f tempest-TestShelveInstance-1578816192 None] Lock "cinder-84a61fd6-7a7e-4b77-9020-a29c5ad9c695-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:34:16 devstack cinder-volume[86188]: DEBUG cinder.coordination [req-9a4f93db-6e38-40fd-bad0-c634ed5bc6ef req-63df06b3-a397-41a3-a140-5d633a1b822f tempest-TestShelveInstance-1578816192 None] Acquiring lock "cinder-quobyte-84a61fd6-7a7e-4b77-9020-a29c5ad9c695" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:34:16 devstack cinder-volume[86188]: DEBUG cinder.coordination [req-9a4f93db-6e38-40fd-bad0-c634ed5bc6ef req-63df06b3-a397-41a3-a140-5d633a1b822f tempest-TestShelveInstance-1578816192 None] Lock "cinder-quobyte-84a61fd6-7a7e-4b77-9020-a29c5ad9c695" acquired by "delete_volume" :: waited 0.020s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:34:16 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[27beca56-ed09-4c05-abbf-49a8435d57d4]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:34:16 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [req-9a4f93db-6e38-40fd-bad0-c634ed5bc6ef req-63df06b3-a397-41a3-a140-5d633a1b822f tempest-TestShelveInstance-1578816192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-84a61fd6-7a7e-4b77-9020-a29c5ad9c695 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:34:16 devstack sudo[103733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-84a61fd6-7a7e-4b77-9020-a29c5ad9c695 Sep 16 20:34:16 devstack sudo[103733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:34:16 devstack sudo[103733]: pam_unix(sudo:session): session closed for user root Sep 16 20:34:16 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [req-9a4f93db-6e38-40fd-bad0-c634ed5bc6ef req-63df06b3-a397-41a3-a140-5d633a1b822f tempest-TestShelveInstance-1578816192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-84a61fd6-7a7e-4b77-9020-a29c5ad9c695" returned: 0 in 0.402s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:34:16 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [req-9a4f93db-6e38-40fd-bad0-c634ed5bc6ef req-63df06b3-a397-41a3-a140-5d633a1b822f tempest-TestShelveInstance-1578816192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-84a61fd6-7a7e-4b77-9020-a29c5ad9c695 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:34:16 devstack sudo[103738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-84a61fd6-7a7e-4b77-9020-a29c5ad9c695 Sep 16 20:34:16 devstack sudo[103738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:34:17 devstack sudo[103738]: pam_unix(sudo:session): session closed for user root Sep 16 20:34:17 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [req-9a4f93db-6e38-40fd-bad0-c634ed5bc6ef req-63df06b3-a397-41a3-a140-5d633a1b822f tempest-TestShelveInstance-1578816192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-84a61fd6-7a7e-4b77-9020-a29c5ad9c695" returned: 0 in 0.270s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:34:17 devstack cinder-volume[86188]: DEBUG cinder.coordination [req-9a4f93db-6e38-40fd-bad0-c634ed5bc6ef req-63df06b3-a397-41a3-a140-5d633a1b822f tempest-TestShelveInstance-1578816192 None] Lock "cinder-quobyte-84a61fd6-7a7e-4b77-9020-a29c5ad9c695" released by "delete_volume" :: held 0.753s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:34:17 devstack cinder-volume[86188]: DEBUG cinder.quota [req-9a4f93db-6e38-40fd-bad0-c634ed5bc6ef req-63df06b3-a397-41a3-a140-5d633a1b822f tempest-TestShelveInstance-1578816192 None] Created reservations ['4e8689f1-1d59-452b-a593-857f14486cb9', '54207abc-2f97-4279-ae15-7b4acde02d55', '0bcd95a0-d79d-4ca0-95e2-76ab6cbb583f', 'c5db7eb8-ee11-49a3-b3c8-fdfd3b078b4a'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:34:17 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [req-9a4f93db-6e38-40fd-bad0-c634ed5bc6ef req-63df06b3-a397-41a3-a140-5d633a1b822f tempest-TestShelveInstance-1578816192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:34:17 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [req-9a4f93db-6e38-40fd-bad0-c634ed5bc6ef req-63df06b3-a397-41a3-a140-5d633a1b822f tempest-TestShelveInstance-1578816192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:34:17 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [req-9a4f93db-6e38-40fd-bad0-c634ed5bc6ef req-63df06b3-a397-41a3-a140-5d633a1b822f tempest-TestShelveInstance-1578816192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:34:17 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [req-9a4f93db-6e38-40fd-bad0-c634ed5bc6ef req-63df06b3-a397-41a3-a140-5d633a1b822f tempest-TestShelveInstance-1578816192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:34:17 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [req-9a4f93db-6e38-40fd-bad0-c634ed5bc6ef req-63df06b3-a397-41a3-a140-5d633a1b822f tempest-TestShelveInstance-1578816192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:34:17 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [req-9a4f93db-6e38-40fd-bad0-c634ed5bc6ef req-63df06b3-a397-41a3-a140-5d633a1b822f tempest-TestShelveInstance-1578816192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:34:17 devstack sudo[103741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:34:17 devstack sudo[103741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:34:17 devstack sudo[103741]: pam_unix(sudo:session): session closed for user root Sep 16 20:34:17 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [req-9a4f93db-6e38-40fd-bad0-c634ed5bc6ef req-63df06b3-a397-41a3-a140-5d633a1b822f tempest-TestShelveInstance-1578816192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.291s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:34:17 devstack cinder-volume[86188]: DEBUG cinder.manager [req-9a4f93db-6e38-40fd-bad0-c634ed5bc6ef req-63df06b3-a397-41a3-a140-5d633a1b822f tempest-TestShelveInstance-1578816192 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:34:17 devstack cinder-volume[86188]: INFO cinder.volume.manager [req-9a4f93db-6e38-40fd-bad0-c634ed5bc6ef req-63df06b3-a397-41a3-a140-5d633a1b822f tempest-TestShelveInstance-1578816192 None] Deleted volume successfully. Sep 16 20:34:17 devstack cinder-volume[86188]: DEBUG cinder.coordination [req-9a4f93db-6e38-40fd-bad0-c634ed5bc6ef req-63df06b3-a397-41a3-a140-5d633a1b822f tempest-TestShelveInstance-1578816192 None] Lock "cinder-84a61fd6-7a7e-4b77-9020-a29c5ad9c695-delete_volume" released by "delete_volume" :: held 1.306s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:34:26 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-313a887b-4185-40ed-9761-a223e0c4c8c9 tempest-SnapshotDependencyTests-47999895 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:34:26 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-313a887b-4185-40ed-9761-a223e0c4c8c9 tempest-SnapshotDependencyTests-47999895 None] Flow 'volume_create_manager' (0dc2523e-553c-4cbb-bf81-983d157df4c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:34:26 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-313a887b-4185-40ed-9761-a223e0c4c8c9 tempest-SnapshotDependencyTests-47999895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e6085d9-cde9-4796-b0e8-a9571fde5605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:34:26 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-313a887b-4185-40ed-9761-a223e0c4c8c9 tempest-SnapshotDependencyTests-47999895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e6085d9-cde9-4796-b0e8-a9571fde5605) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:34:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-554788564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0942af4-be32-41a6-860c-b9fc83fcba7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4013c9112bf8405abe4c98110bd646aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:34:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:34:27Z,use_quota=True,user_id='55dfa72d321a4e7b86457d966d9853c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:34:26 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-313a887b-4185-40ed-9761-a223e0c4c8c9 tempest-SnapshotDependencyTests-47999895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e32dbfd5-bae8-4bdc-a386-01611bafee40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:34:26 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-313a887b-4185-40ed-9761-a223e0c4c8c9 tempest-SnapshotDependencyTests-47999895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e32dbfd5-bae8-4bdc-a386-01611bafee40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:34:26 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-313a887b-4185-40ed-9761-a223e0c4c8c9 tempest-SnapshotDependencyTests-47999895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72336d01-69e3-4038-abfd-454a7004436b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:34:26 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-313a887b-4185-40ed-9761-a223e0c4c8c9 tempest-SnapshotDependencyTests-47999895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72336d01-69e3-4038-abfd-454a7004436b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0942af4-be32-41a6-860c-b9fc83fcba7e', 'volume_name': 'volume-a0942af4-be32-41a6-860c-b9fc83fcba7e', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:34:26 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-313a887b-4185-40ed-9761-a223e0c4c8c9 tempest-SnapshotDependencyTests-47999895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d253046-f660-499c-ba31-f0bcee73ec11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:34:26 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-313a887b-4185-40ed-9761-a223e0c4c8c9 tempest-SnapshotDependencyTests-47999895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d253046-f660-499c-ba31-f0bcee73ec11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:34:27 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-313a887b-4185-40ed-9761-a223e0c4c8c9 tempest-SnapshotDependencyTests-47999895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d0e1fa2-1b2b-455c-8836-ffed34468b2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:34:27 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-313a887b-4185-40ed-9761-a223e0c4c8c9 tempest-SnapshotDependencyTests-47999895 None] Volume a0942af4-be32-41a6-860c-b9fc83fcba7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0942af4-be32-41a6-860c-b9fc83fcba7e', 'volume_size': 1} Sep 16 20:34:27 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-313a887b-4185-40ed-9761-a223e0c4c8c9 tempest-SnapshotDependencyTests-47999895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:34:27 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-313a887b-4185-40ed-9761-a223e0c4c8c9 tempest-SnapshotDependencyTests-47999895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:34:27 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-313a887b-4185-40ed-9761-a223e0c4c8c9 tempest-SnapshotDependencyTests-47999895 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:34:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-554788564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0942af4-be32-41a6-860c-b9fc83fcba7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4013c9112bf8405abe4c98110bd646aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:34:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:34:27Z,use_quota=True,user_id='55dfa72d321a4e7b86457d966d9853c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:34:27 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-313a887b-4185-40ed-9761-a223e0c4c8c9 tempest-SnapshotDependencyTests-47999895 None] Creating volume a0942af4-be32-41a6-860c-b9fc83fcba7e {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:34:27 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-313a887b-4185-40ed-9761-a223e0c4c8c9 tempest-SnapshotDependencyTests-47999895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:34:27 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-313a887b-4185-40ed-9761-a223e0c4c8c9 tempest-SnapshotDependencyTests-47999895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:34:27 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-313a887b-4185-40ed-9761-a223e0c4c8c9 tempest-SnapshotDependencyTests-47999895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:34:27 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-313a887b-4185-40ed-9761-a223e0c4c8c9 tempest-SnapshotDependencyTests-47999895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:34:27 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-313a887b-4185-40ed-9761-a223e0c4c8c9 tempest-SnapshotDependencyTests-47999895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:34:27 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-313a887b-4185-40ed-9761-a223e0c4c8c9 tempest-SnapshotDependencyTests-47999895 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:34:27 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-313a887b-4185-40ed-9761-a223e0c4c8c9 tempest-SnapshotDependencyTests-47999895 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:34:27 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-313a887b-4185-40ed-9761-a223e0c4c8c9 tempest-SnapshotDependencyTests-47999895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a0942af4-be32-41a6-860c-b9fc83fcba7e 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:34:27 devstack sudo[103748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a0942af4-be32-41a6-860c-b9fc83fcba7e 1073741824 Sep 16 20:34:27 devstack sudo[103748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:34:27 devstack sudo[103748]: pam_unix(sudo:session): session closed for user root Sep 16 20:34:27 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-313a887b-4185-40ed-9761-a223e0c4c8c9 tempest-SnapshotDependencyTests-47999895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a0942af4-be32-41a6-860c-b9fc83fcba7e 1073741824" returned: 0 in 0.482s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:34:27 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-313a887b-4185-40ed-9761-a223e0c4c8c9 tempest-SnapshotDependencyTests-47999895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a0942af4-be32-41a6-860c-b9fc83fcba7e {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:34:27 devstack sudo[103754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a0942af4-be32-41a6-860c-b9fc83fcba7e Sep 16 20:34:27 devstack sudo[103754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:34:27 devstack sudo[103754]: pam_unix(sudo:session): session closed for user root Sep 16 20:34:27 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-313a887b-4185-40ed-9761-a223e0c4c8c9 tempest-SnapshotDependencyTests-47999895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a0942af4-be32-41a6-860c-b9fc83fcba7e" returned: 0 in 0.263s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:34:27 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-313a887b-4185-40ed-9761-a223e0c4c8c9 tempest-SnapshotDependencyTests-47999895 None] <== create_volume: return (791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:34:27 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-313a887b-4185-40ed-9761-a223e0c4c8c9 tempest-SnapshotDependencyTests-47999895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.794s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:34:27 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-313a887b-4185-40ed-9761-a223e0c4c8c9 tempest-SnapshotDependencyTests-47999895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d0e1fa2-1b2b-455c-8836-ffed34468b2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0942af4-be32-41a6-860c-b9fc83fcba7e', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:34:27 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-313a887b-4185-40ed-9761-a223e0c4c8c9 tempest-SnapshotDependencyTests-47999895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (777898de-b203-4f99-ba0c-b4d8e413e22b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:34:27 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-313a887b-4185-40ed-9761-a223e0c4c8c9 tempest-SnapshotDependencyTests-47999895 None] Volume volume-a0942af4-be32-41a6-860c-b9fc83fcba7e (a0942af4-be32-41a6-860c-b9fc83fcba7e): created successfully Sep 16 20:34:27 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-313a887b-4185-40ed-9761-a223e0c4c8c9 tempest-SnapshotDependencyTests-47999895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (777898de-b203-4f99-ba0c-b4d8e413e22b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:34:27 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-313a887b-4185-40ed-9761-a223e0c4c8c9 tempest-SnapshotDependencyTests-47999895 None] Flow 'volume_create_manager' (0dc2523e-553c-4cbb-bf81-983d157df4c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:34:27 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-313a887b-4185-40ed-9761-a223e0c4c8c9 tempest-SnapshotDependencyTests-47999895 None] Created volume successfully. Sep 16 20:34:29 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-ba3b28e4-073e-41de-a325-5eadfac8ccc4 tempest-SnapshotDependencyTests-47999895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:34:29 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-ba3b28e4-073e-41de-a325-5eadfac8ccc4 tempest-SnapshotDependencyTests-47999895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:34:29 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-ba3b28e4-073e-41de-a325-5eadfac8ccc4 tempest-SnapshotDependencyTests-47999895 None] Creating offline snapshot 17098a80-d3c2-4f34-b9da-45f1f9ae909d of volume a0942af4-be32-41a6-860c-b9fc83fcba7e {{(pid=86188) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 20:34:29 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[86aab46f-57ec-45e6-9dc5-a17ce6898b0f]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:34:29 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ba3b28e4-073e-41de-a325-5eadfac8ccc4 tempest-SnapshotDependencyTests-47999895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a0942af4-be32-41a6-860c-b9fc83fcba7e {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:34:29 devstack sudo[103758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a0942af4-be32-41a6-860c-b9fc83fcba7e Sep 16 20:34:29 devstack sudo[103758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:34:29 devstack sudo[103758]: pam_unix(sudo:session): session closed for user root Sep 16 20:34:29 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ba3b28e4-073e-41de-a325-5eadfac8ccc4 tempest-SnapshotDependencyTests-47999895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a0942af4-be32-41a6-860c-b9fc83fcba7e" returned: 0 in 0.387s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:34:29 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ba3b28e4-073e-41de-a325-5eadfac8ccc4 tempest-SnapshotDependencyTests-47999895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a0942af4-be32-41a6-860c-b9fc83fcba7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a0942af4-be32-41a6-860c-b9fc83fcba7e.17098a80-d3c2-4f34-b9da-45f1f9ae909d 1G {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:34:29 devstack sudo[103763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a0942af4-be32-41a6-860c-b9fc83fcba7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a0942af4-be32-41a6-860c-b9fc83fcba7e.17098a80-d3c2-4f34-b9da-45f1f9ae909d 1G Sep 16 20:34:29 devstack sudo[103763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:34:30 devstack sudo[103763]: pam_unix(sudo:session): session closed for user root Sep 16 20:34:30 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ba3b28e4-073e-41de-a325-5eadfac8ccc4 tempest-SnapshotDependencyTests-47999895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a0942af4-be32-41a6-860c-b9fc83fcba7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a0942af4-be32-41a6-860c-b9fc83fcba7e.17098a80-d3c2-4f34-b9da-45f1f9ae909d 1G" returned: 0 in 0.480s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:34:30 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ba3b28e4-073e-41de-a325-5eadfac8ccc4 tempest-SnapshotDependencyTests-47999895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0942af4-be32-41a6-860c-b9fc83fcba7e -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a0942af4-be32-41a6-860c-b9fc83fcba7e.17098a80-d3c2-4f34-b9da-45f1f9ae909d {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:34:30 devstack sudo[103768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0942af4-be32-41a6-860c-b9fc83fcba7e -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a0942af4-be32-41a6-860c-b9fc83fcba7e.17098a80-d3c2-4f34-b9da-45f1f9ae909d Sep 16 20:34:30 devstack sudo[103768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:34:30 devstack sudo[103768]: pam_unix(sudo:session): session closed for user root Sep 16 20:34:30 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ba3b28e4-073e-41de-a325-5eadfac8ccc4 tempest-SnapshotDependencyTests-47999895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0942af4-be32-41a6-860c-b9fc83fcba7e -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a0942af4-be32-41a6-860c-b9fc83fcba7e.17098a80-d3c2-4f34-b9da-45f1f9ae909d" returned: 0 in 0.314s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:34:30 devstack cinder-volume[86188]: WARNING cinder.volume.drivers.remotefs [None req-ba3b28e4-073e-41de-a325-5eadfac8ccc4 tempest-SnapshotDependencyTests-47999895 None] /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a0942af4-be32-41a6-860c-b9fc83fcba7e.17098a80-d3c2-4f34-b9da-45f1f9ae909d is being set with open permissions: ugo+rw Sep 16 20:34:30 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ba3b28e4-073e-41de-a325-5eadfac8ccc4 tempest-SnapshotDependencyTests-47999895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a0942af4-be32-41a6-860c-b9fc83fcba7e.17098a80-d3c2-4f34-b9da-45f1f9ae909d {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:34:30 devstack sudo[103775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a0942af4-be32-41a6-860c-b9fc83fcba7e.17098a80-d3c2-4f34-b9da-45f1f9ae909d Sep 16 20:34:30 devstack sudo[103775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:34:30 devstack sudo[103775]: pam_unix(sudo:session): session closed for user root Sep 16 20:34:30 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ba3b28e4-073e-41de-a325-5eadfac8ccc4 tempest-SnapshotDependencyTests-47999895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a0942af4-be32-41a6-860c-b9fc83fcba7e.17098a80-d3c2-4f34-b9da-45f1f9ae909d" returned: 0 in 0.264s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:34:30 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ba3b28e4-073e-41de-a325-5eadfac8ccc4 tempest-SnapshotDependencyTests-47999895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a0942af4-be32-41a6-860c-b9fc83fcba7e.info {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:34:30 devstack sudo[103779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a0942af4-be32-41a6-860c-b9fc83fcba7e.info Sep 16 20:34:30 devstack sudo[103779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:34:31 devstack sudo[103779]: pam_unix(sudo:session): session closed for user root Sep 16 20:34:31 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ba3b28e4-073e-41de-a325-5eadfac8ccc4 tempest-SnapshotDependencyTests-47999895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a0942af4-be32-41a6-860c-b9fc83fcba7e.info" returned: 0 in 0.268s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:34:31 devstack cinder-volume[86188]: WARNING cinder.volume.drivers.remotefs [None req-ba3b28e4-073e-41de-a325-5eadfac8ccc4 tempest-SnapshotDependencyTests-47999895 None] /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a0942af4-be32-41a6-860c-b9fc83fcba7e.info is being set with open permissions: ugo+rw Sep 16 20:34:31 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ba3b28e4-073e-41de-a325-5eadfac8ccc4 tempest-SnapshotDependencyTests-47999895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a0942af4-be32-41a6-860c-b9fc83fcba7e.info {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:34:31 devstack sudo[103782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a0942af4-be32-41a6-860c-b9fc83fcba7e.info Sep 16 20:34:31 devstack sudo[103782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:34:31 devstack sudo[103782]: pam_unix(sudo:session): session closed for user root Sep 16 20:34:31 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ba3b28e4-073e-41de-a325-5eadfac8ccc4 tempest-SnapshotDependencyTests-47999895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a0942af4-be32-41a6-860c-b9fc83fcba7e.info" returned: 0 in 0.254s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:34:31 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-ba3b28e4-073e-41de-a325-5eadfac8ccc4 tempest-SnapshotDependencyTests-47999895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.066s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:34:31 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-ba3b28e4-073e-41de-a325-5eadfac8ccc4 tempest-SnapshotDependencyTests-47999895 None] Create snapshot completed successfully Sep 16 20:34:33 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b87cd27-7e0b-43ad-81f3-1df055bcc35c tempest-SnapshotDependencyTests-47999895 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:34:33 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-4b87cd27-7e0b-43ad-81f3-1df055bcc35c tempest-SnapshotDependencyTests-47999895 None] Flow 'volume_create_manager' (74e0d2d3-4ee7-45fd-a9c8-f4eca89bc4f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:34:33 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-4b87cd27-7e0b-43ad-81f3-1df055bcc35c tempest-SnapshotDependencyTests-47999895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09e52fc1-d4b3-4a4d-8148-127b4df83ed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:34:33 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-4b87cd27-7e0b-43ad-81f3-1df055bcc35c tempest-SnapshotDependencyTests-47999895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09e52fc1-d4b3-4a4d-8148-127b4df83ed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:34:33Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11f3a81b-c0ad-4804-8471-b8b88d736f32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4013c9112bf8405abe4c98110bd646aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:34:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=17098a80-d3c2-4f34-b9da-45f1f9ae909d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:34:33Z,use_quota=True,user_id='55dfa72d321a4e7b86457d966d9853c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:34:33 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-4b87cd27-7e0b-43ad-81f3-1df055bcc35c tempest-SnapshotDependencyTests-47999895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4edf498-4604-4250-b568-ee35ed7da5da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:34:33 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-4b87cd27-7e0b-43ad-81f3-1df055bcc35c tempest-SnapshotDependencyTests-47999895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4edf498-4604-4250-b568-ee35ed7da5da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:34:33 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-4b87cd27-7e0b-43ad-81f3-1df055bcc35c tempest-SnapshotDependencyTests-47999895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88fbdb81-e685-4857-a6b1-5f2db3d37e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:34:33 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-4b87cd27-7e0b-43ad-81f3-1df055bcc35c tempest-SnapshotDependencyTests-47999895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88fbdb81-e685-4857-a6b1-5f2db3d37e97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '11f3a81b-c0ad-4804-8471-b8b88d736f32', 'volume_name': 'volume-11f3a81b-c0ad-4804-8471-b8b88d736f32', 'volume_size': 1, 'snapshot_id': '17098a80-d3c2-4f34-b9da-45f1f9ae909d'}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:34:33 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-4b87cd27-7e0b-43ad-81f3-1df055bcc35c tempest-SnapshotDependencyTests-47999895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5591a33b-8253-4257-a8fa-524f8dad58b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:34:33 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-4b87cd27-7e0b-43ad-81f3-1df055bcc35c tempest-SnapshotDependencyTests-47999895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5591a33b-8253-4257-a8fa-524f8dad58b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:34:33 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-4b87cd27-7e0b-43ad-81f3-1df055bcc35c tempest-SnapshotDependencyTests-47999895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f37a930-7cad-45f8-916f-7e62816ebce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:34:33 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-4b87cd27-7e0b-43ad-81f3-1df055bcc35c tempest-SnapshotDependencyTests-47999895 None] Volume 11f3a81b-c0ad-4804-8471-b8b88d736f32: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-11f3a81b-c0ad-4804-8471-b8b88d736f32', 'volume_size': 1, 'snapshot_id': '17098a80-d3c2-4f34-b9da-45f1f9ae909d'} Sep 16 20:34:33 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-4b87cd27-7e0b-43ad-81f3-1df055bcc35c tempest-SnapshotDependencyTests-47999895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:34:33 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-4b87cd27-7e0b-43ad-81f3-1df055bcc35c tempest-SnapshotDependencyTests-47999895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:34:33 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-4b87cd27-7e0b-43ad-81f3-1df055bcc35c tempest-SnapshotDependencyTests-47999895 None] Acquiring lock "cinder-quobyte-17098a80-d3c2-4f34-b9da-45f1f9ae909d-11f3a81b-c0ad-4804-8471-b8b88d736f32" by "_create_volume_from_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:34:33 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-4b87cd27-7e0b-43ad-81f3-1df055bcc35c tempest-SnapshotDependencyTests-47999895 None] Lock "cinder-quobyte-17098a80-d3c2-4f34-b9da-45f1f9ae909d-11f3a81b-c0ad-4804-8471-b8b88d736f32" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:34:33 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-4b87cd27-7e0b-43ad-81f3-1df055bcc35c tempest-SnapshotDependencyTests-47999895 None] Creating volume 11f3a81b-c0ad-4804-8471-b8b88d736f32 from snapshot 17098a80-d3c2-4f34-b9da-45f1f9ae909d {{(pid=86188) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 16 20:34:33 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-4b87cd27-7e0b-43ad-81f3-1df055bcc35c tempest-SnapshotDependencyTests-47999895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:34:33 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-4b87cd27-7e0b-43ad-81f3-1df055bcc35c tempest-SnapshotDependencyTests-47999895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:34:33 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-4b87cd27-7e0b-43ad-81f3-1df055bcc35c tempest-SnapshotDependencyTests-47999895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:34:33 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-4b87cd27-7e0b-43ad-81f3-1df055bcc35c tempest-SnapshotDependencyTests-47999895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:34:33 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-4b87cd27-7e0b-43ad-81f3-1df055bcc35c tempest-SnapshotDependencyTests-47999895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:34:33 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-4b87cd27-7e0b-43ad-81f3-1df055bcc35c tempest-SnapshotDependencyTests-47999895 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:34:33 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-4b87cd27-7e0b-43ad-81f3-1df055bcc35c tempest-SnapshotDependencyTests-47999895 None] Acquiring lock "cinder-quobyte-11f3a81b-c0ad-4804-8471-b8b88d736f32" by "_copy_volume_from_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:34:33 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-4b87cd27-7e0b-43ad-81f3-1df055bcc35c tempest-SnapshotDependencyTests-47999895 None] Lock "cinder-quobyte-11f3a81b-c0ad-4804-8471-b8b88d736f32" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:34:33 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-4b87cd27-7e0b-43ad-81f3-1df055bcc35c tempest-SnapshotDependencyTests-47999895 None] snapshot: 17098a80-d3c2-4f34-b9da-45f1f9ae909d, volume: 11f3a81b-c0ad-4804-8471-b8b88d736f32, {{(pid=86188) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 16 20:34:33 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-4b87cd27-7e0b-43ad-81f3-1df055bcc35c tempest-SnapshotDependencyTests-47999895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:34:33 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-4b87cd27-7e0b-43ad-81f3-1df055bcc35c tempest-SnapshotDependencyTests-47999895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:34:33 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-4b87cd27-7e0b-43ad-81f3-1df055bcc35c tempest-SnapshotDependencyTests-47999895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:34:33 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-4b87cd27-7e0b-43ad-81f3-1df055bcc35c tempest-SnapshotDependencyTests-47999895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:34:33 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-4b87cd27-7e0b-43ad-81f3-1df055bcc35c tempest-SnapshotDependencyTests-47999895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:34:33 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[298f5575-2023-4275-9ebb-dd2b762915e3]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:34:33 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-4b87cd27-7e0b-43ad-81f3-1df055bcc35c tempest-SnapshotDependencyTests-47999895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a0942af4-be32-41a6-860c-b9fc83fcba7e.17098a80-d3c2-4f34-b9da-45f1f9ae909d {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:34:33 devstack sudo[103785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a0942af4-be32-41a6-860c-b9fc83fcba7e.17098a80-d3c2-4f34-b9da-45f1f9ae909d Sep 16 20:34:33 devstack sudo[103785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:34:33 devstack sudo[103785]: pam_unix(sudo:session): session closed for user root Sep 16 20:34:33 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-4b87cd27-7e0b-43ad-81f3-1df055bcc35c tempest-SnapshotDependencyTests-47999895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a0942af4-be32-41a6-860c-b9fc83fcba7e.17098a80-d3c2-4f34-b9da-45f1f9ae909d" returned: 0 in 0.396s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:34:33 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-4b87cd27-7e0b-43ad-81f3-1df055bcc35c tempest-SnapshotDependencyTests-47999895 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a0942af4-be32-41a6-860c-b9fc83fcba7e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86188) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 20:34:33 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3c72593-81dc-438f-88a7-aabf834bf9d5]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:34:33 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-4b87cd27-7e0b-43ad-81f3-1df055bcc35c tempest-SnapshotDependencyTests-47999895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a0942af4-be32-41a6-860c-b9fc83fcba7e {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:34:33 devstack sudo[103791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a0942af4-be32-41a6-860c-b9fc83fcba7e Sep 16 20:34:33 devstack sudo[103791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:34:34 devstack sudo[103791]: pam_unix(sudo:session): session closed for user root Sep 16 20:34:34 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-4b87cd27-7e0b-43ad-81f3-1df055bcc35c tempest-SnapshotDependencyTests-47999895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a0942af4-be32-41a6-860c-b9fc83fcba7e" returned: 0 in 0.401s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:34:34 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-4b87cd27-7e0b-43ad-81f3-1df055bcc35c tempest-SnapshotDependencyTests-47999895 None] will copy from snapshot at /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a0942af4-be32-41a6-860c-b9fc83fcba7e {{(pid=86188) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 16 20:34:34 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-4b87cd27-7e0b-43ad-81f3-1df055bcc35c tempest-SnapshotDependencyTests-47999895 None] Creating direct copy from snapshot {{(pid=86188) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 16 20:34:34 devstack cinder-volume[86188]: DEBUG cinder.utils [None req-4b87cd27-7e0b-43ad-81f3-1df055bcc35c tempest-SnapshotDependencyTests-47999895 None] Path /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-11f3a81b-c0ad-4804-8471-b8b88d736f32 not found in is_blk_device check {{(pid=86188) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 16 20:34:34 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-4b87cd27-7e0b-43ad-81f3-1df055bcc35c tempest-SnapshotDependencyTests-47999895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a0942af4-be32-41a6-860c-b9fc83fcba7e /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-11f3a81b-c0ad-4804-8471-b8b88d736f32 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:34:34 devstack sudo[103796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a0942af4-be32-41a6-860c-b9fc83fcba7e /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-11f3a81b-c0ad-4804-8471-b8b88d736f32 Sep 16 20:34:34 devstack sudo[103796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:34:40 devstack sudo[103796]: pam_unix(sudo:session): session closed for user root Sep 16 20:34:40 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-4b87cd27-7e0b-43ad-81f3-1df055bcc35c tempest-SnapshotDependencyTests-47999895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a0942af4-be32-41a6-860c-b9fc83fcba7e /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-11f3a81b-c0ad-4804-8471-b8b88d736f32" returned: 0 in 6.878s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:34:40 devstack cinder-volume[86188]: DEBUG cinder.image.image_utils [None req-4b87cd27-7e0b-43ad-81f3-1df055bcc35c tempest-SnapshotDependencyTests-47999895 None] Image conversion details: src /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a0942af4-be32-41a6-860c-b9fc83fcba7e, size 1024.00 MB, duration 6.88 sec, destination /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-11f3a81b-c0ad-4804-8471-b8b88d736f32 {{(pid=86188) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 16 20:34:40 devstack cinder-volume[86188]: INFO cinder.image.image_utils [None req-4b87cd27-7e0b-43ad-81f3-1df055bcc35c tempest-SnapshotDependencyTests-47999895 None] Converted 1024.00 MB image at 148.86 MB/s Sep 16 20:34:40 devstack cinder-volume[86188]: WARNING cinder.volume.drivers.remotefs [None req-4b87cd27-7e0b-43ad-81f3-1df055bcc35c tempest-SnapshotDependencyTests-47999895 None] /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-11f3a81b-c0ad-4804-8471-b8b88d736f32 is being set with open permissions: ugo+rw Sep 16 20:34:40 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-4b87cd27-7e0b-43ad-81f3-1df055bcc35c tempest-SnapshotDependencyTests-47999895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-11f3a81b-c0ad-4804-8471-b8b88d736f32 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:34:40 devstack sudo[103812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-11f3a81b-c0ad-4804-8471-b8b88d736f32 Sep 16 20:34:40 devstack sudo[103812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:34:41 devstack sudo[103812]: pam_unix(sudo:session): session closed for user root Sep 16 20:34:41 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-4b87cd27-7e0b-43ad-81f3-1df055bcc35c tempest-SnapshotDependencyTests-47999895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-11f3a81b-c0ad-4804-8471-b8b88d736f32" returned: 0 in 0.247s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:34:41 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-4b87cd27-7e0b-43ad-81f3-1df055bcc35c tempest-SnapshotDependencyTests-47999895 None] Lock "cinder-quobyte-11f3a81b-c0ad-4804-8471-b8b88d736f32" released by "_copy_volume_from_snapshot" :: held 8.017s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:34:41 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-4b87cd27-7e0b-43ad-81f3-1df055bcc35c tempest-SnapshotDependencyTests-47999895 None] Lock "cinder-quobyte-17098a80-d3c2-4f34-b9da-45f1f9ae909d-11f3a81b-c0ad-4804-8471-b8b88d736f32" released by "_create_volume_from_snapshot" :: held 8.094s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:34:41 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-4b87cd27-7e0b-43ad-81f3-1df055bcc35c tempest-SnapshotDependencyTests-47999895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.114s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:34:41 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-4b87cd27-7e0b-43ad-81f3-1df055bcc35c tempest-SnapshotDependencyTests-47999895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f37a930-7cad-45f8-916f-7e62816ebce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11f3a81b-c0ad-4804-8471-b8b88d736f32', 'volume_size': 1, 'snapshot_id': '17098a80-d3c2-4f34-b9da-45f1f9ae909d'}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:34:41 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-4b87cd27-7e0b-43ad-81f3-1df055bcc35c tempest-SnapshotDependencyTests-47999895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62af656a-3614-4b88-bed7-900eb1679e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:34:41 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-4b87cd27-7e0b-43ad-81f3-1df055bcc35c tempest-SnapshotDependencyTests-47999895 None] Volume volume-11f3a81b-c0ad-4804-8471-b8b88d736f32 (11f3a81b-c0ad-4804-8471-b8b88d736f32): created successfully Sep 16 20:34:41 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-4b87cd27-7e0b-43ad-81f3-1df055bcc35c tempest-SnapshotDependencyTests-47999895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62af656a-3614-4b88-bed7-900eb1679e6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:34:41 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-4b87cd27-7e0b-43ad-81f3-1df055bcc35c tempest-SnapshotDependencyTests-47999895 None] Flow 'volume_create_manager' (74e0d2d3-4ee7-45fd-a9c8-f4eca89bc4f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:34:41 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-4b87cd27-7e0b-43ad-81f3-1df055bcc35c tempest-SnapshotDependencyTests-47999895 None] Created volume successfully. Sep 16 20:34:41 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-b6e4fef2-3b59-492c-9a37-d2add4240328 tempest-SnapshotDependencyTests-47999895 None] Acquiring lock "cinder-17098a80-d3c2-4f34-b9da-45f1f9ae909d-delete_snapshot" by "delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:34:41 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-b6e4fef2-3b59-492c-9a37-d2add4240328 tempest-SnapshotDependencyTests-47999895 None] Lock "cinder-17098a80-d3c2-4f34-b9da-45f1f9ae909d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:34:41 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-b6e4fef2-3b59-492c-9a37-d2add4240328 tempest-SnapshotDependencyTests-47999895 None] Acquiring lock "cinder-quobyte-a0942af4-be32-41a6-860c-b9fc83fcba7e" by "delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:34:41 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-b6e4fef2-3b59-492c-9a37-d2add4240328 tempest-SnapshotDependencyTests-47999895 None] Lock "cinder-quobyte-a0942af4-be32-41a6-860c-b9fc83fcba7e" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:34:41 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-b6e4fef2-3b59-492c-9a37-d2add4240328 tempest-SnapshotDependencyTests-47999895 None] Acquiring lock "cinder-quobyte-17098a80-d3c2-4f34-b9da-45f1f9ae909d" by "_delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:34:41 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-b6e4fef2-3b59-492c-9a37-d2add4240328 tempest-SnapshotDependencyTests-47999895 None] Lock "cinder-quobyte-17098a80-d3c2-4f34-b9da-45f1f9ae909d" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:34:41 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-b6e4fef2-3b59-492c-9a37-d2add4240328 tempest-SnapshotDependencyTests-47999895 None] Deleting offline snapshot 17098a80-d3c2-4f34-b9da-45f1f9ae909d of volume a0942af4-be32-41a6-860c-b9fc83fcba7e {{(pid=86188) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 20:34:41 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-b6e4fef2-3b59-492c-9a37-d2add4240328 tempest-SnapshotDependencyTests-47999895 None] snapshot_file for this snap is: volume-a0942af4-be32-41a6-860c-b9fc83fcba7e.17098a80-d3c2-4f34-b9da-45f1f9ae909d {{(pid=86188) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 20:34:41 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[efc40e35-0184-4e4b-821c-708c65980df2]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:34:41 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b6e4fef2-3b59-492c-9a37-d2add4240328 tempest-SnapshotDependencyTests-47999895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a0942af4-be32-41a6-860c-b9fc83fcba7e.17098a80-d3c2-4f34-b9da-45f1f9ae909d {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:34:42 devstack sudo[103816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a0942af4-be32-41a6-860c-b9fc83fcba7e.17098a80-d3c2-4f34-b9da-45f1f9ae909d Sep 16 20:34:42 devstack sudo[103816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:34:42 devstack sudo[103816]: pam_unix(sudo:session): session closed for user root Sep 16 20:34:42 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b6e4fef2-3b59-492c-9a37-d2add4240328 tempest-SnapshotDependencyTests-47999895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a0942af4-be32-41a6-860c-b9fc83fcba7e.17098a80-d3c2-4f34-b9da-45f1f9ae909d" returned: 0 in 0.438s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:34:42 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-b6e4fef2-3b59-492c-9a37-d2add4240328 tempest-SnapshotDependencyTests-47999895 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a0942af4-be32-41a6-860c-b9fc83fcba7e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86188) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 20:34:42 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d9a20a4-4e05-45f3-ad74-27c1988afd2c]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:34:42 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b6e4fef2-3b59-492c-9a37-d2add4240328 tempest-SnapshotDependencyTests-47999895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a0942af4-be32-41a6-860c-b9fc83fcba7e {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:34:42 devstack sudo[103822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a0942af4-be32-41a6-860c-b9fc83fcba7e Sep 16 20:34:42 devstack sudo[103822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:34:43 devstack sudo[103822]: pam_unix(sudo:session): session closed for user root Sep 16 20:34:43 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b6e4fef2-3b59-492c-9a37-d2add4240328 tempest-SnapshotDependencyTests-47999895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a0942af4-be32-41a6-860c-b9fc83fcba7e" returned: 0 in 0.575s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:34:43 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b6e4fef2-3b59-492c-9a37-d2add4240328 tempest-SnapshotDependencyTests-47999895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a0942af4-be32-41a6-860c-b9fc83fcba7e.17098a80-d3c2-4f34-b9da-45f1f9ae909d {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:34:43 devstack sudo[103827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a0942af4-be32-41a6-860c-b9fc83fcba7e.17098a80-d3c2-4f34-b9da-45f1f9ae909d Sep 16 20:34:43 devstack sudo[103827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:34:43 devstack sudo[103827]: pam_unix(sudo:session): session closed for user root Sep 16 20:34:43 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b6e4fef2-3b59-492c-9a37-d2add4240328 tempest-SnapshotDependencyTests-47999895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a0942af4-be32-41a6-860c-b9fc83fcba7e.17098a80-d3c2-4f34-b9da-45f1f9ae909d" returned: 0 in 0.391s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:34:43 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b6e4fef2-3b59-492c-9a37-d2add4240328 tempest-SnapshotDependencyTests-47999895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a0942af4-be32-41a6-860c-b9fc83fcba7e.17098a80-d3c2-4f34-b9da-45f1f9ae909d {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:34:43 devstack sudo[103832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a0942af4-be32-41a6-860c-b9fc83fcba7e.17098a80-d3c2-4f34-b9da-45f1f9ae909d Sep 16 20:34:43 devstack sudo[103832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:34:43 devstack sudo[103832]: pam_unix(sudo:session): session closed for user root Sep 16 20:34:43 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b6e4fef2-3b59-492c-9a37-d2add4240328 tempest-SnapshotDependencyTests-47999895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a0942af4-be32-41a6-860c-b9fc83fcba7e.17098a80-d3c2-4f34-b9da-45f1f9ae909d" returned: 0 in 0.277s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:34:43 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-b6e4fef2-3b59-492c-9a37-d2add4240328 tempest-SnapshotDependencyTests-47999895 None] Lock "cinder-quobyte-17098a80-d3c2-4f34-b9da-45f1f9ae909d" released by "_delete_snapshot" :: held 1.816s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:34:43 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-b6e4fef2-3b59-492c-9a37-d2add4240328 tempest-SnapshotDependencyTests-47999895 None] Lock "cinder-quobyte-a0942af4-be32-41a6-860c-b9fc83fcba7e" released by "delete_snapshot" :: held 1.839s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:34:43 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-b6e4fef2-3b59-492c-9a37-d2add4240328 tempest-SnapshotDependencyTests-47999895 None] Created reservations ['2228fab9-0183-44ff-843d-3a52013feeac', 'c239df43-41b0-4b11-9df1-63d89741d076', '0150fa1b-46ce-4124-adc6-cf9ca30ad77c', '7b976758-f109-43c2-acb6-dc34d13a37cc'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:34:43 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-b6e4fef2-3b59-492c-9a37-d2add4240328 tempest-SnapshotDependencyTests-47999895 None] Delete snapshot completed successfully. Sep 16 20:34:43 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-b6e4fef2-3b59-492c-9a37-d2add4240328 tempest-SnapshotDependencyTests-47999895 None] Lock "cinder-17098a80-d3c2-4f34-b9da-45f1f9ae909d-delete_snapshot" released by "delete_snapshot" :: held 2.034s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:34:44 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-847fb4dc-5371-4eb1-ab7c-2da2e09330ac tempest-SnapshotDependencyTests-47999895 None] Acquiring lock "cinder-a0942af4-be32-41a6-860c-b9fc83fcba7e-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:34:44 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-847fb4dc-5371-4eb1-ab7c-2da2e09330ac tempest-SnapshotDependencyTests-47999895 None] Lock "cinder-a0942af4-be32-41a6-860c-b9fc83fcba7e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:34:44 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-847fb4dc-5371-4eb1-ab7c-2da2e09330ac tempest-SnapshotDependencyTests-47999895 None] Acquiring lock "cinder-quobyte-a0942af4-be32-41a6-860c-b9fc83fcba7e" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:34:44 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-847fb4dc-5371-4eb1-ab7c-2da2e09330ac tempest-SnapshotDependencyTests-47999895 None] Lock "cinder-quobyte-a0942af4-be32-41a6-860c-b9fc83fcba7e" acquired by "delete_volume" :: waited 0.029s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:34:44 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[662024ee-1d36-40a9-9ca1-0a5d46c69e9f]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:34:44 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-847fb4dc-5371-4eb1-ab7c-2da2e09330ac tempest-SnapshotDependencyTests-47999895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a0942af4-be32-41a6-860c-b9fc83fcba7e {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:34:44 devstack sudo[103835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a0942af4-be32-41a6-860c-b9fc83fcba7e Sep 16 20:34:44 devstack sudo[103835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:34:44 devstack sudo[103835]: pam_unix(sudo:session): session closed for user root Sep 16 20:34:44 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-847fb4dc-5371-4eb1-ab7c-2da2e09330ac tempest-SnapshotDependencyTests-47999895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a0942af4-be32-41a6-860c-b9fc83fcba7e" returned: 0 in 0.373s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:34:44 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-847fb4dc-5371-4eb1-ab7c-2da2e09330ac tempest-SnapshotDependencyTests-47999895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a0942af4-be32-41a6-860c-b9fc83fcba7e {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:34:44 devstack sudo[103840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a0942af4-be32-41a6-860c-b9fc83fcba7e Sep 16 20:34:44 devstack sudo[103840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:34:44 devstack sudo[103840]: pam_unix(sudo:session): session closed for user root Sep 16 20:34:44 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-847fb4dc-5371-4eb1-ab7c-2da2e09330ac tempest-SnapshotDependencyTests-47999895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a0942af4-be32-41a6-860c-b9fc83fcba7e" returned: 0 in 0.245s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:34:44 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-847fb4dc-5371-4eb1-ab7c-2da2e09330ac tempest-SnapshotDependencyTests-47999895 None] Lock "cinder-quobyte-a0942af4-be32-41a6-860c-b9fc83fcba7e" released by "delete_volume" :: held 0.698s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:34:44 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-847fb4dc-5371-4eb1-ab7c-2da2e09330ac tempest-SnapshotDependencyTests-47999895 None] Created reservations ['c690cb06-4421-46cc-9d23-25693f5283a9', 'f7ace59d-18b9-4ede-91d4-4a9b0bd1677b', 'c763f328-e275-4906-aff5-558da0901667', '87da9f12-1d3d-4b20-86ab-b22d18e0ffd5'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:34:44 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-847fb4dc-5371-4eb1-ab7c-2da2e09330ac tempest-SnapshotDependencyTests-47999895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:34:44 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-847fb4dc-5371-4eb1-ab7c-2da2e09330ac tempest-SnapshotDependencyTests-47999895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:34:44 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-847fb4dc-5371-4eb1-ab7c-2da2e09330ac tempest-SnapshotDependencyTests-47999895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:34:44 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-847fb4dc-5371-4eb1-ab7c-2da2e09330ac tempest-SnapshotDependencyTests-47999895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:34:44 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-847fb4dc-5371-4eb1-ab7c-2da2e09330ac tempest-SnapshotDependencyTests-47999895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:34:44 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-847fb4dc-5371-4eb1-ab7c-2da2e09330ac tempest-SnapshotDependencyTests-47999895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:34:45 devstack sudo[103843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:34:45 devstack sudo[103843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:34:45 devstack sudo[103843]: pam_unix(sudo:session): session closed for user root Sep 16 20:34:45 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-6c00e71a-6f29-4be2-94db-66a7b5ce9684 tempest-SnapshotDependencyTests-47999895 None] Acquiring lock "cinder-11f3a81b-c0ad-4804-8471-b8b88d736f32-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:34:45 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-847fb4dc-5371-4eb1-ab7c-2da2e09330ac tempest-SnapshotDependencyTests-47999895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.268s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:34:45 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-847fb4dc-5371-4eb1-ab7c-2da2e09330ac tempest-SnapshotDependencyTests-47999895 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:34:45 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-847fb4dc-5371-4eb1-ab7c-2da2e09330ac tempest-SnapshotDependencyTests-47999895 None] Deleted volume successfully. Sep 16 20:34:45 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-6c00e71a-6f29-4be2-94db-66a7b5ce9684 tempest-SnapshotDependencyTests-47999895 None] Lock "cinder-11f3a81b-c0ad-4804-8471-b8b88d736f32-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:34:45 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-847fb4dc-5371-4eb1-ab7c-2da2e09330ac tempest-SnapshotDependencyTests-47999895 None] Lock "cinder-a0942af4-be32-41a6-860c-b9fc83fcba7e-delete_volume" released by "delete_volume" :: held 1.222s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:34:45 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-6c00e71a-6f29-4be2-94db-66a7b5ce9684 tempest-SnapshotDependencyTests-47999895 None] Acquiring lock "cinder-quobyte-11f3a81b-c0ad-4804-8471-b8b88d736f32" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:34:45 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-6c00e71a-6f29-4be2-94db-66a7b5ce9684 tempest-SnapshotDependencyTests-47999895 None] Lock "cinder-quobyte-11f3a81b-c0ad-4804-8471-b8b88d736f32" acquired by "delete_volume" :: waited 0.014s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:34:45 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0da5ecb-c2af-4b1d-a017-990a8552eb09]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:34:45 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-6c00e71a-6f29-4be2-94db-66a7b5ce9684 tempest-SnapshotDependencyTests-47999895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-11f3a81b-c0ad-4804-8471-b8b88d736f32 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:34:45 devstack sudo[103846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-11f3a81b-c0ad-4804-8471-b8b88d736f32 Sep 16 20:34:45 devstack sudo[103846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:34:45 devstack sudo[103846]: pam_unix(sudo:session): session closed for user root Sep 16 20:34:45 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-6c00e71a-6f29-4be2-94db-66a7b5ce9684 tempest-SnapshotDependencyTests-47999895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-11f3a81b-c0ad-4804-8471-b8b88d736f32" returned: 0 in 0.398s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:34:45 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-6c00e71a-6f29-4be2-94db-66a7b5ce9684 tempest-SnapshotDependencyTests-47999895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-11f3a81b-c0ad-4804-8471-b8b88d736f32 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:34:45 devstack sudo[103852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-11f3a81b-c0ad-4804-8471-b8b88d736f32 Sep 16 20:34:45 devstack sudo[103852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:34:46 devstack sudo[103852]: pam_unix(sudo:session): session closed for user root Sep 16 20:34:46 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-6c00e71a-6f29-4be2-94db-66a7b5ce9684 tempest-SnapshotDependencyTests-47999895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-11f3a81b-c0ad-4804-8471-b8b88d736f32" returned: 0 in 0.289s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:34:46 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-6c00e71a-6f29-4be2-94db-66a7b5ce9684 tempest-SnapshotDependencyTests-47999895 None] Lock "cinder-quobyte-11f3a81b-c0ad-4804-8471-b8b88d736f32" released by "delete_volume" :: held 0.740s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:34:46 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-6c00e71a-6f29-4be2-94db-66a7b5ce9684 tempest-SnapshotDependencyTests-47999895 None] Created reservations ['e8f2e606-aa3b-44ef-b0d9-1401d0d924d7', '4d31eb01-0c1b-43b6-8f40-37c1a6d9c7d2', '0ed2ef92-d395-424b-be3b-a5ee06873948', '17ff3ce1-1214-437f-a597-8dcba19af0f1'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:34:46 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-6c00e71a-6f29-4be2-94db-66a7b5ce9684 tempest-SnapshotDependencyTests-47999895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:34:46 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-6c00e71a-6f29-4be2-94db-66a7b5ce9684 tempest-SnapshotDependencyTests-47999895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:34:46 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-6c00e71a-6f29-4be2-94db-66a7b5ce9684 tempest-SnapshotDependencyTests-47999895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:34:46 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-6c00e71a-6f29-4be2-94db-66a7b5ce9684 tempest-SnapshotDependencyTests-47999895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:34:46 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-6c00e71a-6f29-4be2-94db-66a7b5ce9684 tempest-SnapshotDependencyTests-47999895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:34:46 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-6c00e71a-6f29-4be2-94db-66a7b5ce9684 tempest-SnapshotDependencyTests-47999895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:34:46 devstack sudo[103855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:34:46 devstack sudo[103855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:34:46 devstack sudo[103855]: pam_unix(sudo:session): session closed for user root Sep 16 20:34:46 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-6c00e71a-6f29-4be2-94db-66a7b5ce9684 tempest-SnapshotDependencyTests-47999895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.247s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:34:46 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-6c00e71a-6f29-4be2-94db-66a7b5ce9684 tempest-SnapshotDependencyTests-47999895 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:34:46 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-6c00e71a-6f29-4be2-94db-66a7b5ce9684 tempest-SnapshotDependencyTests-47999895 None] Deleted volume successfully. Sep 16 20:34:46 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-6c00e71a-6f29-4be2-94db-66a7b5ce9684 tempest-SnapshotDependencyTests-47999895 None] Lock "cinder-11f3a81b-c0ad-4804-8471-b8b88d736f32-delete_volume" released by "delete_volume" :: held 1.196s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:34:53 devstack cinder-volume[86188]: DEBUG oslo_service.periodic_task [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86188) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 20:34:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:34:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:34:53 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:34:53 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:34:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:34:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:34:53 devstack sudo[103861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:34:53 devstack sudo[103861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:34:53 devstack sudo[103861]: pam_unix(sudo:session): session closed for user root Sep 16 20:34:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.306s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:34:53 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:34:53 devstack cinder-volume[86188]: DEBUG oslo_service.periodic_task [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Running periodic task VolumeManager._thread_info {{(pid=86188) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 20:34:53 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] thread count: 28 {{(pid=86188) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 16 20:34:53 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] thread info: [<_MainThread(MainThread, started 139858124406912)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86188) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 16 20:34:55 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-253f328d-dba3-4d63-81bf-1746c31eda83 tempest-TestStampPattern-617653917 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:34:55 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-253f328d-dba3-4d63-81bf-1746c31eda83 tempest-TestStampPattern-617653917 None] Flow 'volume_create_manager' (dba734f8-2efe-44b3-8973-7917acae3033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:34:55 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-253f328d-dba3-4d63-81bf-1746c31eda83 tempest-TestStampPattern-617653917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (574b09b6-669e-4849-aec2-eb95647de10e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:34:55 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-253f328d-dba3-4d63-81bf-1746c31eda83 tempest-TestStampPattern-617653917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (574b09b6-669e-4849-aec2-eb95647de10e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:34:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-688019812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b8758db-6c41-409d-bce0-90d3aa983154,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bbdfd958014496eb4df1935fa770d58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:34:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:34:55Z,use_quota=True,user_id='93b6b3a364b847df9de7e672eb461810',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:34:55 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-253f328d-dba3-4d63-81bf-1746c31eda83 tempest-TestStampPattern-617653917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de2d4c7f-558d-4953-8c60-4fe6d7288300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:34:55 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-253f328d-dba3-4d63-81bf-1746c31eda83 tempest-TestStampPattern-617653917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de2d4c7f-558d-4953-8c60-4fe6d7288300) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:34:55 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-253f328d-dba3-4d63-81bf-1746c31eda83 tempest-TestStampPattern-617653917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64b25364-d687-446c-afd0-e700f7f415a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:34:55 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-253f328d-dba3-4d63-81bf-1746c31eda83 tempest-TestStampPattern-617653917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64b25364-d687-446c-afd0-e700f7f415a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b8758db-6c41-409d-bce0-90d3aa983154', 'volume_name': 'volume-1b8758db-6c41-409d-bce0-90d3aa983154', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:34:55 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-253f328d-dba3-4d63-81bf-1746c31eda83 tempest-TestStampPattern-617653917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (effb0de2-76e7-4b7e-acab-fc659d012cf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:34:55 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-253f328d-dba3-4d63-81bf-1746c31eda83 tempest-TestStampPattern-617653917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (effb0de2-76e7-4b7e-acab-fc659d012cf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:34:55 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-253f328d-dba3-4d63-81bf-1746c31eda83 tempest-TestStampPattern-617653917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33177a12-ed70-4fe3-b759-303a3b31b540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:34:55 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-253f328d-dba3-4d63-81bf-1746c31eda83 tempest-TestStampPattern-617653917 None] Volume 1b8758db-6c41-409d-bce0-90d3aa983154: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b8758db-6c41-409d-bce0-90d3aa983154', 'volume_size': 1} Sep 16 20:34:55 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-253f328d-dba3-4d63-81bf-1746c31eda83 tempest-TestStampPattern-617653917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:34:55 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-253f328d-dba3-4d63-81bf-1746c31eda83 tempest-TestStampPattern-617653917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:34:55 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-253f328d-dba3-4d63-81bf-1746c31eda83 tempest-TestStampPattern-617653917 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:34:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-688019812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b8758db-6c41-409d-bce0-90d3aa983154,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bbdfd958014496eb4df1935fa770d58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:34:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:34:55Z,use_quota=True,user_id='93b6b3a364b847df9de7e672eb461810',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:34:55 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-253f328d-dba3-4d63-81bf-1746c31eda83 tempest-TestStampPattern-617653917 None] Creating volume 1b8758db-6c41-409d-bce0-90d3aa983154 {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:34:55 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-253f328d-dba3-4d63-81bf-1746c31eda83 tempest-TestStampPattern-617653917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:34:55 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-253f328d-dba3-4d63-81bf-1746c31eda83 tempest-TestStampPattern-617653917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:34:55 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-253f328d-dba3-4d63-81bf-1746c31eda83 tempest-TestStampPattern-617653917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:34:55 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-253f328d-dba3-4d63-81bf-1746c31eda83 tempest-TestStampPattern-617653917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:34:55 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-253f328d-dba3-4d63-81bf-1746c31eda83 tempest-TestStampPattern-617653917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:34:55 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-253f328d-dba3-4d63-81bf-1746c31eda83 tempest-TestStampPattern-617653917 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:34:55 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-253f328d-dba3-4d63-81bf-1746c31eda83 tempest-TestStampPattern-617653917 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:34:55 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-253f328d-dba3-4d63-81bf-1746c31eda83 tempest-TestStampPattern-617653917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-1b8758db-6c41-409d-bce0-90d3aa983154 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:34:55 devstack sudo[103864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-1b8758db-6c41-409d-bce0-90d3aa983154 1073741824 Sep 16 20:34:55 devstack sudo[103864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:34:55 devstack sudo[103864]: pam_unix(sudo:session): session closed for user root Sep 16 20:34:55 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-253f328d-dba3-4d63-81bf-1746c31eda83 tempest-TestStampPattern-617653917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-1b8758db-6c41-409d-bce0-90d3aa983154 1073741824" returned: 0 in 0.472s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:34:55 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-253f328d-dba3-4d63-81bf-1746c31eda83 tempest-TestStampPattern-617653917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-1b8758db-6c41-409d-bce0-90d3aa983154 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:34:55 devstack sudo[103870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-1b8758db-6c41-409d-bce0-90d3aa983154 Sep 16 20:34:55 devstack sudo[103870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:34:56 devstack sudo[103870]: pam_unix(sudo:session): session closed for user root Sep 16 20:34:56 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-253f328d-dba3-4d63-81bf-1746c31eda83 tempest-TestStampPattern-617653917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-1b8758db-6c41-409d-bce0-90d3aa983154" returned: 0 in 0.287s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:34:56 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-253f328d-dba3-4d63-81bf-1746c31eda83 tempest-TestStampPattern-617653917 None] <== create_volume: return (830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:34:56 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-253f328d-dba3-4d63-81bf-1746c31eda83 tempest-TestStampPattern-617653917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.832s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:34:56 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-253f328d-dba3-4d63-81bf-1746c31eda83 tempest-TestStampPattern-617653917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33177a12-ed70-4fe3-b759-303a3b31b540) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b8758db-6c41-409d-bce0-90d3aa983154', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:34:56 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-253f328d-dba3-4d63-81bf-1746c31eda83 tempest-TestStampPattern-617653917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd94dbf1-423a-4f1d-b8f8-209401d26a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:34:56 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-253f328d-dba3-4d63-81bf-1746c31eda83 tempest-TestStampPattern-617653917 None] Volume volume-1b8758db-6c41-409d-bce0-90d3aa983154 (1b8758db-6c41-409d-bce0-90d3aa983154): created successfully Sep 16 20:34:56 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-253f328d-dba3-4d63-81bf-1746c31eda83 tempest-TestStampPattern-617653917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd94dbf1-423a-4f1d-b8f8-209401d26a67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:34:56 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-253f328d-dba3-4d63-81bf-1746c31eda83 tempest-TestStampPattern-617653917 None] Flow 'volume_create_manager' (dba734f8-2efe-44b3-8973-7917acae3033) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:34:56 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-253f328d-dba3-4d63-81bf-1746c31eda83 tempest-TestStampPattern-617653917 None] Created volume successfully. Sep 16 20:35:06 devstack cinder-volume[86188]: DEBUG dbcounter [-] [86188] Writing DB stats cinder:SELECT=28,cinder:INSERT=10,cinder:UPDATE=43,cinder:DELETE=2 {{(pid=86188) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 20:35:06 devstack cinder-volume[86188]: DEBUG dbcounter [-] [86188] Writing DB stats cinder:SELECT=37,cinder:UPDATE=37,cinder:INSERT=10,cinder:DELETE=5 {{(pid=86188) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 20:35:18 devstack cinder-volume[86188]: DEBUG dbcounter [-] [86188] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=86188) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 20:35:25 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [req-573752dd-963f-4287-9315-cbf2f28a3362 req-a2633f1c-28bc-4515-a4da-cfdbd5d08244 tempest-TestStampPattern-617653917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:35:25 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [req-573752dd-963f-4287-9315-cbf2f28a3362 req-a2633f1c-28bc-4515-a4da-cfdbd5d08244 tempest-TestStampPattern-617653917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:35:25 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [req-573752dd-963f-4287-9315-cbf2f28a3362 req-a2633f1c-28bc-4515-a4da-cfdbd5d08244 tempest-TestStampPattern-617653917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:35:25 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [req-573752dd-963f-4287-9315-cbf2f28a3362 req-a2633f1c-28bc-4515-a4da-cfdbd5d08244 tempest-TestStampPattern-617653917 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81', 'name': 'volume-1b8758db-6c41-409d-bce0-90d3aa983154', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e462be00-8113-42c3-8a51-b4ff36ad19d1', 'enforce_multipath': True} {{(pid=86188) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 16 20:35:26 devstack cinder-volume[86188]: INFO cinder.volume.manager [req-573752dd-963f-4287-9315-cbf2f28a3362 req-a2633f1c-28bc-4515-a4da-cfdbd5d08244 tempest-TestStampPattern-617653917 None] attachment_update completed successfully. Sep 16 20:35:29 devstack cinder-volume[86188]: INFO cinder.volume.manager [req-73c2b815-6855-4095-890b-e6fd6f8ac86f req-f414e872-2b8d-4264-ad08-fae2a70bf621 tempest-TestStampPattern-617653917 None] Terminate volume connection completed successfully. Sep 16 20:35:29 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [req-73c2b815-6855-4095-890b-e6fd6f8ac86f req-f414e872-2b8d-4264-ad08-fae2a70bf621 tempest-TestStampPattern-617653917 None] Deleting attachment e462be00-8113-42c3-8a51-b4ff36ad19d1. {{(pid=86188) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 16 20:35:30 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-1222d435-abfd-4360-ae59-b4fe6c28a6af tempest-TestStampPattern-617653917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:35:30 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-1222d435-abfd-4360-ae59-b4fe6c28a6af tempest-TestStampPattern-617653917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:35:30 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-1222d435-abfd-4360-ae59-b4fe6c28a6af tempest-TestStampPattern-617653917 None] Creating offline snapshot c3f712f2-3eec-464a-b4f8-657cbcb33476 of volume 1b8758db-6c41-409d-bce0-90d3aa983154 {{(pid=86188) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 20:35:30 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[2855df52-e186-4f75-9ea0-a39e5b3ff326]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:35:30 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-1222d435-abfd-4360-ae59-b4fe6c28a6af tempest-TestStampPattern-617653917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-1b8758db-6c41-409d-bce0-90d3aa983154 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:35:30 devstack sudo[104518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-1b8758db-6c41-409d-bce0-90d3aa983154 Sep 16 20:35:30 devstack sudo[104518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:35:31 devstack sudo[104518]: pam_unix(sudo:session): session closed for user root Sep 16 20:35:31 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-1222d435-abfd-4360-ae59-b4fe6c28a6af tempest-TestStampPattern-617653917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-1b8758db-6c41-409d-bce0-90d3aa983154" returned: 0 in 0.358s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:35:31 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-1222d435-abfd-4360-ae59-b4fe6c28a6af tempest-TestStampPattern-617653917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-1b8758db-6c41-409d-bce0-90d3aa983154,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-1b8758db-6c41-409d-bce0-90d3aa983154.c3f712f2-3eec-464a-b4f8-657cbcb33476 1G {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:35:31 devstack sudo[104523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-1b8758db-6c41-409d-bce0-90d3aa983154,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-1b8758db-6c41-409d-bce0-90d3aa983154.c3f712f2-3eec-464a-b4f8-657cbcb33476 1G Sep 16 20:35:31 devstack sudo[104523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:35:31 devstack sudo[104523]: pam_unix(sudo:session): session closed for user root Sep 16 20:35:31 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-1222d435-abfd-4360-ae59-b4fe6c28a6af tempest-TestStampPattern-617653917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-1b8758db-6c41-409d-bce0-90d3aa983154,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-1b8758db-6c41-409d-bce0-90d3aa983154.c3f712f2-3eec-464a-b4f8-657cbcb33476 1G" returned: 0 in 0.371s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:35:31 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-1222d435-abfd-4360-ae59-b4fe6c28a6af tempest-TestStampPattern-617653917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b8758db-6c41-409d-bce0-90d3aa983154 -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-1b8758db-6c41-409d-bce0-90d3aa983154.c3f712f2-3eec-464a-b4f8-657cbcb33476 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:35:31 devstack sudo[104529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b8758db-6c41-409d-bce0-90d3aa983154 -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-1b8758db-6c41-409d-bce0-90d3aa983154.c3f712f2-3eec-464a-b4f8-657cbcb33476 Sep 16 20:35:31 devstack sudo[104529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:35:31 devstack sudo[104529]: pam_unix(sudo:session): session closed for user root Sep 16 20:35:31 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-1222d435-abfd-4360-ae59-b4fe6c28a6af tempest-TestStampPattern-617653917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b8758db-6c41-409d-bce0-90d3aa983154 -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-1b8758db-6c41-409d-bce0-90d3aa983154.c3f712f2-3eec-464a-b4f8-657cbcb33476" returned: 0 in 0.286s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:35:31 devstack cinder-volume[86188]: WARNING cinder.volume.drivers.remotefs [None req-1222d435-abfd-4360-ae59-b4fe6c28a6af tempest-TestStampPattern-617653917 None] /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-1b8758db-6c41-409d-bce0-90d3aa983154.c3f712f2-3eec-464a-b4f8-657cbcb33476 is being set with open permissions: ugo+rw Sep 16 20:35:31 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-1222d435-abfd-4360-ae59-b4fe6c28a6af tempest-TestStampPattern-617653917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-1b8758db-6c41-409d-bce0-90d3aa983154.c3f712f2-3eec-464a-b4f8-657cbcb33476 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:35:31 devstack sudo[104534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-1b8758db-6c41-409d-bce0-90d3aa983154.c3f712f2-3eec-464a-b4f8-657cbcb33476 Sep 16 20:35:31 devstack sudo[104534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:35:32 devstack sudo[104534]: pam_unix(sudo:session): session closed for user root Sep 16 20:35:32 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-1222d435-abfd-4360-ae59-b4fe6c28a6af tempest-TestStampPattern-617653917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-1b8758db-6c41-409d-bce0-90d3aa983154.c3f712f2-3eec-464a-b4f8-657cbcb33476" returned: 0 in 0.260s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:35:32 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-1222d435-abfd-4360-ae59-b4fe6c28a6af tempest-TestStampPattern-617653917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-1b8758db-6c41-409d-bce0-90d3aa983154.info {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:35:32 devstack sudo[104537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-1b8758db-6c41-409d-bce0-90d3aa983154.info Sep 16 20:35:32 devstack sudo[104537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:35:32 devstack sudo[104537]: pam_unix(sudo:session): session closed for user root Sep 16 20:35:32 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-1222d435-abfd-4360-ae59-b4fe6c28a6af tempest-TestStampPattern-617653917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-1b8758db-6c41-409d-bce0-90d3aa983154.info" returned: 0 in 0.241s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:35:32 devstack cinder-volume[86188]: WARNING cinder.volume.drivers.remotefs [None req-1222d435-abfd-4360-ae59-b4fe6c28a6af tempest-TestStampPattern-617653917 None] /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-1b8758db-6c41-409d-bce0-90d3aa983154.info is being set with open permissions: ugo+rw Sep 16 20:35:32 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-1222d435-abfd-4360-ae59-b4fe6c28a6af tempest-TestStampPattern-617653917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-1b8758db-6c41-409d-bce0-90d3aa983154.info {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:35:32 devstack sudo[104540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-1b8758db-6c41-409d-bce0-90d3aa983154.info Sep 16 20:35:32 devstack sudo[104540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:35:32 devstack sudo[104540]: pam_unix(sudo:session): session closed for user root Sep 16 20:35:32 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-1222d435-abfd-4360-ae59-b4fe6c28a6af tempest-TestStampPattern-617653917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-1b8758db-6c41-409d-bce0-90d3aa983154.info" returned: 0 in 0.233s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:35:32 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-1222d435-abfd-4360-ae59-b4fe6c28a6af tempest-TestStampPattern-617653917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.834s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:35:32 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-1222d435-abfd-4360-ae59-b4fe6c28a6af tempest-TestStampPattern-617653917 None] Create snapshot completed successfully Sep 16 20:35:39 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbdefabe-d34a-4482-8704-610828e5bf3a tempest-TestStampPattern-617653917 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:35:39 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-bbdefabe-d34a-4482-8704-610828e5bf3a tempest-TestStampPattern-617653917 None] Flow 'volume_create_manager' (dc74bc87-b7e9-4148-a20d-5f98ce2efb89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:35:39 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-bbdefabe-d34a-4482-8704-610828e5bf3a tempest-TestStampPattern-617653917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94db13e2-04a3-494e-9f54-46eeee5fcfea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:35:39 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-bbdefabe-d34a-4482-8704-610828e5bf3a tempest-TestStampPattern-617653917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94db13e2-04a3-494e-9f54-46eeee5fcfea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:35:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1250368842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec61bb61-5c12-4fed-b2ca-c524981218cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bbdfd958014496eb4df1935fa770d58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:35:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c3f712f2-3eec-464a-b4f8-657cbcb33476,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:35:39Z,use_quota=True,user_id='93b6b3a364b847df9de7e672eb461810',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:35:39 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-bbdefabe-d34a-4482-8704-610828e5bf3a tempest-TestStampPattern-617653917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d683882b-3b70-4caa-9bb7-7f047da8e399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:35:39 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-bbdefabe-d34a-4482-8704-610828e5bf3a tempest-TestStampPattern-617653917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d683882b-3b70-4caa-9bb7-7f047da8e399) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:35:39 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-bbdefabe-d34a-4482-8704-610828e5bf3a tempest-TestStampPattern-617653917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (982e3fb3-7613-4e6a-90e7-f3552df8aded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:35:39 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-bbdefabe-d34a-4482-8704-610828e5bf3a tempest-TestStampPattern-617653917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (982e3fb3-7613-4e6a-90e7-f3552df8aded) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ec61bb61-5c12-4fed-b2ca-c524981218cf', 'volume_name': 'volume-ec61bb61-5c12-4fed-b2ca-c524981218cf', 'volume_size': 1, 'snapshot_id': 'c3f712f2-3eec-464a-b4f8-657cbcb33476'}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:35:39 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-bbdefabe-d34a-4482-8704-610828e5bf3a tempest-TestStampPattern-617653917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65064a66-a6c7-41a7-ad66-6a6cb9211878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:35:39 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-bbdefabe-d34a-4482-8704-610828e5bf3a tempest-TestStampPattern-617653917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65064a66-a6c7-41a7-ad66-6a6cb9211878) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:35:39 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-bbdefabe-d34a-4482-8704-610828e5bf3a tempest-TestStampPattern-617653917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1ba9087-3872-4ccd-8da6-c5ad9606b491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:35:39 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-bbdefabe-d34a-4482-8704-610828e5bf3a tempest-TestStampPattern-617653917 None] Volume ec61bb61-5c12-4fed-b2ca-c524981218cf: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ec61bb61-5c12-4fed-b2ca-c524981218cf', 'volume_size': 1, 'snapshot_id': 'c3f712f2-3eec-464a-b4f8-657cbcb33476'} Sep 16 20:35:39 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-bbdefabe-d34a-4482-8704-610828e5bf3a tempest-TestStampPattern-617653917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:35:39 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-bbdefabe-d34a-4482-8704-610828e5bf3a tempest-TestStampPattern-617653917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:35:39 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-bbdefabe-d34a-4482-8704-610828e5bf3a tempest-TestStampPattern-617653917 None] Acquiring lock "cinder-quobyte-c3f712f2-3eec-464a-b4f8-657cbcb33476-ec61bb61-5c12-4fed-b2ca-c524981218cf" by "_create_volume_from_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:35:39 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-bbdefabe-d34a-4482-8704-610828e5bf3a tempest-TestStampPattern-617653917 None] Lock "cinder-quobyte-c3f712f2-3eec-464a-b4f8-657cbcb33476-ec61bb61-5c12-4fed-b2ca-c524981218cf" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:35:39 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-bbdefabe-d34a-4482-8704-610828e5bf3a tempest-TestStampPattern-617653917 None] Creating volume ec61bb61-5c12-4fed-b2ca-c524981218cf from snapshot c3f712f2-3eec-464a-b4f8-657cbcb33476 {{(pid=86188) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 16 20:35:39 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-bbdefabe-d34a-4482-8704-610828e5bf3a tempest-TestStampPattern-617653917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:35:39 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-bbdefabe-d34a-4482-8704-610828e5bf3a tempest-TestStampPattern-617653917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:35:39 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-bbdefabe-d34a-4482-8704-610828e5bf3a tempest-TestStampPattern-617653917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:35:39 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-bbdefabe-d34a-4482-8704-610828e5bf3a tempest-TestStampPattern-617653917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:35:39 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-bbdefabe-d34a-4482-8704-610828e5bf3a tempest-TestStampPattern-617653917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:35:39 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-bbdefabe-d34a-4482-8704-610828e5bf3a tempest-TestStampPattern-617653917 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:35:39 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-bbdefabe-d34a-4482-8704-610828e5bf3a tempest-TestStampPattern-617653917 None] Acquiring lock "cinder-quobyte-ec61bb61-5c12-4fed-b2ca-c524981218cf" by "_copy_volume_from_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:35:39 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-bbdefabe-d34a-4482-8704-610828e5bf3a tempest-TestStampPattern-617653917 None] Lock "cinder-quobyte-ec61bb61-5c12-4fed-b2ca-c524981218cf" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:35:39 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-bbdefabe-d34a-4482-8704-610828e5bf3a tempest-TestStampPattern-617653917 None] snapshot: c3f712f2-3eec-464a-b4f8-657cbcb33476, volume: ec61bb61-5c12-4fed-b2ca-c524981218cf, {{(pid=86188) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 16 20:35:39 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-bbdefabe-d34a-4482-8704-610828e5bf3a tempest-TestStampPattern-617653917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:35:39 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-bbdefabe-d34a-4482-8704-610828e5bf3a tempest-TestStampPattern-617653917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:35:39 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-bbdefabe-d34a-4482-8704-610828e5bf3a tempest-TestStampPattern-617653917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:35:39 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-bbdefabe-d34a-4482-8704-610828e5bf3a tempest-TestStampPattern-617653917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:35:39 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-bbdefabe-d34a-4482-8704-610828e5bf3a tempest-TestStampPattern-617653917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:35:39 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9b68b1c-b204-4f3d-af6f-e93f68bee2d0]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:35:39 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-bbdefabe-d34a-4482-8704-610828e5bf3a tempest-TestStampPattern-617653917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-1b8758db-6c41-409d-bce0-90d3aa983154.c3f712f2-3eec-464a-b4f8-657cbcb33476 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:35:39 devstack sudo[104573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-1b8758db-6c41-409d-bce0-90d3aa983154.c3f712f2-3eec-464a-b4f8-657cbcb33476 Sep 16 20:35:39 devstack sudo[104573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:35:40 devstack sudo[104573]: pam_unix(sudo:session): session closed for user root Sep 16 20:35:40 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-bbdefabe-d34a-4482-8704-610828e5bf3a tempest-TestStampPattern-617653917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-1b8758db-6c41-409d-bce0-90d3aa983154.c3f712f2-3eec-464a-b4f8-657cbcb33476" returned: 0 in 0.402s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:35:40 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-bbdefabe-d34a-4482-8704-610828e5bf3a tempest-TestStampPattern-617653917 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b8758db-6c41-409d-bce0-90d3aa983154(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86188) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 20:35:40 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[86b0db6f-0c07-4e29-a4e8-c9ebf991f163]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:35:40 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-bbdefabe-d34a-4482-8704-610828e5bf3a tempest-TestStampPattern-617653917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-1b8758db-6c41-409d-bce0-90d3aa983154 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:35:40 devstack sudo[104578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-1b8758db-6c41-409d-bce0-90d3aa983154 Sep 16 20:35:40 devstack sudo[104578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:35:40 devstack sudo[104578]: pam_unix(sudo:session): session closed for user root Sep 16 20:35:40 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-bbdefabe-d34a-4482-8704-610828e5bf3a tempest-TestStampPattern-617653917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-1b8758db-6c41-409d-bce0-90d3aa983154" returned: 0 in 0.382s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:35:40 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-bbdefabe-d34a-4482-8704-610828e5bf3a tempest-TestStampPattern-617653917 None] will copy from snapshot at /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-1b8758db-6c41-409d-bce0-90d3aa983154 {{(pid=86188) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 16 20:35:40 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-bbdefabe-d34a-4482-8704-610828e5bf3a tempest-TestStampPattern-617653917 None] Creating direct copy from snapshot {{(pid=86188) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 16 20:35:40 devstack cinder-volume[86188]: DEBUG cinder.utils [None req-bbdefabe-d34a-4482-8704-610828e5bf3a tempest-TestStampPattern-617653917 None] Path /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ec61bb61-5c12-4fed-b2ca-c524981218cf not found in is_blk_device check {{(pid=86188) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 16 20:35:40 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-bbdefabe-d34a-4482-8704-610828e5bf3a tempest-TestStampPattern-617653917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-1b8758db-6c41-409d-bce0-90d3aa983154 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ec61bb61-5c12-4fed-b2ca-c524981218cf {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:35:40 devstack sudo[104586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-1b8758db-6c41-409d-bce0-90d3aa983154 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ec61bb61-5c12-4fed-b2ca-c524981218cf Sep 16 20:35:40 devstack sudo[104586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:35:49 devstack sudo[104586]: pam_unix(sudo:session): session closed for user root Sep 16 20:35:49 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-bbdefabe-d34a-4482-8704-610828e5bf3a tempest-TestStampPattern-617653917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-1b8758db-6c41-409d-bce0-90d3aa983154 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ec61bb61-5c12-4fed-b2ca-c524981218cf" returned: 0 in 8.860s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:35:49 devstack cinder-volume[86188]: DEBUG cinder.image.image_utils [None req-bbdefabe-d34a-4482-8704-610828e5bf3a tempest-TestStampPattern-617653917 None] Image conversion details: src /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-1b8758db-6c41-409d-bce0-90d3aa983154, size 1024.00 MB, duration 8.86 sec, destination /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ec61bb61-5c12-4fed-b2ca-c524981218cf {{(pid=86188) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 16 20:35:49 devstack cinder-volume[86188]: INFO cinder.image.image_utils [None req-bbdefabe-d34a-4482-8704-610828e5bf3a tempest-TestStampPattern-617653917 None] Converted 1024.00 MB image at 115.55 MB/s Sep 16 20:35:49 devstack cinder-volume[86188]: WARNING cinder.volume.drivers.remotefs [None req-bbdefabe-d34a-4482-8704-610828e5bf3a tempest-TestStampPattern-617653917 None] /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ec61bb61-5c12-4fed-b2ca-c524981218cf is being set with open permissions: ugo+rw Sep 16 20:35:49 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-bbdefabe-d34a-4482-8704-610828e5bf3a tempest-TestStampPattern-617653917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ec61bb61-5c12-4fed-b2ca-c524981218cf {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:35:49 devstack sudo[104669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ec61bb61-5c12-4fed-b2ca-c524981218cf Sep 16 20:35:49 devstack sudo[104669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:35:49 devstack cinder-volume[86188]: DEBUG dbcounter [-] [86188] Writing DB stats cinder:SELECT=14,cinder:UPDATE=2,cinder:INSERT=1 {{(pid=86188) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 20:35:49 devstack sudo[104669]: pam_unix(sudo:session): session closed for user root Sep 16 20:35:49 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-bbdefabe-d34a-4482-8704-610828e5bf3a tempest-TestStampPattern-617653917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ec61bb61-5c12-4fed-b2ca-c524981218cf" returned: 0 in 0.266s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:35:49 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-bbdefabe-d34a-4482-8704-610828e5bf3a tempest-TestStampPattern-617653917 None] Lock "cinder-quobyte-ec61bb61-5c12-4fed-b2ca-c524981218cf" released by "_copy_volume_from_snapshot" :: held 10.002s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:35:49 devstack cinder-volume[86188]: DEBUG dbcounter [-] [86188] Writing DB stats cinder:SELECT=12,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=86188) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 20:35:49 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-bbdefabe-d34a-4482-8704-610828e5bf3a tempest-TestStampPattern-617653917 None] Lock "cinder-quobyte-c3f712f2-3eec-464a-b4f8-657cbcb33476-ec61bb61-5c12-4fed-b2ca-c524981218cf" released by "_create_volume_from_snapshot" :: held 10.068s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:35:49 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-bbdefabe-d34a-4482-8704-610828e5bf3a tempest-TestStampPattern-617653917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.082s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:35:49 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-bbdefabe-d34a-4482-8704-610828e5bf3a tempest-TestStampPattern-617653917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1ba9087-3872-4ccd-8da6-c5ad9606b491) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec61bb61-5c12-4fed-b2ca-c524981218cf', 'volume_size': 1, 'snapshot_id': 'c3f712f2-3eec-464a-b4f8-657cbcb33476'}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:35:49 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-bbdefabe-d34a-4482-8704-610828e5bf3a tempest-TestStampPattern-617653917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c20851b1-5c11-435b-ae56-aeb327a97672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:35:49 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-bbdefabe-d34a-4482-8704-610828e5bf3a tempest-TestStampPattern-617653917 None] Volume volume-ec61bb61-5c12-4fed-b2ca-c524981218cf (ec61bb61-5c12-4fed-b2ca-c524981218cf): created successfully Sep 16 20:35:49 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-bbdefabe-d34a-4482-8704-610828e5bf3a tempest-TestStampPattern-617653917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c20851b1-5c11-435b-ae56-aeb327a97672) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:35:49 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-bbdefabe-d34a-4482-8704-610828e5bf3a tempest-TestStampPattern-617653917 None] Flow 'volume_create_manager' (dc74bc87-b7e9-4148-a20d-5f98ce2efb89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:35:49 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-bbdefabe-d34a-4482-8704-610828e5bf3a tempest-TestStampPattern-617653917 None] Created volume successfully. Sep 16 20:35:53 devstack cinder-volume[86188]: DEBUG oslo_service.periodic_task [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86188) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 20:35:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:35:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:35:53 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:35:53 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:35:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:35:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:35:53 devstack sudo[104674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:35:53 devstack sudo[104674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:35:53 devstack sudo[104674]: pam_unix(sudo:session): session closed for user root Sep 16 20:35:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.246s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:35:53 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:35:53 devstack cinder-volume[86188]: DEBUG oslo_service.periodic_task [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Running periodic task VolumeManager._thread_info {{(pid=86188) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 20:35:53 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] thread count: 28 {{(pid=86188) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 16 20:35:53 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] thread info: [<_MainThread(MainThread, started 139858124406912)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86188) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 16 20:35:59 devstack cinder-volume[86188]: DEBUG dbcounter [-] [86188] Writing DB stats cinder:SELECT=2,cinder:UPDATE=4,cinder:INSERT=1 {{(pid=86188) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 20:35:59 devstack cinder-volume[86188]: DEBUG dbcounter [-] [86188] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1,cinder:DELETE=1 {{(pid=86188) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 20:36:29 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [req-f5071026-6d6a-4789-92e6-8615c8f1f546 req-9286c29c-0264-4dcf-aece-7d0af41c8bf8 tempest-TestStampPattern-617653917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:36:29 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [req-f5071026-6d6a-4789-92e6-8615c8f1f546 req-9286c29c-0264-4dcf-aece-7d0af41c8bf8 tempest-TestStampPattern-617653917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:36:29 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [req-f5071026-6d6a-4789-92e6-8615c8f1f546 req-9286c29c-0264-4dcf-aece-7d0af41c8bf8 tempest-TestStampPattern-617653917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:36:29 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [req-f5071026-6d6a-4789-92e6-8615c8f1f546 req-9286c29c-0264-4dcf-aece-7d0af41c8bf8 tempest-TestStampPattern-617653917 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81', 'name': 'volume-ec61bb61-5c12-4fed-b2ca-c524981218cf', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a347894a-786d-48f8-8ef9-08d394c58ebe', 'enforce_multipath': True} {{(pid=86188) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 16 20:36:29 devstack cinder-volume[86188]: INFO cinder.volume.manager [req-f5071026-6d6a-4789-92e6-8615c8f1f546 req-9286c29c-0264-4dcf-aece-7d0af41c8bf8 tempest-TestStampPattern-617653917 None] attachment_update completed successfully. Sep 16 20:36:31 devstack cinder-volume[86188]: INFO cinder.volume.manager [req-282aec63-8510-42c6-a044-fe90a8cc3bc4 req-cfcc8743-a914-46a0-8935-b75a44654422 tempest-TestStampPattern-617653917 None] Terminate volume connection completed successfully. Sep 16 20:36:31 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [req-282aec63-8510-42c6-a044-fe90a8cc3bc4 req-cfcc8743-a914-46a0-8935-b75a44654422 tempest-TestStampPattern-617653917 None] Deleting attachment a347894a-786d-48f8-8ef9-08d394c58ebe. {{(pid=86188) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 16 20:36:35 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-efcf3442-5fd4-4a28-95c6-97bfaf9dcf3a tempest-TestStampPattern-617653917 None] Acquiring lock "cinder-ec61bb61-5c12-4fed-b2ca-c524981218cf-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:36:35 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-efcf3442-5fd4-4a28-95c6-97bfaf9dcf3a tempest-TestStampPattern-617653917 None] Lock "cinder-ec61bb61-5c12-4fed-b2ca-c524981218cf-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:36:35 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-efcf3442-5fd4-4a28-95c6-97bfaf9dcf3a tempest-TestStampPattern-617653917 None] Acquiring lock "cinder-quobyte-ec61bb61-5c12-4fed-b2ca-c524981218cf" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:36:35 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-efcf3442-5fd4-4a28-95c6-97bfaf9dcf3a tempest-TestStampPattern-617653917 None] Lock "cinder-quobyte-ec61bb61-5c12-4fed-b2ca-c524981218cf" acquired by "delete_volume" :: waited 0.017s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:36:35 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa44539b-fe37-4783-8145-a6ae15b3aa00]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:36:35 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-efcf3442-5fd4-4a28-95c6-97bfaf9dcf3a tempest-TestStampPattern-617653917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ec61bb61-5c12-4fed-b2ca-c524981218cf {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:36:35 devstack sudo[105249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ec61bb61-5c12-4fed-b2ca-c524981218cf Sep 16 20:36:35 devstack sudo[105249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:36:35 devstack sudo[105249]: pam_unix(sudo:session): session closed for user root Sep 16 20:36:35 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-efcf3442-5fd4-4a28-95c6-97bfaf9dcf3a tempest-TestStampPattern-617653917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ec61bb61-5c12-4fed-b2ca-c524981218cf" returned: 0 in 0.347s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:36:35 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-efcf3442-5fd4-4a28-95c6-97bfaf9dcf3a tempest-TestStampPattern-617653917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ec61bb61-5c12-4fed-b2ca-c524981218cf {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:36:35 devstack sudo[105254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ec61bb61-5c12-4fed-b2ca-c524981218cf Sep 16 20:36:35 devstack sudo[105254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:36:36 devstack sudo[105254]: pam_unix(sudo:session): session closed for user root Sep 16 20:36:36 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-efcf3442-5fd4-4a28-95c6-97bfaf9dcf3a tempest-TestStampPattern-617653917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ec61bb61-5c12-4fed-b2ca-c524981218cf" returned: 0 in 0.236s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:36:36 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-efcf3442-5fd4-4a28-95c6-97bfaf9dcf3a tempest-TestStampPattern-617653917 None] Lock "cinder-quobyte-ec61bb61-5c12-4fed-b2ca-c524981218cf" released by "delete_volume" :: held 0.624s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:36:36 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-efcf3442-5fd4-4a28-95c6-97bfaf9dcf3a tempest-TestStampPattern-617653917 None] Created reservations ['0401d60b-b9ae-44a1-8684-3bd0d2f192ce', 'b7d61df3-b630-4e3d-8b2c-a15b513cf034', '20a77c50-2419-46c1-94e0-4d1c12e7ef02', '86aca006-9cb1-449a-b1ab-71a15d935d08'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:36:36 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-efcf3442-5fd4-4a28-95c6-97bfaf9dcf3a tempest-TestStampPattern-617653917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:36:36 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-efcf3442-5fd4-4a28-95c6-97bfaf9dcf3a tempest-TestStampPattern-617653917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:36:36 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-efcf3442-5fd4-4a28-95c6-97bfaf9dcf3a tempest-TestStampPattern-617653917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:36:36 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-efcf3442-5fd4-4a28-95c6-97bfaf9dcf3a tempest-TestStampPattern-617653917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:36:36 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-efcf3442-5fd4-4a28-95c6-97bfaf9dcf3a tempest-TestStampPattern-617653917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:36:36 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-efcf3442-5fd4-4a28-95c6-97bfaf9dcf3a tempest-TestStampPattern-617653917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:36:36 devstack sudo[105257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:36:36 devstack sudo[105257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:36:36 devstack sudo[105257]: pam_unix(sudo:session): session closed for user root Sep 16 20:36:36 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-efcf3442-5fd4-4a28-95c6-97bfaf9dcf3a tempest-TestStampPattern-617653917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.237s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:36:36 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-efcf3442-5fd4-4a28-95c6-97bfaf9dcf3a tempest-TestStampPattern-617653917 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:36:36 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-efcf3442-5fd4-4a28-95c6-97bfaf9dcf3a tempest-TestStampPattern-617653917 None] Deleted volume successfully. Sep 16 20:36:36 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-efcf3442-5fd4-4a28-95c6-97bfaf9dcf3a tempest-TestStampPattern-617653917 None] Lock "cinder-ec61bb61-5c12-4fed-b2ca-c524981218cf-delete_volume" released by "delete_volume" :: held 1.042s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:36:36 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-f85b60af-34f0-4d4c-8fc2-3fb75d7ca092 tempest-TestStampPattern-617653917 None] Acquiring lock "cinder-c3f712f2-3eec-464a-b4f8-657cbcb33476-delete_snapshot" by "delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:36:36 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-f85b60af-34f0-4d4c-8fc2-3fb75d7ca092 tempest-TestStampPattern-617653917 None] Lock "cinder-c3f712f2-3eec-464a-b4f8-657cbcb33476-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:36:36 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-f85b60af-34f0-4d4c-8fc2-3fb75d7ca092 tempest-TestStampPattern-617653917 None] Acquiring lock "cinder-quobyte-1b8758db-6c41-409d-bce0-90d3aa983154" by "delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:36:36 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-f85b60af-34f0-4d4c-8fc2-3fb75d7ca092 tempest-TestStampPattern-617653917 None] Lock "cinder-quobyte-1b8758db-6c41-409d-bce0-90d3aa983154" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:36:36 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-f85b60af-34f0-4d4c-8fc2-3fb75d7ca092 tempest-TestStampPattern-617653917 None] Acquiring lock "cinder-quobyte-c3f712f2-3eec-464a-b4f8-657cbcb33476" by "_delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:36:36 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-f85b60af-34f0-4d4c-8fc2-3fb75d7ca092 tempest-TestStampPattern-617653917 None] Lock "cinder-quobyte-c3f712f2-3eec-464a-b4f8-657cbcb33476" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:36:36 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-f85b60af-34f0-4d4c-8fc2-3fb75d7ca092 tempest-TestStampPattern-617653917 None] Deleting offline snapshot c3f712f2-3eec-464a-b4f8-657cbcb33476 of volume 1b8758db-6c41-409d-bce0-90d3aa983154 {{(pid=86188) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 20:36:36 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-f85b60af-34f0-4d4c-8fc2-3fb75d7ca092 tempest-TestStampPattern-617653917 None] snapshot_file for this snap is: volume-1b8758db-6c41-409d-bce0-90d3aa983154.c3f712f2-3eec-464a-b4f8-657cbcb33476 {{(pid=86188) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 20:36:36 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd43a32c-63e3-4283-864d-a4976a910b5d]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:36:36 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f85b60af-34f0-4d4c-8fc2-3fb75d7ca092 tempest-TestStampPattern-617653917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-1b8758db-6c41-409d-bce0-90d3aa983154.c3f712f2-3eec-464a-b4f8-657cbcb33476 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:36:37 devstack sudo[105260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-1b8758db-6c41-409d-bce0-90d3aa983154.c3f712f2-3eec-464a-b4f8-657cbcb33476 Sep 16 20:36:37 devstack sudo[105260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:36:37 devstack sudo[105260]: pam_unix(sudo:session): session closed for user root Sep 16 20:36:37 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f85b60af-34f0-4d4c-8fc2-3fb75d7ca092 tempest-TestStampPattern-617653917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-1b8758db-6c41-409d-bce0-90d3aa983154.c3f712f2-3eec-464a-b4f8-657cbcb33476" returned: 0 in 0.349s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:36:37 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-f85b60af-34f0-4d4c-8fc2-3fb75d7ca092 tempest-TestStampPattern-617653917 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b8758db-6c41-409d-bce0-90d3aa983154(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86188) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 20:36:37 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[60a0e929-9a7c-4034-96b7-dd63931cbbda]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:36:37 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f85b60af-34f0-4d4c-8fc2-3fb75d7ca092 tempest-TestStampPattern-617653917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-1b8758db-6c41-409d-bce0-90d3aa983154 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:36:37 devstack sudo[105265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-1b8758db-6c41-409d-bce0-90d3aa983154 Sep 16 20:36:37 devstack sudo[105265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:36:37 devstack sudo[105265]: pam_unix(sudo:session): session closed for user root Sep 16 20:36:37 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f85b60af-34f0-4d4c-8fc2-3fb75d7ca092 tempest-TestStampPattern-617653917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-1b8758db-6c41-409d-bce0-90d3aa983154" returned: 0 in 0.514s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:36:37 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f85b60af-34f0-4d4c-8fc2-3fb75d7ca092 tempest-TestStampPattern-617653917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-1b8758db-6c41-409d-bce0-90d3aa983154.c3f712f2-3eec-464a-b4f8-657cbcb33476 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:36:37 devstack sudo[105270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-1b8758db-6c41-409d-bce0-90d3aa983154.c3f712f2-3eec-464a-b4f8-657cbcb33476 Sep 16 20:36:37 devstack sudo[105270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:36:38 devstack sudo[105270]: pam_unix(sudo:session): session closed for user root Sep 16 20:36:38 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f85b60af-34f0-4d4c-8fc2-3fb75d7ca092 tempest-TestStampPattern-617653917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-1b8758db-6c41-409d-bce0-90d3aa983154.c3f712f2-3eec-464a-b4f8-657cbcb33476" returned: 0 in 0.318s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:36:38 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f85b60af-34f0-4d4c-8fc2-3fb75d7ca092 tempest-TestStampPattern-617653917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-1b8758db-6c41-409d-bce0-90d3aa983154.c3f712f2-3eec-464a-b4f8-657cbcb33476 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:36:38 devstack sudo[105275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-1b8758db-6c41-409d-bce0-90d3aa983154.c3f712f2-3eec-464a-b4f8-657cbcb33476 Sep 16 20:36:38 devstack sudo[105275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:36:38 devstack sudo[105275]: pam_unix(sudo:session): session closed for user root Sep 16 20:36:38 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f85b60af-34f0-4d4c-8fc2-3fb75d7ca092 tempest-TestStampPattern-617653917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-1b8758db-6c41-409d-bce0-90d3aa983154.c3f712f2-3eec-464a-b4f8-657cbcb33476" returned: 0 in 0.237s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:36:38 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-f85b60af-34f0-4d4c-8fc2-3fb75d7ca092 tempest-TestStampPattern-617653917 None] Lock "cinder-quobyte-c3f712f2-3eec-464a-b4f8-657cbcb33476" released by "_delete_snapshot" :: held 1.511s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:36:38 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-f85b60af-34f0-4d4c-8fc2-3fb75d7ca092 tempest-TestStampPattern-617653917 None] Lock "cinder-quobyte-1b8758db-6c41-409d-bce0-90d3aa983154" released by "delete_snapshot" :: held 1.532s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:36:38 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-f85b60af-34f0-4d4c-8fc2-3fb75d7ca092 tempest-TestStampPattern-617653917 None] Created reservations ['eb701a1a-ba1a-484b-b4d9-5b5f18be16c2', 'dcfd7c86-177b-46d1-b676-93d57aa31f55', '71e33279-43b3-4ad6-b508-c4e7857ecde9', '44e737cf-e66e-486a-b065-46adc0a08579'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:36:38 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-f85b60af-34f0-4d4c-8fc2-3fb75d7ca092 tempest-TestStampPattern-617653917 None] Delete snapshot completed successfully. Sep 16 20:36:38 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-f85b60af-34f0-4d4c-8fc2-3fb75d7ca092 tempest-TestStampPattern-617653917 None] Lock "cinder-c3f712f2-3eec-464a-b4f8-657cbcb33476-delete_snapshot" released by "delete_snapshot" :: held 1.653s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:36:42 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-4d506125-1fa6-42be-a5ec-136157886631 tempest-TestStampPattern-617653917 None] Acquiring lock "cinder-1b8758db-6c41-409d-bce0-90d3aa983154-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:36:42 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-4d506125-1fa6-42be-a5ec-136157886631 tempest-TestStampPattern-617653917 None] Lock "cinder-1b8758db-6c41-409d-bce0-90d3aa983154-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:36:42 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-4d506125-1fa6-42be-a5ec-136157886631 tempest-TestStampPattern-617653917 None] Acquiring lock "cinder-quobyte-1b8758db-6c41-409d-bce0-90d3aa983154" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:36:42 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-4d506125-1fa6-42be-a5ec-136157886631 tempest-TestStampPattern-617653917 None] Lock "cinder-quobyte-1b8758db-6c41-409d-bce0-90d3aa983154" acquired by "delete_volume" :: waited 0.013s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:36:42 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e4942c6-f609-409f-828a-d8a9f0b76e45]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:36:42 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-4d506125-1fa6-42be-a5ec-136157886631 tempest-TestStampPattern-617653917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-1b8758db-6c41-409d-bce0-90d3aa983154 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:36:42 devstack sudo[105306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-1b8758db-6c41-409d-bce0-90d3aa983154 Sep 16 20:36:42 devstack sudo[105306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:36:42 devstack sudo[105306]: pam_unix(sudo:session): session closed for user root Sep 16 20:36:42 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-4d506125-1fa6-42be-a5ec-136157886631 tempest-TestStampPattern-617653917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-1b8758db-6c41-409d-bce0-90d3aa983154" returned: 0 in 0.361s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:36:42 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-4d506125-1fa6-42be-a5ec-136157886631 tempest-TestStampPattern-617653917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-1b8758db-6c41-409d-bce0-90d3aa983154 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:36:42 devstack sudo[105311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-1b8758db-6c41-409d-bce0-90d3aa983154 Sep 16 20:36:42 devstack sudo[105311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:36:43 devstack sudo[105311]: pam_unix(sudo:session): session closed for user root Sep 16 20:36:43 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-4d506125-1fa6-42be-a5ec-136157886631 tempest-TestStampPattern-617653917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-1b8758db-6c41-409d-bce0-90d3aa983154" returned: 0 in 0.241s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:36:43 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-4d506125-1fa6-42be-a5ec-136157886631 tempest-TestStampPattern-617653917 None] Lock "cinder-quobyte-1b8758db-6c41-409d-bce0-90d3aa983154" released by "delete_volume" :: held 0.658s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:36:43 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-4d506125-1fa6-42be-a5ec-136157886631 tempest-TestStampPattern-617653917 None] Created reservations ['09fd7b8d-db31-4d04-9ffc-e7c90b3362c1', '76760b33-26f1-4feb-94e4-21494c3c1846', '4b71fc61-6fd3-40e3-bc14-5698301e0765', '538fed6d-d8f8-4d11-87f2-4c4823158d9e'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:36:43 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-4d506125-1fa6-42be-a5ec-136157886631 tempest-TestStampPattern-617653917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:36:43 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-4d506125-1fa6-42be-a5ec-136157886631 tempest-TestStampPattern-617653917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:36:43 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-4d506125-1fa6-42be-a5ec-136157886631 tempest-TestStampPattern-617653917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:36:43 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-4d506125-1fa6-42be-a5ec-136157886631 tempest-TestStampPattern-617653917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:36:43 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-4d506125-1fa6-42be-a5ec-136157886631 tempest-TestStampPattern-617653917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:36:43 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-4d506125-1fa6-42be-a5ec-136157886631 tempest-TestStampPattern-617653917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:36:43 devstack sudo[105314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:36:43 devstack sudo[105314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:36:43 devstack sudo[105314]: pam_unix(sudo:session): session closed for user root Sep 16 20:36:43 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-4d506125-1fa6-42be-a5ec-136157886631 tempest-TestStampPattern-617653917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.245s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:36:43 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-4d506125-1fa6-42be-a5ec-136157886631 tempest-TestStampPattern-617653917 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:36:43 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-4d506125-1fa6-42be-a5ec-136157886631 tempest-TestStampPattern-617653917 None] Deleted volume successfully. Sep 16 20:36:43 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-4d506125-1fa6-42be-a5ec-136157886631 tempest-TestStampPattern-617653917 None] Lock "cinder-1b8758db-6c41-409d-bce0-90d3aa983154-delete_volume" released by "delete_volume" :: held 1.079s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:36:53 devstack cinder-volume[86188]: DEBUG oslo_service.periodic_task [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86188) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 20:36:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:36:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:36:53 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:36:53 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:36:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:36:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:36:53 devstack sudo[105323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:36:53 devstack sudo[105323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:36:53 devstack cinder-volume[86188]: DEBUG dbcounter [-] [86188] Writing DB stats cinder:SELECT=26,cinder:INSERT=6,cinder:UPDATE=21,cinder:DELETE=1 {{(pid=86188) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 20:36:53 devstack sudo[105323]: pam_unix(sudo:session): session closed for user root Sep 16 20:36:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.250s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:36:53 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:36:53 devstack cinder-volume[86188]: DEBUG oslo_service.periodic_task [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Running periodic task VolumeManager._thread_info {{(pid=86188) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 20:36:53 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] thread count: 28 {{(pid=86188) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 16 20:36:53 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] thread info: [<_MainThread(MainThread, started 139858124406912)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86188) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 16 20:36:53 devstack cinder-volume[86188]: DEBUG dbcounter [-] [86188] Writing DB stats cinder:SELECT=20,cinder:UPDATE=25,cinder:INSERT=6,cinder:DELETE=1 {{(pid=86188) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 20:36:58 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-65bdca78-7b3f-499e-9b18-41001a30c1e0 tempest-ProjectReaderTests-2113236416 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:36:58 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-65bdca78-7b3f-499e-9b18-41001a30c1e0 tempest-ProjectReaderTests-2113236416 None] Flow 'volume_create_manager' (b40326c0-c3ca-40fd-941a-e714aa4e25b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:36:58 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-65bdca78-7b3f-499e-9b18-41001a30c1e0 tempest-ProjectReaderTests-2113236416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f364e40-b51f-4ed9-8af7-8f1a022fe74d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:36:58 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-65bdca78-7b3f-499e-9b18-41001a30c1e0 tempest-ProjectReaderTests-2113236416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f364e40-b51f-4ed9-8af7-8f1a022fe74d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:36:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-672693863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bb4a2a3-8e63-48c4-b8ca-93c68e802c5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='527e792a03f740a2b7c5ef3642195f5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:36:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:36:59Z,use_quota=True,user_id='97d6f7e562bd4acaac580315231086e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:36:58 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-65bdca78-7b3f-499e-9b18-41001a30c1e0 tempest-ProjectReaderTests-2113236416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a8b9996-89db-4a88-9271-71aca5b2fbad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:36:58 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-65bdca78-7b3f-499e-9b18-41001a30c1e0 tempest-ProjectReaderTests-2113236416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a8b9996-89db-4a88-9271-71aca5b2fbad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:36:58 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-65bdca78-7b3f-499e-9b18-41001a30c1e0 tempest-ProjectReaderTests-2113236416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c395897e-a6c6-4af2-893a-bb142df0cffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:36:58 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-65bdca78-7b3f-499e-9b18-41001a30c1e0 tempest-ProjectReaderTests-2113236416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c395897e-a6c6-4af2-893a-bb142df0cffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bb4a2a3-8e63-48c4-b8ca-93c68e802c5a', 'volume_name': 'volume-3bb4a2a3-8e63-48c4-b8ca-93c68e802c5a', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:36:58 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-65bdca78-7b3f-499e-9b18-41001a30c1e0 tempest-ProjectReaderTests-2113236416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99346953-cc46-4913-bf6e-719d67fff27a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:36:58 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-65bdca78-7b3f-499e-9b18-41001a30c1e0 tempest-ProjectReaderTests-2113236416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99346953-cc46-4913-bf6e-719d67fff27a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:36:58 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-65bdca78-7b3f-499e-9b18-41001a30c1e0 tempest-ProjectReaderTests-2113236416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddec4fa5-3e40-44f3-960a-937b316d518b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:36:58 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-65bdca78-7b3f-499e-9b18-41001a30c1e0 tempest-ProjectReaderTests-2113236416 None] Volume 3bb4a2a3-8e63-48c4-b8ca-93c68e802c5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bb4a2a3-8e63-48c4-b8ca-93c68e802c5a', 'volume_size': 1} Sep 16 20:36:58 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-65bdca78-7b3f-499e-9b18-41001a30c1e0 tempest-ProjectReaderTests-2113236416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:36:58 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-65bdca78-7b3f-499e-9b18-41001a30c1e0 tempest-ProjectReaderTests-2113236416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:36:58 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-65bdca78-7b3f-499e-9b18-41001a30c1e0 tempest-ProjectReaderTests-2113236416 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:36:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-672693863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bb4a2a3-8e63-48c4-b8ca-93c68e802c5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='527e792a03f740a2b7c5ef3642195f5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:36:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:36:59Z,use_quota=True,user_id='97d6f7e562bd4acaac580315231086e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:36:58 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-65bdca78-7b3f-499e-9b18-41001a30c1e0 tempest-ProjectReaderTests-2113236416 None] Creating volume 3bb4a2a3-8e63-48c4-b8ca-93c68e802c5a {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:36:58 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-65bdca78-7b3f-499e-9b18-41001a30c1e0 tempest-ProjectReaderTests-2113236416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:36:58 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-65bdca78-7b3f-499e-9b18-41001a30c1e0 tempest-ProjectReaderTests-2113236416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:36:58 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-65bdca78-7b3f-499e-9b18-41001a30c1e0 tempest-ProjectReaderTests-2113236416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:36:58 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-65bdca78-7b3f-499e-9b18-41001a30c1e0 tempest-ProjectReaderTests-2113236416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:36:58 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-65bdca78-7b3f-499e-9b18-41001a30c1e0 tempest-ProjectReaderTests-2113236416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:36:58 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-65bdca78-7b3f-499e-9b18-41001a30c1e0 tempest-ProjectReaderTests-2113236416 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:36:58 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-65bdca78-7b3f-499e-9b18-41001a30c1e0 tempest-ProjectReaderTests-2113236416 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:36:58 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-65bdca78-7b3f-499e-9b18-41001a30c1e0 tempest-ProjectReaderTests-2113236416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-3bb4a2a3-8e63-48c4-b8ca-93c68e802c5a 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:36:58 devstack sudo[105326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-3bb4a2a3-8e63-48c4-b8ca-93c68e802c5a 1073741824 Sep 16 20:36:58 devstack sudo[105326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:36:59 devstack sudo[105326]: pam_unix(sudo:session): session closed for user root Sep 16 20:36:59 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-65bdca78-7b3f-499e-9b18-41001a30c1e0 tempest-ProjectReaderTests-2113236416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-3bb4a2a3-8e63-48c4-b8ca-93c68e802c5a 1073741824" returned: 0 in 0.400s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:36:59 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-65bdca78-7b3f-499e-9b18-41001a30c1e0 tempest-ProjectReaderTests-2113236416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-3bb4a2a3-8e63-48c4-b8ca-93c68e802c5a {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:36:59 devstack sudo[105333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-3bb4a2a3-8e63-48c4-b8ca-93c68e802c5a Sep 16 20:36:59 devstack sudo[105333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:36:59 devstack sudo[105333]: pam_unix(sudo:session): session closed for user root Sep 16 20:36:59 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-65bdca78-7b3f-499e-9b18-41001a30c1e0 tempest-ProjectReaderTests-2113236416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-3bb4a2a3-8e63-48c4-b8ca-93c68e802c5a" returned: 0 in 0.242s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:36:59 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-65bdca78-7b3f-499e-9b18-41001a30c1e0 tempest-ProjectReaderTests-2113236416 None] <== create_volume: return (679ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:36:59 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-65bdca78-7b3f-499e-9b18-41001a30c1e0 tempest-ProjectReaderTests-2113236416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.682s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:36:59 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-65bdca78-7b3f-499e-9b18-41001a30c1e0 tempest-ProjectReaderTests-2113236416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddec4fa5-3e40-44f3-960a-937b316d518b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bb4a2a3-8e63-48c4-b8ca-93c68e802c5a', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:36:59 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-65bdca78-7b3f-499e-9b18-41001a30c1e0 tempest-ProjectReaderTests-2113236416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32c7b3a1-1c9d-4710-9d84-831cf7c90447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:36:59 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-65bdca78-7b3f-499e-9b18-41001a30c1e0 tempest-ProjectReaderTests-2113236416 None] Volume volume-3bb4a2a3-8e63-48c4-b8ca-93c68e802c5a (3bb4a2a3-8e63-48c4-b8ca-93c68e802c5a): created successfully Sep 16 20:36:59 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-65bdca78-7b3f-499e-9b18-41001a30c1e0 tempest-ProjectReaderTests-2113236416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32c7b3a1-1c9d-4710-9d84-831cf7c90447) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:36:59 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-65bdca78-7b3f-499e-9b18-41001a30c1e0 tempest-ProjectReaderTests-2113236416 None] Flow 'volume_create_manager' (b40326c0-c3ca-40fd-941a-e714aa4e25b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:36:59 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-65bdca78-7b3f-499e-9b18-41001a30c1e0 tempest-ProjectReaderTests-2113236416 None] Created volume successfully. Sep 16 20:37:00 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-7e6f1b6c-ecd0-4c39-9237-d014159ed887 tempest-ProjectReaderTests-2113236416 None] Acquiring lock "cinder-3bb4a2a3-8e63-48c4-b8ca-93c68e802c5a-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:37:00 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-7e6f1b6c-ecd0-4c39-9237-d014159ed887 tempest-ProjectReaderTests-2113236416 None] Lock "cinder-3bb4a2a3-8e63-48c4-b8ca-93c68e802c5a-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:37:00 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-7e6f1b6c-ecd0-4c39-9237-d014159ed887 tempest-ProjectReaderTests-2113236416 None] Acquiring lock "cinder-quobyte-3bb4a2a3-8e63-48c4-b8ca-93c68e802c5a" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:37:00 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-7e6f1b6c-ecd0-4c39-9237-d014159ed887 tempest-ProjectReaderTests-2113236416 None] Lock "cinder-quobyte-3bb4a2a3-8e63-48c4-b8ca-93c68e802c5a" acquired by "delete_volume" :: waited 0.013s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:37:00 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[58d7b44a-bbb8-4f80-8e06-4ae8efae49e8]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:37:00 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-7e6f1b6c-ecd0-4c39-9237-d014159ed887 tempest-ProjectReaderTests-2113236416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-3bb4a2a3-8e63-48c4-b8ca-93c68e802c5a {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:00 devstack sudo[105336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-3bb4a2a3-8e63-48c4-b8ca-93c68e802c5a Sep 16 20:37:00 devstack sudo[105336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:00 devstack sudo[105336]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:00 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-7e6f1b6c-ecd0-4c39-9237-d014159ed887 tempest-ProjectReaderTests-2113236416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-3bb4a2a3-8e63-48c4-b8ca-93c68e802c5a" returned: 0 in 0.379s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:00 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-7e6f1b6c-ecd0-4c39-9237-d014159ed887 tempest-ProjectReaderTests-2113236416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-3bb4a2a3-8e63-48c4-b8ca-93c68e802c5a {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:00 devstack sudo[105377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-3bb4a2a3-8e63-48c4-b8ca-93c68e802c5a Sep 16 20:37:00 devstack sudo[105377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:00 devstack sudo[105377]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:00 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-7e6f1b6c-ecd0-4c39-9237-d014159ed887 tempest-ProjectReaderTests-2113236416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-3bb4a2a3-8e63-48c4-b8ca-93c68e802c5a" returned: 0 in 0.243s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:00 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-7e6f1b6c-ecd0-4c39-9237-d014159ed887 tempest-ProjectReaderTests-2113236416 None] Lock "cinder-quobyte-3bb4a2a3-8e63-48c4-b8ca-93c68e802c5a" released by "delete_volume" :: held 0.661s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:37:00 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-7e6f1b6c-ecd0-4c39-9237-d014159ed887 tempest-ProjectReaderTests-2113236416 None] Created reservations ['4fe2668d-665c-4171-adca-daf15aef7857', '3a8a1bb0-4f16-42e9-93db-d5644d873c93', '78953921-dfb8-42f0-99f3-c0883168cf3a', '7761ed30-da33-4b47-8b8c-1eb77905f64c'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:37:00 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-7e6f1b6c-ecd0-4c39-9237-d014159ed887 tempest-ProjectReaderTests-2113236416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:37:00 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-7e6f1b6c-ecd0-4c39-9237-d014159ed887 tempest-ProjectReaderTests-2113236416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:37:00 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-7e6f1b6c-ecd0-4c39-9237-d014159ed887 tempest-ProjectReaderTests-2113236416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:37:00 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-7e6f1b6c-ecd0-4c39-9237-d014159ed887 tempest-ProjectReaderTests-2113236416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:37:00 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-7e6f1b6c-ecd0-4c39-9237-d014159ed887 tempest-ProjectReaderTests-2113236416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:37:00 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-7e6f1b6c-ecd0-4c39-9237-d014159ed887 tempest-ProjectReaderTests-2113236416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:00 devstack sudo[105380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:37:00 devstack sudo[105380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:01 devstack sudo[105380]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:01 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-7e6f1b6c-ecd0-4c39-9237-d014159ed887 tempest-ProjectReaderTests-2113236416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.246s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:01 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-7e6f1b6c-ecd0-4c39-9237-d014159ed887 tempest-ProjectReaderTests-2113236416 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:37:01 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-7e6f1b6c-ecd0-4c39-9237-d014159ed887 tempest-ProjectReaderTests-2113236416 None] Deleted volume successfully. Sep 16 20:37:01 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-7e6f1b6c-ecd0-4c39-9237-d014159ed887 tempest-ProjectReaderTests-2113236416 None] Lock "cinder-3bb4a2a3-8e63-48c4-b8ca-93c68e802c5a-delete_volume" released by "delete_volume" :: held 1.100s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:37:01 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec13889a-5476-4af1-8d0c-4aa205999e4f tempest-ProjectReaderTests-2113236416 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:37:01 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ec13889a-5476-4af1-8d0c-4aa205999e4f tempest-ProjectReaderTests-2113236416 None] Flow 'volume_create_manager' (657708a0-c195-4266-8e85-1d64337868c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:37:01 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ec13889a-5476-4af1-8d0c-4aa205999e4f tempest-ProjectReaderTests-2113236416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0510dfa6-3bb6-4d49-84d0-fb4117243342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:01 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ec13889a-5476-4af1-8d0c-4aa205999e4f tempest-ProjectReaderTests-2113236416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0510dfa6-3bb6-4d49-84d0-fb4117243342) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:37:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1018771347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc539032-675a-45db-82e6-8c18a891cf07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='527e792a03f740a2b7c5ef3642195f5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:37:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:37:02Z,use_quota=True,user_id='97d6f7e562bd4acaac580315231086e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:01 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ec13889a-5476-4af1-8d0c-4aa205999e4f tempest-ProjectReaderTests-2113236416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4505d261-52e4-4c15-a437-60b37b21ddde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:01 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ec13889a-5476-4af1-8d0c-4aa205999e4f tempest-ProjectReaderTests-2113236416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4505d261-52e4-4c15-a437-60b37b21ddde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:01 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ec13889a-5476-4af1-8d0c-4aa205999e4f tempest-ProjectReaderTests-2113236416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60f7e362-1308-4062-aed7-8365d964b704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:01 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ec13889a-5476-4af1-8d0c-4aa205999e4f tempest-ProjectReaderTests-2113236416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60f7e362-1308-4062-aed7-8365d964b704) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc539032-675a-45db-82e6-8c18a891cf07', 'volume_name': 'volume-bc539032-675a-45db-82e6-8c18a891cf07', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:01 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ec13889a-5476-4af1-8d0c-4aa205999e4f tempest-ProjectReaderTests-2113236416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93ddcbd8-44cb-4b59-961c-75073cf95c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:01 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ec13889a-5476-4af1-8d0c-4aa205999e4f tempest-ProjectReaderTests-2113236416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93ddcbd8-44cb-4b59-961c-75073cf95c46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:01 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ec13889a-5476-4af1-8d0c-4aa205999e4f tempest-ProjectReaderTests-2113236416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4bad3ff-1715-445b-ac34-3d0dab94d0a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:01 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-ec13889a-5476-4af1-8d0c-4aa205999e4f tempest-ProjectReaderTests-2113236416 None] Volume bc539032-675a-45db-82e6-8c18a891cf07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc539032-675a-45db-82e6-8c18a891cf07', 'volume_size': 1} Sep 16 20:37:01 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-ec13889a-5476-4af1-8d0c-4aa205999e4f tempest-ProjectReaderTests-2113236416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:37:01 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-ec13889a-5476-4af1-8d0c-4aa205999e4f tempest-ProjectReaderTests-2113236416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:37:01 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-ec13889a-5476-4af1-8d0c-4aa205999e4f tempest-ProjectReaderTests-2113236416 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:37:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1018771347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc539032-675a-45db-82e6-8c18a891cf07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='527e792a03f740a2b7c5ef3642195f5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:37:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:37:02Z,use_quota=True,user_id='97d6f7e562bd4acaac580315231086e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:37:01 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-ec13889a-5476-4af1-8d0c-4aa205999e4f tempest-ProjectReaderTests-2113236416 None] Creating volume bc539032-675a-45db-82e6-8c18a891cf07 {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:37:01 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-ec13889a-5476-4af1-8d0c-4aa205999e4f tempest-ProjectReaderTests-2113236416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:37:01 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-ec13889a-5476-4af1-8d0c-4aa205999e4f tempest-ProjectReaderTests-2113236416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:37:01 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-ec13889a-5476-4af1-8d0c-4aa205999e4f tempest-ProjectReaderTests-2113236416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:37:01 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-ec13889a-5476-4af1-8d0c-4aa205999e4f tempest-ProjectReaderTests-2113236416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:37:01 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-ec13889a-5476-4af1-8d0c-4aa205999e4f tempest-ProjectReaderTests-2113236416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:37:01 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-ec13889a-5476-4af1-8d0c-4aa205999e4f tempest-ProjectReaderTests-2113236416 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:37:01 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-ec13889a-5476-4af1-8d0c-4aa205999e4f tempest-ProjectReaderTests-2113236416 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:37:01 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ec13889a-5476-4af1-8d0c-4aa205999e4f tempest-ProjectReaderTests-2113236416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-bc539032-675a-45db-82e6-8c18a891cf07 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:01 devstack sudo[105383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-bc539032-675a-45db-82e6-8c18a891cf07 1073741824 Sep 16 20:37:01 devstack sudo[105383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:02 devstack sudo[105383]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:02 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ec13889a-5476-4af1-8d0c-4aa205999e4f tempest-ProjectReaderTests-2113236416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-bc539032-675a-45db-82e6-8c18a891cf07 1073741824" returned: 0 in 0.415s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:02 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ec13889a-5476-4af1-8d0c-4aa205999e4f tempest-ProjectReaderTests-2113236416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-bc539032-675a-45db-82e6-8c18a891cf07 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:02 devstack sudo[105388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-bc539032-675a-45db-82e6-8c18a891cf07 Sep 16 20:37:02 devstack sudo[105388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:02 devstack sudo[105388]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:02 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ec13889a-5476-4af1-8d0c-4aa205999e4f tempest-ProjectReaderTests-2113236416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-bc539032-675a-45db-82e6-8c18a891cf07" returned: 0 in 0.244s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:02 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-ec13889a-5476-4af1-8d0c-4aa205999e4f tempest-ProjectReaderTests-2113236416 None] <== create_volume: return (700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:37:02 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-ec13889a-5476-4af1-8d0c-4aa205999e4f tempest-ProjectReaderTests-2113236416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.702s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:37:02 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ec13889a-5476-4af1-8d0c-4aa205999e4f tempest-ProjectReaderTests-2113236416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4bad3ff-1715-445b-ac34-3d0dab94d0a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc539032-675a-45db-82e6-8c18a891cf07', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:02 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ec13889a-5476-4af1-8d0c-4aa205999e4f tempest-ProjectReaderTests-2113236416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdb81c10-e950-423d-b987-c3aa0cd218d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:02 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-ec13889a-5476-4af1-8d0c-4aa205999e4f tempest-ProjectReaderTests-2113236416 None] Volume volume-bc539032-675a-45db-82e6-8c18a891cf07 (bc539032-675a-45db-82e6-8c18a891cf07): created successfully Sep 16 20:37:02 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ec13889a-5476-4af1-8d0c-4aa205999e4f tempest-ProjectReaderTests-2113236416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdb81c10-e950-423d-b987-c3aa0cd218d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:02 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ec13889a-5476-4af1-8d0c-4aa205999e4f tempest-ProjectReaderTests-2113236416 None] Flow 'volume_create_manager' (657708a0-c195-4266-8e85-1d64337868c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:37:02 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-ec13889a-5476-4af1-8d0c-4aa205999e4f tempest-ProjectReaderTests-2113236416 None] Created volume successfully. Sep 16 20:37:02 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-f68e77db-0f52-42c6-b2c2-552bb49f40b1 tempest-ProjectReaderTests-2113236416 None] Acquiring lock "cinder-bc539032-675a-45db-82e6-8c18a891cf07-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:37:02 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-f68e77db-0f52-42c6-b2c2-552bb49f40b1 tempest-ProjectReaderTests-2113236416 None] Lock "cinder-bc539032-675a-45db-82e6-8c18a891cf07-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:37:02 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-f68e77db-0f52-42c6-b2c2-552bb49f40b1 tempest-ProjectReaderTests-2113236416 None] Acquiring lock "cinder-quobyte-bc539032-675a-45db-82e6-8c18a891cf07" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:37:02 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-f68e77db-0f52-42c6-b2c2-552bb49f40b1 tempest-ProjectReaderTests-2113236416 None] Lock "cinder-quobyte-bc539032-675a-45db-82e6-8c18a891cf07" acquired by "delete_volume" :: waited 0.013s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:37:02 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1b7bf53-6d29-4fe8-84c3-089590f9d908]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:37:02 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f68e77db-0f52-42c6-b2c2-552bb49f40b1 tempest-ProjectReaderTests-2113236416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-bc539032-675a-45db-82e6-8c18a891cf07 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:02 devstack sudo[105391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-bc539032-675a-45db-82e6-8c18a891cf07 Sep 16 20:37:02 devstack sudo[105391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:03 devstack sudo[105391]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:03 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f68e77db-0f52-42c6-b2c2-552bb49f40b1 tempest-ProjectReaderTests-2113236416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-bc539032-675a-45db-82e6-8c18a891cf07" returned: 0 in 0.351s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:03 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f68e77db-0f52-42c6-b2c2-552bb49f40b1 tempest-ProjectReaderTests-2113236416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-bc539032-675a-45db-82e6-8c18a891cf07 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:03 devstack sudo[105396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-bc539032-675a-45db-82e6-8c18a891cf07 Sep 16 20:37:03 devstack sudo[105396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:03 devstack sudo[105396]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:03 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f68e77db-0f52-42c6-b2c2-552bb49f40b1 tempest-ProjectReaderTests-2113236416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-bc539032-675a-45db-82e6-8c18a891cf07" returned: 0 in 0.237s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:03 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-f68e77db-0f52-42c6-b2c2-552bb49f40b1 tempest-ProjectReaderTests-2113236416 None] Lock "cinder-quobyte-bc539032-675a-45db-82e6-8c18a891cf07" released by "delete_volume" :: held 0.629s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:37:03 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-f68e77db-0f52-42c6-b2c2-552bb49f40b1 tempest-ProjectReaderTests-2113236416 None] Created reservations ['305ad495-1dab-4d4f-b36e-11f69bc08123', '0e3656a3-01fe-4a58-a6c5-f18842a13b81', 'fc521691-d8fe-4578-b88b-eb61e191817b', 'a38b759e-ccd5-40d4-8925-820d3a50cce9'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:37:03 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-f68e77db-0f52-42c6-b2c2-552bb49f40b1 tempest-ProjectReaderTests-2113236416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:37:03 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-f68e77db-0f52-42c6-b2c2-552bb49f40b1 tempest-ProjectReaderTests-2113236416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:37:03 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-f68e77db-0f52-42c6-b2c2-552bb49f40b1 tempest-ProjectReaderTests-2113236416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:37:03 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-f68e77db-0f52-42c6-b2c2-552bb49f40b1 tempest-ProjectReaderTests-2113236416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:37:03 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-f68e77db-0f52-42c6-b2c2-552bb49f40b1 tempest-ProjectReaderTests-2113236416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:37:03 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f68e77db-0f52-42c6-b2c2-552bb49f40b1 tempest-ProjectReaderTests-2113236416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:03 devstack sudo[105399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:37:03 devstack sudo[105399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:03 devstack sudo[105399]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:03 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f68e77db-0f52-42c6-b2c2-552bb49f40b1 tempest-ProjectReaderTests-2113236416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.232s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:03 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-f68e77db-0f52-42c6-b2c2-552bb49f40b1 tempest-ProjectReaderTests-2113236416 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:37:03 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-f68e77db-0f52-42c6-b2c2-552bb49f40b1 tempest-ProjectReaderTests-2113236416 None] Deleted volume successfully. Sep 16 20:37:03 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-f68e77db-0f52-42c6-b2c2-552bb49f40b1 tempest-ProjectReaderTests-2113236416 None] Lock "cinder-bc539032-675a-45db-82e6-8c18a891cf07-delete_volume" released by "delete_volume" :: held 1.053s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:37:04 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f5b6847-35e5-48f9-919f-9b4bdcb6a388 tempest-ProjectReaderTests-2113236416 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:37:04 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-4f5b6847-35e5-48f9-919f-9b4bdcb6a388 tempest-ProjectReaderTests-2113236416 None] Flow 'volume_create_manager' (2f889224-5229-4bff-988c-aacba9cd4149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:37:04 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-4f5b6847-35e5-48f9-919f-9b4bdcb6a388 tempest-ProjectReaderTests-2113236416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc8952a9-b141-4990-9bcd-ed06d643398e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:04 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-4f5b6847-35e5-48f9-919f-9b4bdcb6a388 tempest-ProjectReaderTests-2113236416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc8952a9-b141-4990-9bcd-ed06d643398e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:37:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1289768856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cfc8a9b-5434-4e2e-86ee-cf7a6b98d9d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='527e792a03f740a2b7c5ef3642195f5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:37:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:37:04Z,use_quota=True,user_id='97d6f7e562bd4acaac580315231086e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:04 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-4f5b6847-35e5-48f9-919f-9b4bdcb6a388 tempest-ProjectReaderTests-2113236416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (149db1d5-79a8-4511-a1f7-64eeb03f23b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:04 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-4f5b6847-35e5-48f9-919f-9b4bdcb6a388 tempest-ProjectReaderTests-2113236416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (149db1d5-79a8-4511-a1f7-64eeb03f23b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:04 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-4f5b6847-35e5-48f9-919f-9b4bdcb6a388 tempest-ProjectReaderTests-2113236416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ac86217-b600-4ef5-8c51-529acc5d8835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:04 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-4f5b6847-35e5-48f9-919f-9b4bdcb6a388 tempest-ProjectReaderTests-2113236416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ac86217-b600-4ef5-8c51-529acc5d8835) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5cfc8a9b-5434-4e2e-86ee-cf7a6b98d9d5', 'volume_name': 'volume-5cfc8a9b-5434-4e2e-86ee-cf7a6b98d9d5', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:04 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-4f5b6847-35e5-48f9-919f-9b4bdcb6a388 tempest-ProjectReaderTests-2113236416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0569141-ec36-4ed6-82b8-b4ac6eb1a27f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:04 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-4f5b6847-35e5-48f9-919f-9b4bdcb6a388 tempest-ProjectReaderTests-2113236416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0569141-ec36-4ed6-82b8-b4ac6eb1a27f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:04 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-4f5b6847-35e5-48f9-919f-9b4bdcb6a388 tempest-ProjectReaderTests-2113236416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70e03f57-e46a-4ebd-ad38-28382fc04062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:04 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-4f5b6847-35e5-48f9-919f-9b4bdcb6a388 tempest-ProjectReaderTests-2113236416 None] Volume 5cfc8a9b-5434-4e2e-86ee-cf7a6b98d9d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5cfc8a9b-5434-4e2e-86ee-cf7a6b98d9d5', 'volume_size': 1} Sep 16 20:37:04 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-4f5b6847-35e5-48f9-919f-9b4bdcb6a388 tempest-ProjectReaderTests-2113236416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:37:04 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-4f5b6847-35e5-48f9-919f-9b4bdcb6a388 tempest-ProjectReaderTests-2113236416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:37:04 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-4f5b6847-35e5-48f9-919f-9b4bdcb6a388 tempest-ProjectReaderTests-2113236416 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:37:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1289768856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cfc8a9b-5434-4e2e-86ee-cf7a6b98d9d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='527e792a03f740a2b7c5ef3642195f5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:37:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:37:04Z,use_quota=True,user_id='97d6f7e562bd4acaac580315231086e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:37:04 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-4f5b6847-35e5-48f9-919f-9b4bdcb6a388 tempest-ProjectReaderTests-2113236416 None] Creating volume 5cfc8a9b-5434-4e2e-86ee-cf7a6b98d9d5 {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:37:04 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-4f5b6847-35e5-48f9-919f-9b4bdcb6a388 tempest-ProjectReaderTests-2113236416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:37:04 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-4f5b6847-35e5-48f9-919f-9b4bdcb6a388 tempest-ProjectReaderTests-2113236416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:37:04 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-4f5b6847-35e5-48f9-919f-9b4bdcb6a388 tempest-ProjectReaderTests-2113236416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:37:04 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-4f5b6847-35e5-48f9-919f-9b4bdcb6a388 tempest-ProjectReaderTests-2113236416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:37:04 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-4f5b6847-35e5-48f9-919f-9b4bdcb6a388 tempest-ProjectReaderTests-2113236416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:37:04 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-4f5b6847-35e5-48f9-919f-9b4bdcb6a388 tempest-ProjectReaderTests-2113236416 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:37:04 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-4f5b6847-35e5-48f9-919f-9b4bdcb6a388 tempest-ProjectReaderTests-2113236416 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:37:04 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-4f5b6847-35e5-48f9-919f-9b4bdcb6a388 tempest-ProjectReaderTests-2113236416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-5cfc8a9b-5434-4e2e-86ee-cf7a6b98d9d5 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:04 devstack sudo[105402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-5cfc8a9b-5434-4e2e-86ee-cf7a6b98d9d5 1073741824 Sep 16 20:37:04 devstack sudo[105402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:04 devstack sudo[105402]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:04 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-4f5b6847-35e5-48f9-919f-9b4bdcb6a388 tempest-ProjectReaderTests-2113236416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-5cfc8a9b-5434-4e2e-86ee-cf7a6b98d9d5 1073741824" returned: 0 in 0.398s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:04 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-4f5b6847-35e5-48f9-919f-9b4bdcb6a388 tempest-ProjectReaderTests-2113236416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-5cfc8a9b-5434-4e2e-86ee-cf7a6b98d9d5 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:04 devstack sudo[105409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-5cfc8a9b-5434-4e2e-86ee-cf7a6b98d9d5 Sep 16 20:37:04 devstack sudo[105409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:04 devstack sudo[105409]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:04 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-4f5b6847-35e5-48f9-919f-9b4bdcb6a388 tempest-ProjectReaderTests-2113236416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-5cfc8a9b-5434-4e2e-86ee-cf7a6b98d9d5" returned: 0 in 0.246s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:04 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-4f5b6847-35e5-48f9-919f-9b4bdcb6a388 tempest-ProjectReaderTests-2113236416 None] <== create_volume: return (684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:37:04 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-4f5b6847-35e5-48f9-919f-9b4bdcb6a388 tempest-ProjectReaderTests-2113236416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.686s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:37:04 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-4f5b6847-35e5-48f9-919f-9b4bdcb6a388 tempest-ProjectReaderTests-2113236416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70e03f57-e46a-4ebd-ad38-28382fc04062) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5cfc8a9b-5434-4e2e-86ee-cf7a6b98d9d5', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:04 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-4f5b6847-35e5-48f9-919f-9b4bdcb6a388 tempest-ProjectReaderTests-2113236416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (564ed1fb-0ffc-4171-b9e1-b6e2e70cc8c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:04 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-4f5b6847-35e5-48f9-919f-9b4bdcb6a388 tempest-ProjectReaderTests-2113236416 None] Volume volume-5cfc8a9b-5434-4e2e-86ee-cf7a6b98d9d5 (5cfc8a9b-5434-4e2e-86ee-cf7a6b98d9d5): created successfully Sep 16 20:37:04 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-4f5b6847-35e5-48f9-919f-9b4bdcb6a388 tempest-ProjectReaderTests-2113236416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (564ed1fb-0ffc-4171-b9e1-b6e2e70cc8c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:05 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-4f5b6847-35e5-48f9-919f-9b4bdcb6a388 tempest-ProjectReaderTests-2113236416 None] Flow 'volume_create_manager' (2f889224-5229-4bff-988c-aacba9cd4149) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:37:05 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-4f5b6847-35e5-48f9-919f-9b4bdcb6a388 tempest-ProjectReaderTests-2113236416 None] Created volume successfully. Sep 16 20:37:05 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-ca3ac139-8579-4bf0-972f-28553cefd65a tempest-ProjectReaderTests-2113236416 None] Acquiring lock "cinder-5cfc8a9b-5434-4e2e-86ee-cf7a6b98d9d5-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:37:05 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-ca3ac139-8579-4bf0-972f-28553cefd65a tempest-ProjectReaderTests-2113236416 None] Lock "cinder-5cfc8a9b-5434-4e2e-86ee-cf7a6b98d9d5-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:37:05 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-ca3ac139-8579-4bf0-972f-28553cefd65a tempest-ProjectReaderTests-2113236416 None] Acquiring lock "cinder-quobyte-5cfc8a9b-5434-4e2e-86ee-cf7a6b98d9d5" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:37:05 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-ca3ac139-8579-4bf0-972f-28553cefd65a tempest-ProjectReaderTests-2113236416 None] Lock "cinder-quobyte-5cfc8a9b-5434-4e2e-86ee-cf7a6b98d9d5" acquired by "delete_volume" :: waited 0.015s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:37:05 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f3d2bb6-c889-482f-abb0-44a0e65372cb]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:37:05 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ca3ac139-8579-4bf0-972f-28553cefd65a tempest-ProjectReaderTests-2113236416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-5cfc8a9b-5434-4e2e-86ee-cf7a6b98d9d5 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:05 devstack sudo[105418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-5cfc8a9b-5434-4e2e-86ee-cf7a6b98d9d5 Sep 16 20:37:05 devstack sudo[105418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:05 devstack sudo[105418]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:05 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ca3ac139-8579-4bf0-972f-28553cefd65a tempest-ProjectReaderTests-2113236416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-5cfc8a9b-5434-4e2e-86ee-cf7a6b98d9d5" returned: 0 in 0.367s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:05 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ca3ac139-8579-4bf0-972f-28553cefd65a tempest-ProjectReaderTests-2113236416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-5cfc8a9b-5434-4e2e-86ee-cf7a6b98d9d5 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:05 devstack sudo[105423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-5cfc8a9b-5434-4e2e-86ee-cf7a6b98d9d5 Sep 16 20:37:05 devstack sudo[105423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:05 devstack sudo[105423]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:05 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ca3ac139-8579-4bf0-972f-28553cefd65a tempest-ProjectReaderTests-2113236416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-5cfc8a9b-5434-4e2e-86ee-cf7a6b98d9d5" returned: 0 in 0.237s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:06 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-ca3ac139-8579-4bf0-972f-28553cefd65a tempest-ProjectReaderTests-2113236416 None] Lock "cinder-quobyte-5cfc8a9b-5434-4e2e-86ee-cf7a6b98d9d5" released by "delete_volume" :: held 0.645s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:37:06 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-ca3ac139-8579-4bf0-972f-28553cefd65a tempest-ProjectReaderTests-2113236416 None] Created reservations ['0310312b-fbfb-433c-b252-8ad447a69a4c', '583449cd-b824-4d53-8a0f-c3970fbb940b', 'c36c9f94-49cc-4450-a994-fe1e2bbefef6', '7b88efe2-cf1c-4124-b3d9-17021ebdb780'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:37:06 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-ca3ac139-8579-4bf0-972f-28553cefd65a tempest-ProjectReaderTests-2113236416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:37:06 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-ca3ac139-8579-4bf0-972f-28553cefd65a tempest-ProjectReaderTests-2113236416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:37:06 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-ca3ac139-8579-4bf0-972f-28553cefd65a tempest-ProjectReaderTests-2113236416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:37:06 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-ca3ac139-8579-4bf0-972f-28553cefd65a tempest-ProjectReaderTests-2113236416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:37:06 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-ca3ac139-8579-4bf0-972f-28553cefd65a tempest-ProjectReaderTests-2113236416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:37:06 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ca3ac139-8579-4bf0-972f-28553cefd65a tempest-ProjectReaderTests-2113236416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:06 devstack sudo[105426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:37:06 devstack sudo[105426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:06 devstack sudo[105426]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:06 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ca3ac139-8579-4bf0-972f-28553cefd65a tempest-ProjectReaderTests-2113236416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.235s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:06 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-ca3ac139-8579-4bf0-972f-28553cefd65a tempest-ProjectReaderTests-2113236416 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:37:06 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-ca3ac139-8579-4bf0-972f-28553cefd65a tempest-ProjectReaderTests-2113236416 None] Deleted volume successfully. Sep 16 20:37:06 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-ca3ac139-8579-4bf0-972f-28553cefd65a tempest-ProjectReaderTests-2113236416 None] Lock "cinder-5cfc8a9b-5434-4e2e-86ee-cf7a6b98d9d5-delete_volume" released by "delete_volume" :: held 1.072s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:37:06 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-637c0576-c707-42e1-9f30-9f93b4fc8e2a tempest-ProjectReaderTests-2113236416 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:37:06 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-637c0576-c707-42e1-9f30-9f93b4fc8e2a tempest-ProjectReaderTests-2113236416 None] Flow 'volume_create_manager' (48695ff5-98cd-4753-adf3-3eb610371feb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:37:06 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-637c0576-c707-42e1-9f30-9f93b4fc8e2a tempest-ProjectReaderTests-2113236416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac14c1b8-8d26-4e45-a238-f627733a75bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:06 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-637c0576-c707-42e1-9f30-9f93b4fc8e2a tempest-ProjectReaderTests-2113236416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac14c1b8-8d26-4e45-a238-f627733a75bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:37:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-217315124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b391f9ec-f3b0-4c2a-9d5e-49902fced299,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='527e792a03f740a2b7c5ef3642195f5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:37:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:37:07Z,use_quota=True,user_id='97d6f7e562bd4acaac580315231086e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:06 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-637c0576-c707-42e1-9f30-9f93b4fc8e2a tempest-ProjectReaderTests-2113236416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e75a82ff-b4bd-48d9-9679-641798f320e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:06 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-637c0576-c707-42e1-9f30-9f93b4fc8e2a tempest-ProjectReaderTests-2113236416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e75a82ff-b4bd-48d9-9679-641798f320e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:06 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-637c0576-c707-42e1-9f30-9f93b4fc8e2a tempest-ProjectReaderTests-2113236416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a797264-8bfa-4858-a46c-f877a4bb4680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:06 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-637c0576-c707-42e1-9f30-9f93b4fc8e2a tempest-ProjectReaderTests-2113236416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a797264-8bfa-4858-a46c-f877a4bb4680) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b391f9ec-f3b0-4c2a-9d5e-49902fced299', 'volume_name': 'volume-b391f9ec-f3b0-4c2a-9d5e-49902fced299', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:06 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-637c0576-c707-42e1-9f30-9f93b4fc8e2a tempest-ProjectReaderTests-2113236416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e49b7e4c-e65a-4b63-b338-6de6d6918ba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:06 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-637c0576-c707-42e1-9f30-9f93b4fc8e2a tempest-ProjectReaderTests-2113236416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e49b7e4c-e65a-4b63-b338-6de6d6918ba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:06 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-637c0576-c707-42e1-9f30-9f93b4fc8e2a tempest-ProjectReaderTests-2113236416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c82fba28-7b84-43c0-a13c-63c1bee7926a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:06 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-637c0576-c707-42e1-9f30-9f93b4fc8e2a tempest-ProjectReaderTests-2113236416 None] Volume b391f9ec-f3b0-4c2a-9d5e-49902fced299: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b391f9ec-f3b0-4c2a-9d5e-49902fced299', 'volume_size': 1} Sep 16 20:37:06 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-637c0576-c707-42e1-9f30-9f93b4fc8e2a tempest-ProjectReaderTests-2113236416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:37:06 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-637c0576-c707-42e1-9f30-9f93b4fc8e2a tempest-ProjectReaderTests-2113236416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:37:06 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-637c0576-c707-42e1-9f30-9f93b4fc8e2a tempest-ProjectReaderTests-2113236416 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:37:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-217315124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b391f9ec-f3b0-4c2a-9d5e-49902fced299,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='527e792a03f740a2b7c5ef3642195f5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:37:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:37:07Z,use_quota=True,user_id='97d6f7e562bd4acaac580315231086e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:37:06 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-637c0576-c707-42e1-9f30-9f93b4fc8e2a tempest-ProjectReaderTests-2113236416 None] Creating volume b391f9ec-f3b0-4c2a-9d5e-49902fced299 {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:37:06 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-637c0576-c707-42e1-9f30-9f93b4fc8e2a tempest-ProjectReaderTests-2113236416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:37:06 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-637c0576-c707-42e1-9f30-9f93b4fc8e2a tempest-ProjectReaderTests-2113236416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:37:06 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-637c0576-c707-42e1-9f30-9f93b4fc8e2a tempest-ProjectReaderTests-2113236416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:37:06 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-637c0576-c707-42e1-9f30-9f93b4fc8e2a tempest-ProjectReaderTests-2113236416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:37:06 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-637c0576-c707-42e1-9f30-9f93b4fc8e2a tempest-ProjectReaderTests-2113236416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:37:06 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-637c0576-c707-42e1-9f30-9f93b4fc8e2a tempest-ProjectReaderTests-2113236416 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:37:06 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-637c0576-c707-42e1-9f30-9f93b4fc8e2a tempest-ProjectReaderTests-2113236416 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:37:06 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-637c0576-c707-42e1-9f30-9f93b4fc8e2a tempest-ProjectReaderTests-2113236416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b391f9ec-f3b0-4c2a-9d5e-49902fced299 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:06 devstack sudo[105429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b391f9ec-f3b0-4c2a-9d5e-49902fced299 1073741824 Sep 16 20:37:06 devstack sudo[105429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:07 devstack sudo[105429]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:07 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-637c0576-c707-42e1-9f30-9f93b4fc8e2a tempest-ProjectReaderTests-2113236416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b391f9ec-f3b0-4c2a-9d5e-49902fced299 1073741824" returned: 0 in 0.401s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:07 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-637c0576-c707-42e1-9f30-9f93b4fc8e2a tempest-ProjectReaderTests-2113236416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b391f9ec-f3b0-4c2a-9d5e-49902fced299 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:07 devstack sudo[105437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b391f9ec-f3b0-4c2a-9d5e-49902fced299 Sep 16 20:37:07 devstack sudo[105437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:07 devstack sudo[105437]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:07 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-637c0576-c707-42e1-9f30-9f93b4fc8e2a tempest-ProjectReaderTests-2113236416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b391f9ec-f3b0-4c2a-9d5e-49902fced299" returned: 0 in 0.236s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:07 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-637c0576-c707-42e1-9f30-9f93b4fc8e2a tempest-ProjectReaderTests-2113236416 None] <== create_volume: return (677ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:37:07 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-637c0576-c707-42e1-9f30-9f93b4fc8e2a tempest-ProjectReaderTests-2113236416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.680s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:37:07 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-637c0576-c707-42e1-9f30-9f93b4fc8e2a tempest-ProjectReaderTests-2113236416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c82fba28-7b84-43c0-a13c-63c1bee7926a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b391f9ec-f3b0-4c2a-9d5e-49902fced299', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:07 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-637c0576-c707-42e1-9f30-9f93b4fc8e2a tempest-ProjectReaderTests-2113236416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9aef603-7f95-49b1-85d4-bdf069cbed64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:07 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-637c0576-c707-42e1-9f30-9f93b4fc8e2a tempest-ProjectReaderTests-2113236416 None] Volume volume-b391f9ec-f3b0-4c2a-9d5e-49902fced299 (b391f9ec-f3b0-4c2a-9d5e-49902fced299): created successfully Sep 16 20:37:07 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-637c0576-c707-42e1-9f30-9f93b4fc8e2a tempest-ProjectReaderTests-2113236416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9aef603-7f95-49b1-85d4-bdf069cbed64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:07 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-637c0576-c707-42e1-9f30-9f93b4fc8e2a tempest-ProjectReaderTests-2113236416 None] Flow 'volume_create_manager' (48695ff5-98cd-4753-adf3-3eb610371feb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:37:07 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-637c0576-c707-42e1-9f30-9f93b4fc8e2a tempest-ProjectReaderTests-2113236416 None] Created volume successfully. Sep 16 20:37:07 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-2baaf7c3-b33e-4db4-9011-83ddaee19bd6 tempest-ProjectReaderTests-2113236416 None] Acquiring lock "cinder-b391f9ec-f3b0-4c2a-9d5e-49902fced299-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:37:07 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-2baaf7c3-b33e-4db4-9011-83ddaee19bd6 tempest-ProjectReaderTests-2113236416 None] Lock "cinder-b391f9ec-f3b0-4c2a-9d5e-49902fced299-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:37:07 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-2baaf7c3-b33e-4db4-9011-83ddaee19bd6 tempest-ProjectReaderTests-2113236416 None] Acquiring lock "cinder-quobyte-b391f9ec-f3b0-4c2a-9d5e-49902fced299" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:37:07 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-2baaf7c3-b33e-4db4-9011-83ddaee19bd6 tempest-ProjectReaderTests-2113236416 None] Lock "cinder-quobyte-b391f9ec-f3b0-4c2a-9d5e-49902fced299" acquired by "delete_volume" :: waited 0.014s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:37:07 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[260bcb9f-cee8-4171-be8b-be1814e0c811]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:37:07 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-2baaf7c3-b33e-4db4-9011-83ddaee19bd6 tempest-ProjectReaderTests-2113236416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b391f9ec-f3b0-4c2a-9d5e-49902fced299 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:08 devstack sudo[105440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b391f9ec-f3b0-4c2a-9d5e-49902fced299 Sep 16 20:37:08 devstack sudo[105440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:08 devstack sudo[105440]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:08 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-2baaf7c3-b33e-4db4-9011-83ddaee19bd6 tempest-ProjectReaderTests-2113236416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b391f9ec-f3b0-4c2a-9d5e-49902fced299" returned: 0 in 0.366s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:08 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-2baaf7c3-b33e-4db4-9011-83ddaee19bd6 tempest-ProjectReaderTests-2113236416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b391f9ec-f3b0-4c2a-9d5e-49902fced299 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:08 devstack sudo[105445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b391f9ec-f3b0-4c2a-9d5e-49902fced299 Sep 16 20:37:08 devstack sudo[105445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:08 devstack sudo[105445]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:08 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-2baaf7c3-b33e-4db4-9011-83ddaee19bd6 tempest-ProjectReaderTests-2113236416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b391f9ec-f3b0-4c2a-9d5e-49902fced299" returned: 0 in 0.240s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:08 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-2baaf7c3-b33e-4db4-9011-83ddaee19bd6 tempest-ProjectReaderTests-2113236416 None] Lock "cinder-quobyte-b391f9ec-f3b0-4c2a-9d5e-49902fced299" released by "delete_volume" :: held 0.649s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:37:08 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-2baaf7c3-b33e-4db4-9011-83ddaee19bd6 tempest-ProjectReaderTests-2113236416 None] Created reservations ['ada63a4f-c9ba-45c8-bb3f-11b4c5ec938d', 'e69d0a1b-0b53-485e-94ab-be12f34a4ec0', 'ae60779c-8a3f-4f51-bce5-c2c0a6f77751', '83c66c1c-5d01-4fd6-85ff-68e2f441d649'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:37:08 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-2baaf7c3-b33e-4db4-9011-83ddaee19bd6 tempest-ProjectReaderTests-2113236416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:37:08 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-2baaf7c3-b33e-4db4-9011-83ddaee19bd6 tempest-ProjectReaderTests-2113236416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:37:08 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-2baaf7c3-b33e-4db4-9011-83ddaee19bd6 tempest-ProjectReaderTests-2113236416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:37:08 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-2baaf7c3-b33e-4db4-9011-83ddaee19bd6 tempest-ProjectReaderTests-2113236416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:37:08 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-2baaf7c3-b33e-4db4-9011-83ddaee19bd6 tempest-ProjectReaderTests-2113236416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:37:08 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-2baaf7c3-b33e-4db4-9011-83ddaee19bd6 tempest-ProjectReaderTests-2113236416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:08 devstack sudo[105448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:37:08 devstack sudo[105448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:08 devstack sudo[105448]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:08 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-2baaf7c3-b33e-4db4-9011-83ddaee19bd6 tempest-ProjectReaderTests-2113236416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.233s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:08 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-2baaf7c3-b33e-4db4-9011-83ddaee19bd6 tempest-ProjectReaderTests-2113236416 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:37:08 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-2baaf7c3-b33e-4db4-9011-83ddaee19bd6 tempest-ProjectReaderTests-2113236416 None] Deleted volume successfully. Sep 16 20:37:08 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-2baaf7c3-b33e-4db4-9011-83ddaee19bd6 tempest-ProjectReaderTests-2113236416 None] Lock "cinder-b391f9ec-f3b0-4c2a-9d5e-49902fced299-delete_volume" released by "delete_volume" :: held 1.070s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:37:18 devstack cinder-volume[86188]: DEBUG dbcounter [-] [86188] Writing DB stats cinder:UPDATE=42,cinder:SELECT=31,cinder:INSERT=14,cinder:DELETE=3 {{(pid=86188) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 20:37:18 devstack cinder-volume[86188]: DEBUG dbcounter [-] [86188] Writing DB stats cinder:SELECT=26,cinder:INSERT=6,cinder:UPDATE=47,cinder:DELETE=5 {{(pid=86188) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 20:37:20 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-150ec410-d153-4344-b80f-c3b97553e7b6 tempest-CreateVolumesFromImageTest-954412085 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:37:20 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-150ec410-d153-4344-b80f-c3b97553e7b6 tempest-CreateVolumesFromImageTest-954412085 None] Flow 'volume_create_manager' (27952af3-620f-4435-8f8b-b4b4ff068e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:37:20 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-150ec410-d153-4344-b80f-c3b97553e7b6 tempest-CreateVolumesFromImageTest-954412085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fadf62e-093e-428a-b00e-be77d8212f8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:20 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-150ec410-d153-4344-b80f-c3b97553e7b6 tempest-CreateVolumesFromImageTest-954412085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fadf62e-093e-428a-b00e-be77d8212f8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:37:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1497564438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40df3fd1-702e-4d27-aba9-3cbc21484afc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f4504a8ae8f48d4b29d92538b02aa25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:37:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:37:21Z,use_quota=True,user_id='24b3690b16a04bc4b55445552a68a6bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:20 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-150ec410-d153-4344-b80f-c3b97553e7b6 tempest-CreateVolumesFromImageTest-954412085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f57b8866-ac6a-49dc-8ea1-2180f028d2ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:20 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-150ec410-d153-4344-b80f-c3b97553e7b6 tempest-CreateVolumesFromImageTest-954412085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f57b8866-ac6a-49dc-8ea1-2180f028d2ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:20 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-150ec410-d153-4344-b80f-c3b97553e7b6 tempest-CreateVolumesFromImageTest-954412085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4b573fb-f656-4979-8a77-5c501f547ed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:20 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-150ec410-d153-4344-b80f-c3b97553e7b6 tempest-CreateVolumesFromImageTest-954412085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4b573fb-f656-4979-8a77-5c501f547ed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40df3fd1-702e-4d27-aba9-3cbc21484afc', 'volume_name': 'volume-40df3fd1-702e-4d27-aba9-3cbc21484afc', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:20 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-150ec410-d153-4344-b80f-c3b97553e7b6 tempest-CreateVolumesFromImageTest-954412085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23f9d35c-64b3-48b2-8e44-2cf8dd65a34b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:20 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-150ec410-d153-4344-b80f-c3b97553e7b6 tempest-CreateVolumesFromImageTest-954412085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23f9d35c-64b3-48b2-8e44-2cf8dd65a34b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:20 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-150ec410-d153-4344-b80f-c3b97553e7b6 tempest-CreateVolumesFromImageTest-954412085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed6e413e-ba78-4739-82e5-15b3baf3aee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:20 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-150ec410-d153-4344-b80f-c3b97553e7b6 tempest-CreateVolumesFromImageTest-954412085 None] Volume 40df3fd1-702e-4d27-aba9-3cbc21484afc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40df3fd1-702e-4d27-aba9-3cbc21484afc', 'volume_size': 1} Sep 16 20:37:20 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-150ec410-d153-4344-b80f-c3b97553e7b6 tempest-CreateVolumesFromImageTest-954412085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:37:20 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-150ec410-d153-4344-b80f-c3b97553e7b6 tempest-CreateVolumesFromImageTest-954412085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:37:20 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-150ec410-d153-4344-b80f-c3b97553e7b6 tempest-CreateVolumesFromImageTest-954412085 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:37:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1497564438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40df3fd1-702e-4d27-aba9-3cbc21484afc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f4504a8ae8f48d4b29d92538b02aa25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:37:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:37:21Z,use_quota=True,user_id='24b3690b16a04bc4b55445552a68a6bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:37:20 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-150ec410-d153-4344-b80f-c3b97553e7b6 tempest-CreateVolumesFromImageTest-954412085 None] Creating volume 40df3fd1-702e-4d27-aba9-3cbc21484afc {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:37:20 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-150ec410-d153-4344-b80f-c3b97553e7b6 tempest-CreateVolumesFromImageTest-954412085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:37:20 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-150ec410-d153-4344-b80f-c3b97553e7b6 tempest-CreateVolumesFromImageTest-954412085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:37:20 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-150ec410-d153-4344-b80f-c3b97553e7b6 tempest-CreateVolumesFromImageTest-954412085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:37:20 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-150ec410-d153-4344-b80f-c3b97553e7b6 tempest-CreateVolumesFromImageTest-954412085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:37:20 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-150ec410-d153-4344-b80f-c3b97553e7b6 tempest-CreateVolumesFromImageTest-954412085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:37:20 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-150ec410-d153-4344-b80f-c3b97553e7b6 tempest-CreateVolumesFromImageTest-954412085 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:37:20 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-150ec410-d153-4344-b80f-c3b97553e7b6 tempest-CreateVolumesFromImageTest-954412085 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:37:20 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-150ec410-d153-4344-b80f-c3b97553e7b6 tempest-CreateVolumesFromImageTest-954412085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-40df3fd1-702e-4d27-aba9-3cbc21484afc 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:20 devstack sudo[105491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-40df3fd1-702e-4d27-aba9-3cbc21484afc 1073741824 Sep 16 20:37:20 devstack sudo[105491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:21 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-30957f59-e3b4-4771-951d-c1e7b21c8fa4 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:37:21 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-30957f59-e3b4-4771-951d-c1e7b21c8fa4 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Flow 'volume_create_manager' (e736de29-e45e-4c48-8ca3-119381b80444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:37:21 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-30957f59-e3b4-4771-951d-c1e7b21c8fa4 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42b15b13-044e-4cd5-b709-9e74211faa24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:21 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-30957f59-e3b4-4771-951d-c1e7b21c8fa4 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42b15b13-044e-4cd5-b709-9e74211faa24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:37:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1216546698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c63fa010-30d6-42d8-ab10-04c4c913fb00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18ec43261b15442881c1519b383cf38f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:37:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:37:21Z,use_quota=True,user_id='5f83c4f77fe64640a8339e850d297e6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:21 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-30957f59-e3b4-4771-951d-c1e7b21c8fa4 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f9f49bf-7068-4660-a5f3-c5be1a7ff073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:21 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-30957f59-e3b4-4771-951d-c1e7b21c8fa4 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f9f49bf-7068-4660-a5f3-c5be1a7ff073) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:21 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-30957f59-e3b4-4771-951d-c1e7b21c8fa4 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a184502-7b07-4589-aa9d-02f9b8558569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:21 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-30957f59-e3b4-4771-951d-c1e7b21c8fa4 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a184502-7b07-4589-aa9d-02f9b8558569) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c63fa010-30d6-42d8-ab10-04c4c913fb00', 'volume_name': 'volume-c63fa010-30d6-42d8-ab10-04c4c913fb00', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:21 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-30957f59-e3b4-4771-951d-c1e7b21c8fa4 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (360e1f1f-2132-457e-b6f4-1ad2b1d2520f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:21 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-30957f59-e3b4-4771-951d-c1e7b21c8fa4 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (360e1f1f-2132-457e-b6f4-1ad2b1d2520f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:21 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-30957f59-e3b4-4771-951d-c1e7b21c8fa4 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5879767a-af7f-4499-917b-958b38b63da1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:21 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-30957f59-e3b4-4771-951d-c1e7b21c8fa4 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Volume c63fa010-30d6-42d8-ab10-04c4c913fb00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c63fa010-30d6-42d8-ab10-04c4c913fb00', 'volume_size': 1} Sep 16 20:37:21 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-30957f59-e3b4-4771-951d-c1e7b21c8fa4 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:37:21 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba783a5b-6386-4b5c-a4f3-dd5eb7f7fdbb tempest-CreateVolumesFromImageTest-954412085 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:37:21 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ba783a5b-6386-4b5c-a4f3-dd5eb7f7fdbb tempest-CreateVolumesFromImageTest-954412085 None] Flow 'volume_create_manager' (d69f459f-caea-48b9-b385-938d5fa62c86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:37:21 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ba783a5b-6386-4b5c-a4f3-dd5eb7f7fdbb tempest-CreateVolumesFromImageTest-954412085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (380062b3-143d-41d7-b742-de0fa6130d3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:21 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ba783a5b-6386-4b5c-a4f3-dd5eb7f7fdbb tempest-CreateVolumesFromImageTest-954412085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (380062b3-143d-41d7-b742-de0fa6130d3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:37:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1515072971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62d44ba1-4aa6-4652-935c-074516bdfda5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f4504a8ae8f48d4b29d92538b02aa25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:37:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:37:21Z,use_quota=True,user_id='24b3690b16a04bc4b55445552a68a6bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:21 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ba783a5b-6386-4b5c-a4f3-dd5eb7f7fdbb tempest-CreateVolumesFromImageTest-954412085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff105f2a-6444-4b87-a55b-d9a7a5caa080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:21 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ba783a5b-6386-4b5c-a4f3-dd5eb7f7fdbb tempest-CreateVolumesFromImageTest-954412085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff105f2a-6444-4b87-a55b-d9a7a5caa080) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:21 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ba783a5b-6386-4b5c-a4f3-dd5eb7f7fdbb tempest-CreateVolumesFromImageTest-954412085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4f8d3a7-7cd6-4b1f-8345-e800085b5375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:21 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ba783a5b-6386-4b5c-a4f3-dd5eb7f7fdbb tempest-CreateVolumesFromImageTest-954412085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4f8d3a7-7cd6-4b1f-8345-e800085b5375) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62d44ba1-4aa6-4652-935c-074516bdfda5', 'volume_name': 'volume-62d44ba1-4aa6-4652-935c-074516bdfda5', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:21 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ba783a5b-6386-4b5c-a4f3-dd5eb7f7fdbb tempest-CreateVolumesFromImageTest-954412085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (777ff59c-7dad-4a03-ac26-e866450971ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:21 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ba783a5b-6386-4b5c-a4f3-dd5eb7f7fdbb tempest-CreateVolumesFromImageTest-954412085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (777ff59c-7dad-4a03-ac26-e866450971ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:21 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ba783a5b-6386-4b5c-a4f3-dd5eb7f7fdbb tempest-CreateVolumesFromImageTest-954412085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (137cdcfa-5884-4dd7-8fdd-cd5d5455a8c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:21 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-ba783a5b-6386-4b5c-a4f3-dd5eb7f7fdbb tempest-CreateVolumesFromImageTest-954412085 None] Volume 62d44ba1-4aa6-4652-935c-074516bdfda5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62d44ba1-4aa6-4652-935c-074516bdfda5', 'volume_size': 1} Sep 16 20:37:21 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-ba783a5b-6386-4b5c-a4f3-dd5eb7f7fdbb tempest-CreateVolumesFromImageTest-954412085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:37:21 devstack sudo[105491]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:21 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-150ec410-d153-4344-b80f-c3b97553e7b6 tempest-CreateVolumesFromImageTest-954412085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-40df3fd1-702e-4d27-aba9-3cbc21484afc 1073741824" returned: 0 in 0.788s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:21 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-150ec410-d153-4344-b80f-c3b97553e7b6 tempest-CreateVolumesFromImageTest-954412085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-40df3fd1-702e-4d27-aba9-3cbc21484afc {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:21 devstack sudo[105497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-40df3fd1-702e-4d27-aba9-3cbc21484afc Sep 16 20:37:21 devstack sudo[105497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:21 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-256a8456-38ed-41b0-8f45-221488684455 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:37:21 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-256a8456-38ed-41b0-8f45-221488684455 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Flow 'volume_create_manager' (6aef9918-7050-4893-9a5d-b0876b0c478d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:37:21 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-256a8456-38ed-41b0-8f45-221488684455 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f66c4742-16de-495b-8fa3-879bf38848fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:22 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-c596d380-de68-427c-89aa-679bd654cc0c tempest-CreateVolumesFromImageTest-954412085 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:37:22 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-c596d380-de68-427c-89aa-679bd654cc0c tempest-CreateVolumesFromImageTest-954412085 None] Flow 'volume_create_manager' (1a096436-d7cb-411e-a739-284f9455c910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:37:22 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-c596d380-de68-427c-89aa-679bd654cc0c tempest-CreateVolumesFromImageTest-954412085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (722ef3a5-7083-40ec-83b4-df9682f14f3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:22 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-256a8456-38ed-41b0-8f45-221488684455 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f66c4742-16de-495b-8fa3-879bf38848fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:37:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1386548214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae09469c-8d27-4806-ac32-eac559656845,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be14f2fbcae04804b6ead8457652572b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:37:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:37:22Z,use_quota=True,user_id='0a42ae2d85c14e9c9bd48a96c1cc43ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:22 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-256a8456-38ed-41b0-8f45-221488684455 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c38e689-108e-4c07-9cf5-6996fa4f9e55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:22 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-256a8456-38ed-41b0-8f45-221488684455 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c38e689-108e-4c07-9cf5-6996fa4f9e55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:22 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-256a8456-38ed-41b0-8f45-221488684455 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a548390c-be49-4021-af92-c3cf3aa0535f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:22 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-256a8456-38ed-41b0-8f45-221488684455 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a548390c-be49-4021-af92-c3cf3aa0535f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae09469c-8d27-4806-ac32-eac559656845', 'volume_name': 'volume-ae09469c-8d27-4806-ac32-eac559656845', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:22 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-256a8456-38ed-41b0-8f45-221488684455 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64e55dbd-8209-4264-85f8-93298179100c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:22 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-256a8456-38ed-41b0-8f45-221488684455 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64e55dbd-8209-4264-85f8-93298179100c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:22 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-256a8456-38ed-41b0-8f45-221488684455 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8efbe7d6-70ca-4df8-8ca5-9894d75142af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:22 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-256a8456-38ed-41b0-8f45-221488684455 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Volume ae09469c-8d27-4806-ac32-eac559656845: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae09469c-8d27-4806-ac32-eac559656845', 'volume_size': 1} Sep 16 20:37:22 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-256a8456-38ed-41b0-8f45-221488684455 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:37:22 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-c596d380-de68-427c-89aa-679bd654cc0c tempest-CreateVolumesFromImageTest-954412085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (722ef3a5-7083-40ec-83b4-df9682f14f3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:37:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1461137691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7af2fa70-c81c-40be-b02d-5623573883cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f4504a8ae8f48d4b29d92538b02aa25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:37:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:37:22Z,use_quota=True,user_id='24b3690b16a04bc4b55445552a68a6bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:22 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-c596d380-de68-427c-89aa-679bd654cc0c tempest-CreateVolumesFromImageTest-954412085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b060a192-4839-4a50-8969-103298d03f54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:22 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-c596d380-de68-427c-89aa-679bd654cc0c tempest-CreateVolumesFromImageTest-954412085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b060a192-4839-4a50-8969-103298d03f54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:22 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-c596d380-de68-427c-89aa-679bd654cc0c tempest-CreateVolumesFromImageTest-954412085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09a380bd-c668-4827-b62e-dd5c4d296942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:22 devstack sudo[105497]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:22 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-c596d380-de68-427c-89aa-679bd654cc0c tempest-CreateVolumesFromImageTest-954412085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09a380bd-c668-4827-b62e-dd5c4d296942) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7af2fa70-c81c-40be-b02d-5623573883cb', 'volume_name': 'volume-7af2fa70-c81c-40be-b02d-5623573883cb', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:22 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-c596d380-de68-427c-89aa-679bd654cc0c tempest-CreateVolumesFromImageTest-954412085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98f93b6f-dabf-415a-bdb6-4fed3f449aa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:22 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-c596d380-de68-427c-89aa-679bd654cc0c tempest-CreateVolumesFromImageTest-954412085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98f93b6f-dabf-415a-bdb6-4fed3f449aa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:22 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-c596d380-de68-427c-89aa-679bd654cc0c tempest-CreateVolumesFromImageTest-954412085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d28db68-0123-4bf2-af81-654f26de6c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:22 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-c596d380-de68-427c-89aa-679bd654cc0c tempest-CreateVolumesFromImageTest-954412085 None] Volume 7af2fa70-c81c-40be-b02d-5623573883cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7af2fa70-c81c-40be-b02d-5623573883cb', 'volume_size': 1} Sep 16 20:37:22 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-c596d380-de68-427c-89aa-679bd654cc0c tempest-CreateVolumesFromImageTest-954412085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:37:22 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-150ec410-d153-4344-b80f-c3b97553e7b6 tempest-CreateVolumesFromImageTest-954412085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-40df3fd1-702e-4d27-aba9-3cbc21484afc" returned: 0 in 0.501s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:22 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-150ec410-d153-4344-b80f-c3b97553e7b6 tempest-CreateVolumesFromImageTest-954412085 None] <== create_volume: return (1357ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:37:22 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-150ec410-d153-4344-b80f-c3b97553e7b6 tempest-CreateVolumesFromImageTest-954412085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.360s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:37:22 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-30957f59-e3b4-4771-951d-c1e7b21c8fa4 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.792s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:37:22 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-30957f59-e3b4-4771-951d-c1e7b21c8fa4 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:37:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1216546698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c63fa010-30d6-42d8-ab10-04c4c913fb00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18ec43261b15442881c1519b383cf38f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:37:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:37:21Z,use_quota=True,user_id='5f83c4f77fe64640a8339e850d297e6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:37:22 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-30957f59-e3b4-4771-951d-c1e7b21c8fa4 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Creating volume c63fa010-30d6-42d8-ab10-04c4c913fb00 {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:37:22 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-30957f59-e3b4-4771-951d-c1e7b21c8fa4 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:37:22 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-30957f59-e3b4-4771-951d-c1e7b21c8fa4 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:37:22 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-30957f59-e3b4-4771-951d-c1e7b21c8fa4 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:37:22 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-30957f59-e3b4-4771-951d-c1e7b21c8fa4 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:37:22 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-30957f59-e3b4-4771-951d-c1e7b21c8fa4 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:37:22 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-30957f59-e3b4-4771-951d-c1e7b21c8fa4 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:37:22 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-30957f59-e3b4-4771-951d-c1e7b21c8fa4 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:37:22 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-30957f59-e3b4-4771-951d-c1e7b21c8fa4 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c63fa010-30d6-42d8-ab10-04c4c913fb00 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:22 devstack sudo[105500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c63fa010-30d6-42d8-ab10-04c4c913fb00 1073741824 Sep 16 20:37:22 devstack sudo[105500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:22 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-150ec410-d153-4344-b80f-c3b97553e7b6 tempest-CreateVolumesFromImageTest-954412085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed6e413e-ba78-4739-82e5-15b3baf3aee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40df3fd1-702e-4d27-aba9-3cbc21484afc', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:22 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-150ec410-d153-4344-b80f-c3b97553e7b6 tempest-CreateVolumesFromImageTest-954412085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ba3e0ac-c7bc-431b-bebe-3d995db812e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:22 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-150ec410-d153-4344-b80f-c3b97553e7b6 tempest-CreateVolumesFromImageTest-954412085 None] Volume volume-40df3fd1-702e-4d27-aba9-3cbc21484afc (40df3fd1-702e-4d27-aba9-3cbc21484afc): created successfully Sep 16 20:37:22 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-150ec410-d153-4344-b80f-c3b97553e7b6 tempest-CreateVolumesFromImageTest-954412085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ba3e0ac-c7bc-431b-bebe-3d995db812e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:22 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-150ec410-d153-4344-b80f-c3b97553e7b6 tempest-CreateVolumesFromImageTest-954412085 None] Flow 'volume_create_manager' (27952af3-620f-4435-8f8b-b4b4ff068e3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:37:22 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-20b19d29-909a-4459-a4cb-c7be1c881301 tempest-CreateVolumesFromImageTest-954412085 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:37:22 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-20b19d29-909a-4459-a4cb-c7be1c881301 tempest-CreateVolumesFromImageTest-954412085 None] Flow 'volume_create_manager' (9bfda702-f135-4fcf-b009-cfa4bc3ef1d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:37:22 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-20b19d29-909a-4459-a4cb-c7be1c881301 tempest-CreateVolumesFromImageTest-954412085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f87c1b6c-8879-4235-9589-5bb337b59bb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:22 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-20b19d29-909a-4459-a4cb-c7be1c881301 tempest-CreateVolumesFromImageTest-954412085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f87c1b6c-8879-4235-9589-5bb337b59bb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:37:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1902304615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8703a730-3262-4585-a970-e8ddcd3eaf54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f4504a8ae8f48d4b29d92538b02aa25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:37:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:37:22Z,use_quota=True,user_id='24b3690b16a04bc4b55445552a68a6bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:22 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-20b19d29-909a-4459-a4cb-c7be1c881301 tempest-CreateVolumesFromImageTest-954412085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4d24548-f801-4d74-ab8f-1e984f827bd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:22 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-20b19d29-909a-4459-a4cb-c7be1c881301 tempest-CreateVolumesFromImageTest-954412085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4d24548-f801-4d74-ab8f-1e984f827bd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:22 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-20b19d29-909a-4459-a4cb-c7be1c881301 tempest-CreateVolumesFromImageTest-954412085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26e59f6d-0ec9-40fb-b36f-646355ab6770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:22 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-20b19d29-909a-4459-a4cb-c7be1c881301 tempest-CreateVolumesFromImageTest-954412085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26e59f6d-0ec9-40fb-b36f-646355ab6770) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8703a730-3262-4585-a970-e8ddcd3eaf54', 'volume_name': 'volume-8703a730-3262-4585-a970-e8ddcd3eaf54', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:22 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-20b19d29-909a-4459-a4cb-c7be1c881301 tempest-CreateVolumesFromImageTest-954412085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a36de146-282d-461f-8be0-eb625747c13e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:22 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-20b19d29-909a-4459-a4cb-c7be1c881301 tempest-CreateVolumesFromImageTest-954412085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a36de146-282d-461f-8be0-eb625747c13e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:22 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-20b19d29-909a-4459-a4cb-c7be1c881301 tempest-CreateVolumesFromImageTest-954412085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0905539e-7400-4d42-b34d-68bd1bdbd0ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:22 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-20b19d29-909a-4459-a4cb-c7be1c881301 tempest-CreateVolumesFromImageTest-954412085 None] Volume 8703a730-3262-4585-a970-e8ddcd3eaf54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8703a730-3262-4585-a970-e8ddcd3eaf54', 'volume_size': 1} Sep 16 20:37:22 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-20b19d29-909a-4459-a4cb-c7be1c881301 tempest-CreateVolumesFromImageTest-954412085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:37:22 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-150ec410-d153-4344-b80f-c3b97553e7b6 tempest-CreateVolumesFromImageTest-954412085 None] Created volume successfully. Sep 16 20:37:22 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-190a2e03-a8e4-4112-8f8c-122c4de2cc5c tempest-CreateVolumesFromImageTest-954412085 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:37:22 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-190a2e03-a8e4-4112-8f8c-122c4de2cc5c tempest-CreateVolumesFromImageTest-954412085 None] Flow 'volume_create_manager' (0d582a00-27ea-4ae9-b2a1-88f24a305b53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:37:22 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-190a2e03-a8e4-4112-8f8c-122c4de2cc5c tempest-CreateVolumesFromImageTest-954412085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6582176-4b47-4fec-a7f1-195cf2c52923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:22 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-190a2e03-a8e4-4112-8f8c-122c4de2cc5c tempest-CreateVolumesFromImageTest-954412085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6582176-4b47-4fec-a7f1-195cf2c52923) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:37:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1612992829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a05225dc-dba4-4bb3-bb9a-e4780dc4f36e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f4504a8ae8f48d4b29d92538b02aa25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:37:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:37:23Z,use_quota=True,user_id='24b3690b16a04bc4b55445552a68a6bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:22 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-190a2e03-a8e4-4112-8f8c-122c4de2cc5c tempest-CreateVolumesFromImageTest-954412085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (909c8cde-096c-4206-9715-6dc27bbb8ae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:22 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-190a2e03-a8e4-4112-8f8c-122c4de2cc5c tempest-CreateVolumesFromImageTest-954412085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (909c8cde-096c-4206-9715-6dc27bbb8ae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:22 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-190a2e03-a8e4-4112-8f8c-122c4de2cc5c tempest-CreateVolumesFromImageTest-954412085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3001eaf4-2d7d-4d47-98cb-4790a9169844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:22 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-190a2e03-a8e4-4112-8f8c-122c4de2cc5c tempest-CreateVolumesFromImageTest-954412085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3001eaf4-2d7d-4d47-98cb-4790a9169844) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a05225dc-dba4-4bb3-bb9a-e4780dc4f36e', 'volume_name': 'volume-a05225dc-dba4-4bb3-bb9a-e4780dc4f36e', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:22 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-190a2e03-a8e4-4112-8f8c-122c4de2cc5c tempest-CreateVolumesFromImageTest-954412085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (030d68fe-88ca-4c4b-aea0-6a9a242ac346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:22 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-190a2e03-a8e4-4112-8f8c-122c4de2cc5c tempest-CreateVolumesFromImageTest-954412085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (030d68fe-88ca-4c4b-aea0-6a9a242ac346) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:22 devstack sudo[105500]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:22 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-190a2e03-a8e4-4112-8f8c-122c4de2cc5c tempest-CreateVolumesFromImageTest-954412085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8668f347-bc0e-4759-b53b-763428b79cda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:22 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-190a2e03-a8e4-4112-8f8c-122c4de2cc5c tempest-CreateVolumesFromImageTest-954412085 None] Volume a05225dc-dba4-4bb3-bb9a-e4780dc4f36e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a05225dc-dba4-4bb3-bb9a-e4780dc4f36e', 'volume_size': 1} Sep 16 20:37:22 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-190a2e03-a8e4-4112-8f8c-122c4de2cc5c tempest-CreateVolumesFromImageTest-954412085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:37:22 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-30957f59-e3b4-4771-951d-c1e7b21c8fa4 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c63fa010-30d6-42d8-ab10-04c4c913fb00 1073741824" returned: 0 in 0.616s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:22 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-30957f59-e3b4-4771-951d-c1e7b21c8fa4 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c63fa010-30d6-42d8-ab10-04c4c913fb00 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:22 devstack sudo[105506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c63fa010-30d6-42d8-ab10-04c4c913fb00 Sep 16 20:37:22 devstack sudo[105506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:23 devstack sudo[105506]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:23 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-30957f59-e3b4-4771-951d-c1e7b21c8fa4 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c63fa010-30d6-42d8-ab10-04c4c913fb00" returned: 0 in 0.285s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:23 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-30957f59-e3b4-4771-951d-c1e7b21c8fa4 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] <== create_volume: return (954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:37:23 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-30957f59-e3b4-4771-951d-c1e7b21c8fa4 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:37:23 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-ba783a5b-6386-4b5c-a4f3-dd5eb7f7fdbb tempest-CreateVolumesFromImageTest-954412085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.591s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:37:23 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-ba783a5b-6386-4b5c-a4f3-dd5eb7f7fdbb tempest-CreateVolumesFromImageTest-954412085 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:37:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1515072971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62d44ba1-4aa6-4652-935c-074516bdfda5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f4504a8ae8f48d4b29d92538b02aa25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:37:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:37:21Z,use_quota=True,user_id='24b3690b16a04bc4b55445552a68a6bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:37:23 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-ba783a5b-6386-4b5c-a4f3-dd5eb7f7fdbb tempest-CreateVolumesFromImageTest-954412085 None] Creating volume 62d44ba1-4aa6-4652-935c-074516bdfda5 {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:37:23 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-ba783a5b-6386-4b5c-a4f3-dd5eb7f7fdbb tempest-CreateVolumesFromImageTest-954412085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:37:23 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-ba783a5b-6386-4b5c-a4f3-dd5eb7f7fdbb tempest-CreateVolumesFromImageTest-954412085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:37:23 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-ba783a5b-6386-4b5c-a4f3-dd5eb7f7fdbb tempest-CreateVolumesFromImageTest-954412085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:37:23 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-ba783a5b-6386-4b5c-a4f3-dd5eb7f7fdbb tempest-CreateVolumesFromImageTest-954412085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:37:23 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-ba783a5b-6386-4b5c-a4f3-dd5eb7f7fdbb tempest-CreateVolumesFromImageTest-954412085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:37:23 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-ba783a5b-6386-4b5c-a4f3-dd5eb7f7fdbb tempest-CreateVolumesFromImageTest-954412085 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:37:23 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-ba783a5b-6386-4b5c-a4f3-dd5eb7f7fdbb tempest-CreateVolumesFromImageTest-954412085 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:37:23 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ba783a5b-6386-4b5c-a4f3-dd5eb7f7fdbb tempest-CreateVolumesFromImageTest-954412085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-62d44ba1-4aa6-4652-935c-074516bdfda5 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:23 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-30957f59-e3b4-4771-951d-c1e7b21c8fa4 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5879767a-af7f-4499-917b-958b38b63da1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c63fa010-30d6-42d8-ab10-04c4c913fb00', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:23 devstack sudo[105509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-62d44ba1-4aa6-4652-935c-074516bdfda5 1073741824 Sep 16 20:37:23 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-30957f59-e3b4-4771-951d-c1e7b21c8fa4 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ff7f599-21e4-4e80-b835-43fa5c9e3350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:23 devstack sudo[105509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:23 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-30957f59-e3b4-4771-951d-c1e7b21c8fa4 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Volume volume-c63fa010-30d6-42d8-ab10-04c4c913fb00 (c63fa010-30d6-42d8-ab10-04c4c913fb00): created successfully Sep 16 20:37:23 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-30957f59-e3b4-4771-951d-c1e7b21c8fa4 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ff7f599-21e4-4e80-b835-43fa5c9e3350) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:23 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-30957f59-e3b4-4771-951d-c1e7b21c8fa4 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Flow 'volume_create_manager' (e736de29-e45e-4c48-8ca3-119381b80444) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:37:23 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-30957f59-e3b4-4771-951d-c1e7b21c8fa4 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Created volume successfully. Sep 16 20:37:23 devstack sudo[105509]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:23 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ba783a5b-6386-4b5c-a4f3-dd5eb7f7fdbb tempest-CreateVolumesFromImageTest-954412085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-62d44ba1-4aa6-4652-935c-074516bdfda5 1073741824" returned: 0 in 0.462s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:23 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ba783a5b-6386-4b5c-a4f3-dd5eb7f7fdbb tempest-CreateVolumesFromImageTest-954412085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-62d44ba1-4aa6-4652-935c-074516bdfda5 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:23 devstack sudo[105515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-62d44ba1-4aa6-4652-935c-074516bdfda5 Sep 16 20:37:23 devstack sudo[105515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:23 devstack sudo[105515]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:23 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ba783a5b-6386-4b5c-a4f3-dd5eb7f7fdbb tempest-CreateVolumesFromImageTest-954412085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-62d44ba1-4aa6-4652-935c-074516bdfda5" returned: 0 in 0.247s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:23 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-ba783a5b-6386-4b5c-a4f3-dd5eb7f7fdbb tempest-CreateVolumesFromImageTest-954412085 None] <== create_volume: return (751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:37:23 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-ba783a5b-6386-4b5c-a4f3-dd5eb7f7fdbb tempest-CreateVolumesFromImageTest-954412085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.754s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:37:23 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-256a8456-38ed-41b0-8f45-221488684455 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.789s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:37:23 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-256a8456-38ed-41b0-8f45-221488684455 tempest-CreateVolumesFromSnapshotTest-1978168872 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:37:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1386548214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae09469c-8d27-4806-ac32-eac559656845,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be14f2fbcae04804b6ead8457652572b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:37:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:37:22Z,use_quota=True,user_id='0a42ae2d85c14e9c9bd48a96c1cc43ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:37:23 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-256a8456-38ed-41b0-8f45-221488684455 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Creating volume ae09469c-8d27-4806-ac32-eac559656845 {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:37:23 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-256a8456-38ed-41b0-8f45-221488684455 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:37:23 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-256a8456-38ed-41b0-8f45-221488684455 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:37:23 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-256a8456-38ed-41b0-8f45-221488684455 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:37:23 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-256a8456-38ed-41b0-8f45-221488684455 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:37:23 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-256a8456-38ed-41b0-8f45-221488684455 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:37:23 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-256a8456-38ed-41b0-8f45-221488684455 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:37:23 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-256a8456-38ed-41b0-8f45-221488684455 tempest-CreateVolumesFromSnapshotTest-1978168872 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:37:23 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-256a8456-38ed-41b0-8f45-221488684455 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ae09469c-8d27-4806-ac32-eac559656845 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:24 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ba783a5b-6386-4b5c-a4f3-dd5eb7f7fdbb tempest-CreateVolumesFromImageTest-954412085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (137cdcfa-5884-4dd7-8fdd-cd5d5455a8c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62d44ba1-4aa6-4652-935c-074516bdfda5', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:24 devstack sudo[105518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ae09469c-8d27-4806-ac32-eac559656845 1073741824 Sep 16 20:37:24 devstack sudo[105518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:24 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ba783a5b-6386-4b5c-a4f3-dd5eb7f7fdbb tempest-CreateVolumesFromImageTest-954412085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e479063b-a38c-4be7-9793-68c35ad3a86e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:24 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-ba783a5b-6386-4b5c-a4f3-dd5eb7f7fdbb tempest-CreateVolumesFromImageTest-954412085 None] Volume volume-62d44ba1-4aa6-4652-935c-074516bdfda5 (62d44ba1-4aa6-4652-935c-074516bdfda5): created successfully Sep 16 20:37:24 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ba783a5b-6386-4b5c-a4f3-dd5eb7f7fdbb tempest-CreateVolumesFromImageTest-954412085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e479063b-a38c-4be7-9793-68c35ad3a86e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:24 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ba783a5b-6386-4b5c-a4f3-dd5eb7f7fdbb tempest-CreateVolumesFromImageTest-954412085 None] Flow 'volume_create_manager' (d69f459f-caea-48b9-b385-938d5fa62c86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:37:24 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-ba783a5b-6386-4b5c-a4f3-dd5eb7f7fdbb tempest-CreateVolumesFromImageTest-954412085 None] Created volume successfully. Sep 16 20:37:24 devstack sudo[105518]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:24 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-256a8456-38ed-41b0-8f45-221488684455 tempest-CreateVolumesFromSnapshotTest-1978168872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ae09469c-8d27-4806-ac32-eac559656845 1073741824" returned: 0 in 0.494s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:24 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-256a8456-38ed-41b0-8f45-221488684455 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ae09469c-8d27-4806-ac32-eac559656845 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:24 devstack sudo[105524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ae09469c-8d27-4806-ac32-eac559656845 Sep 16 20:37:24 devstack sudo[105524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:24 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-eabfff95-8d86-4d26-ba50-ba9491d76746 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:37:24 devstack sudo[105524]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:24 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-eabfff95-8d86-4d26-ba50-ba9491d76746 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Flow 'volume_create_manager' (8df231ee-1482-4696-8f97-d89a00d7ec51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:37:24 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-eabfff95-8d86-4d26-ba50-ba9491d76746 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35941577-5b27-4dda-b303-918ca04769dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:24 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-256a8456-38ed-41b0-8f45-221488684455 tempest-CreateVolumesFromSnapshotTest-1978168872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ae09469c-8d27-4806-ac32-eac559656845" returned: 0 in 0.334s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:24 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-256a8456-38ed-41b0-8f45-221488684455 tempest-CreateVolumesFromSnapshotTest-1978168872 None] <== create_volume: return (877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:37:24 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-256a8456-38ed-41b0-8f45-221488684455 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.879s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:37:24 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-c596d380-de68-427c-89aa-679bd654cc0c tempest-CreateVolumesFromImageTest-954412085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.620s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:37:24 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-c596d380-de68-427c-89aa-679bd654cc0c tempest-CreateVolumesFromImageTest-954412085 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:37:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1461137691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7af2fa70-c81c-40be-b02d-5623573883cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f4504a8ae8f48d4b29d92538b02aa25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:37:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:37:22Z,use_quota=True,user_id='24b3690b16a04bc4b55445552a68a6bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:37:24 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-c596d380-de68-427c-89aa-679bd654cc0c tempest-CreateVolumesFromImageTest-954412085 None] Creating volume 7af2fa70-c81c-40be-b02d-5623573883cb {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:37:24 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-c596d380-de68-427c-89aa-679bd654cc0c tempest-CreateVolumesFromImageTest-954412085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:37:24 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-c596d380-de68-427c-89aa-679bd654cc0c tempest-CreateVolumesFromImageTest-954412085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:37:24 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-c596d380-de68-427c-89aa-679bd654cc0c tempest-CreateVolumesFromImageTest-954412085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:37:24 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-c596d380-de68-427c-89aa-679bd654cc0c tempest-CreateVolumesFromImageTest-954412085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:37:24 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-c596d380-de68-427c-89aa-679bd654cc0c tempest-CreateVolumesFromImageTest-954412085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:37:24 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-c596d380-de68-427c-89aa-679bd654cc0c tempest-CreateVolumesFromImageTest-954412085 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:37:24 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-c596d380-de68-427c-89aa-679bd654cc0c tempest-CreateVolumesFromImageTest-954412085 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:37:24 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-c596d380-de68-427c-89aa-679bd654cc0c tempest-CreateVolumesFromImageTest-954412085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-7af2fa70-c81c-40be-b02d-5623573883cb 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:24 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-eabfff95-8d86-4d26-ba50-ba9491d76746 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35941577-5b27-4dda-b303-918ca04769dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:37:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-64499132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2c64f04-0698-4340-8f7e-62265a895a5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18ec43261b15442881c1519b383cf38f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:37:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:37:25Z,use_quota=True,user_id='5f83c4f77fe64640a8339e850d297e6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:24 devstack sudo[105527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-7af2fa70-c81c-40be-b02d-5623573883cb 1073741824 Sep 16 20:37:24 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-eabfff95-8d86-4d26-ba50-ba9491d76746 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31e4340a-da3a-4027-b095-cc7b2ff13dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:24 devstack sudo[105527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:24 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-eabfff95-8d86-4d26-ba50-ba9491d76746 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31e4340a-da3a-4027-b095-cc7b2ff13dfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:24 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-eabfff95-8d86-4d26-ba50-ba9491d76746 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3ccf197-3fb5-4c0f-aba6-6e607e451d6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:24 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-eabfff95-8d86-4d26-ba50-ba9491d76746 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3ccf197-3fb5-4c0f-aba6-6e607e451d6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2c64f04-0698-4340-8f7e-62265a895a5a', 'volume_name': 'volume-b2c64f04-0698-4340-8f7e-62265a895a5a', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:24 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-eabfff95-8d86-4d26-ba50-ba9491d76746 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00a39d8c-e8fa-44e3-b206-f788677dd957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:24 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-eabfff95-8d86-4d26-ba50-ba9491d76746 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00a39d8c-e8fa-44e3-b206-f788677dd957) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:24 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-eabfff95-8d86-4d26-ba50-ba9491d76746 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d73f778-5d04-42fd-84ee-827028ed4d6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:24 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-eabfff95-8d86-4d26-ba50-ba9491d76746 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Volume b2c64f04-0698-4340-8f7e-62265a895a5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2c64f04-0698-4340-8f7e-62265a895a5a', 'volume_size': 1} Sep 16 20:37:24 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-eabfff95-8d86-4d26-ba50-ba9491d76746 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:37:24 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-256a8456-38ed-41b0-8f45-221488684455 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8efbe7d6-70ca-4df8-8ca5-9894d75142af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae09469c-8d27-4806-ac32-eac559656845', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:24 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-256a8456-38ed-41b0-8f45-221488684455 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4af6da3d-b577-4b7e-a433-a84cd02056f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:24 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-256a8456-38ed-41b0-8f45-221488684455 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Volume volume-ae09469c-8d27-4806-ac32-eac559656845 (ae09469c-8d27-4806-ac32-eac559656845): created successfully Sep 16 20:37:24 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-256a8456-38ed-41b0-8f45-221488684455 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4af6da3d-b577-4b7e-a433-a84cd02056f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:24 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-256a8456-38ed-41b0-8f45-221488684455 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Flow 'volume_create_manager' (6aef9918-7050-4893-9a5d-b0876b0c478d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:37:24 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-256a8456-38ed-41b0-8f45-221488684455 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Created volume successfully. Sep 16 20:37:25 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba54fc4e-db0a-489b-bfd1-6fc5107a6b49 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:37:25 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ba54fc4e-db0a-489b-bfd1-6fc5107a6b49 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Flow 'volume_create_manager' (ab23222d-9c28-420a-85ba-85c82d4356bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:37:25 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ba54fc4e-db0a-489b-bfd1-6fc5107a6b49 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (789d2213-2261-4302-b2c3-b9d3c58cf56a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:25 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ba54fc4e-db0a-489b-bfd1-6fc5107a6b49 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (789d2213-2261-4302-b2c3-b9d3c58cf56a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:37:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-205317904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b8bde32-db2d-4e69-b8d3-9e079a444698,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18ec43261b15442881c1519b383cf38f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:37:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:37:25Z,use_quota=True,user_id='5f83c4f77fe64640a8339e850d297e6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:25 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ba54fc4e-db0a-489b-bfd1-6fc5107a6b49 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53f4589b-42d5-4de5-8511-a046b1beebee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:25 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ba54fc4e-db0a-489b-bfd1-6fc5107a6b49 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53f4589b-42d5-4de5-8511-a046b1beebee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:25 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ba54fc4e-db0a-489b-bfd1-6fc5107a6b49 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (290af1b4-ce04-4b84-8cc9-c6f730f458e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:25 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ba54fc4e-db0a-489b-bfd1-6fc5107a6b49 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (290af1b4-ce04-4b84-8cc9-c6f730f458e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b8bde32-db2d-4e69-b8d3-9e079a444698', 'volume_name': 'volume-2b8bde32-db2d-4e69-b8d3-9e079a444698', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:25 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ba54fc4e-db0a-489b-bfd1-6fc5107a6b49 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acc908de-b054-4a43-ab8b-d82c57fc8191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:25 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ba54fc4e-db0a-489b-bfd1-6fc5107a6b49 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acc908de-b054-4a43-ab8b-d82c57fc8191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:25 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ba54fc4e-db0a-489b-bfd1-6fc5107a6b49 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (141a4cec-ff3e-4774-abc3-16a7f4ab63a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:25 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-ba54fc4e-db0a-489b-bfd1-6fc5107a6b49 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Volume 2b8bde32-db2d-4e69-b8d3-9e079a444698: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b8bde32-db2d-4e69-b8d3-9e079a444698', 'volume_size': 1} Sep 16 20:37:25 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-ba54fc4e-db0a-489b-bfd1-6fc5107a6b49 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:37:25 devstack sudo[105527]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:25 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-c596d380-de68-427c-89aa-679bd654cc0c tempest-CreateVolumesFromImageTest-954412085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-7af2fa70-c81c-40be-b02d-5623573883cb 1073741824" returned: 0 in 0.588s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:25 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-c596d380-de68-427c-89aa-679bd654cc0c tempest-CreateVolumesFromImageTest-954412085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-7af2fa70-c81c-40be-b02d-5623573883cb {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:25 devstack sudo[105533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-7af2fa70-c81c-40be-b02d-5623573883cb Sep 16 20:37:25 devstack sudo[105533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:25 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-816616ea-072a-42f7-8a62-d07d79740c1e tempest-CreateVolumesFromSnapshotTest-1978168872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:37:25 devstack sudo[105533]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:25 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-c596d380-de68-427c-89aa-679bd654cc0c tempest-CreateVolumesFromImageTest-954412085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-7af2fa70-c81c-40be-b02d-5623573883cb" returned: 0 in 0.333s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:25 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-c596d380-de68-427c-89aa-679bd654cc0c tempest-CreateVolumesFromImageTest-954412085 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:37:25 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-c596d380-de68-427c-89aa-679bd654cc0c tempest-CreateVolumesFromImageTest-954412085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:37:25 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-20b19d29-909a-4459-a4cb-c7be1c881301 tempest-CreateVolumesFromImageTest-954412085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.359s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:37:25 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-20b19d29-909a-4459-a4cb-c7be1c881301 tempest-CreateVolumesFromImageTest-954412085 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:37:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1902304615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8703a730-3262-4585-a970-e8ddcd3eaf54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f4504a8ae8f48d4b29d92538b02aa25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:37:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:37:22Z,use_quota=True,user_id='24b3690b16a04bc4b55445552a68a6bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:37:25 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-20b19d29-909a-4459-a4cb-c7be1c881301 tempest-CreateVolumesFromImageTest-954412085 None] Creating volume 8703a730-3262-4585-a970-e8ddcd3eaf54 {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:37:25 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-20b19d29-909a-4459-a4cb-c7be1c881301 tempest-CreateVolumesFromImageTest-954412085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:37:25 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-20b19d29-909a-4459-a4cb-c7be1c881301 tempest-CreateVolumesFromImageTest-954412085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:37:25 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-20b19d29-909a-4459-a4cb-c7be1c881301 tempest-CreateVolumesFromImageTest-954412085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:37:25 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-20b19d29-909a-4459-a4cb-c7be1c881301 tempest-CreateVolumesFromImageTest-954412085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:37:25 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-20b19d29-909a-4459-a4cb-c7be1c881301 tempest-CreateVolumesFromImageTest-954412085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:37:25 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-20b19d29-909a-4459-a4cb-c7be1c881301 tempest-CreateVolumesFromImageTest-954412085 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:37:25 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-20b19d29-909a-4459-a4cb-c7be1c881301 tempest-CreateVolumesFromImageTest-954412085 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:37:25 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-20b19d29-909a-4459-a4cb-c7be1c881301 tempest-CreateVolumesFromImageTest-954412085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-8703a730-3262-4585-a970-e8ddcd3eaf54 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:25 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-c596d380-de68-427c-89aa-679bd654cc0c tempest-CreateVolumesFromImageTest-954412085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d28db68-0123-4bf2-af81-654f26de6c16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7af2fa70-c81c-40be-b02d-5623573883cb', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:25 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-c596d380-de68-427c-89aa-679bd654cc0c tempest-CreateVolumesFromImageTest-954412085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1331809b-edfd-4a6f-8206-5a5f7d3eed14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:25 devstack sudo[105536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-8703a730-3262-4585-a970-e8ddcd3eaf54 1073741824 Sep 16 20:37:25 devstack sudo[105536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:25 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-c596d380-de68-427c-89aa-679bd654cc0c tempest-CreateVolumesFromImageTest-954412085 None] Volume volume-7af2fa70-c81c-40be-b02d-5623573883cb (7af2fa70-c81c-40be-b02d-5623573883cb): created successfully Sep 16 20:37:25 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-c596d380-de68-427c-89aa-679bd654cc0c tempest-CreateVolumesFromImageTest-954412085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1331809b-edfd-4a6f-8206-5a5f7d3eed14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:25 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-c596d380-de68-427c-89aa-679bd654cc0c tempest-CreateVolumesFromImageTest-954412085 None] Flow 'volume_create_manager' (1a096436-d7cb-411e-a739-284f9455c910) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:37:25 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc31dab2-0781-457f-8b20-7a53341df30f tempest-VolumeAndVolumeTypeFromImageTest-1520299628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:37:25 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-bc31dab2-0781-457f-8b20-7a53341df30f tempest-VolumeAndVolumeTypeFromImageTest-1520299628 None] Flow 'volume_create_manager' (318b1e75-d02f-4509-8313-60a2ec2461a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:37:25 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-bc31dab2-0781-457f-8b20-7a53341df30f tempest-VolumeAndVolumeTypeFromImageTest-1520299628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6c73430-23c3-40c9-b4b6-ed48d80ada53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:25 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-c596d380-de68-427c-89aa-679bd654cc0c tempest-CreateVolumesFromImageTest-954412085 None] Created volume successfully. Sep 16 20:37:26 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-bc31dab2-0781-457f-8b20-7a53341df30f tempest-VolumeAndVolumeTypeFromImageTest-1520299628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6c73430-23c3-40c9-b4b6-ed48d80ada53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:37:25Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4042f07-d1ca-467b-b61b-75f07a29678d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a681c0c0c42478f8b526f392809d000',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:37:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:37:26Z,use_quota=True,user_id='f6938bea3fc34eedb99509653e73ab1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(65fef380-75d2-48da-bce5-c94117e39c19),volume_type_id=65fef380-75d2-48da-bce5-c94117e39c19)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:26 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-bc31dab2-0781-457f-8b20-7a53341df30f tempest-VolumeAndVolumeTypeFromImageTest-1520299628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a85633c1-4e38-45c5-9ab1-6ed562f482ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:26 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-bc31dab2-0781-457f-8b20-7a53341df30f tempest-VolumeAndVolumeTypeFromImageTest-1520299628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a85633c1-4e38-45c5-9ab1-6ed562f482ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:26 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-bc31dab2-0781-457f-8b20-7a53341df30f tempest-VolumeAndVolumeTypeFromImageTest-1520299628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5021ef7-6c64-4398-a994-88064fb0bb90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:26 devstack cinder-volume[86188]: DEBUG cinder.image.glance [None req-bc31dab2-0781-457f-8b20-7a53341df30f tempest-VolumeAndVolumeTypeFromImageTest-1520299628 None] Creating Keystone auth plugin from conf {{(pid=86188) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 16 20:37:26 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-49f2eab3-1e30-4431-8644-d841045c4054 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:37:26 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-49f2eab3-1e30-4431-8644-d841045c4054 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Flow 'volume_create_manager' (21003237-a0f7-4c5a-bf9e-e8be038dedcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:37:26 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-49f2eab3-1e30-4431-8644-d841045c4054 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eef2de38-ece3-4bbd-aca5-dd0e7be38396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:26 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-49f2eab3-1e30-4431-8644-d841045c4054 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eef2de38-ece3-4bbd-aca5-dd0e7be38396) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:37:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1067831635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=993cf03f-b9c8-4f53-b1ef-44ee249b13e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18ec43261b15442881c1519b383cf38f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:37:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:37:26Z,use_quota=True,user_id='5f83c4f77fe64640a8339e850d297e6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:26 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-49f2eab3-1e30-4431-8644-d841045c4054 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a65522c-5089-457a-98e5-6d274173e81e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:26 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-49f2eab3-1e30-4431-8644-d841045c4054 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a65522c-5089-457a-98e5-6d274173e81e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:26 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-49f2eab3-1e30-4431-8644-d841045c4054 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ed82624-5dfe-4f2f-9bf0-9dd506999d8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:26 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-49f2eab3-1e30-4431-8644-d841045c4054 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ed82624-5dfe-4f2f-9bf0-9dd506999d8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '993cf03f-b9c8-4f53-b1ef-44ee249b13e4', 'volume_name': 'volume-993cf03f-b9c8-4f53-b1ef-44ee249b13e4', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:26 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-49f2eab3-1e30-4431-8644-d841045c4054 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c3ff55a-fda7-4e5c-aab8-dac432ec88e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:26 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-49f2eab3-1e30-4431-8644-d841045c4054 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c3ff55a-fda7-4e5c-aab8-dac432ec88e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:26 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-49f2eab3-1e30-4431-8644-d841045c4054 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3eddecef-f74c-41f4-bc11-b1d90e3e9d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:26 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-49f2eab3-1e30-4431-8644-d841045c4054 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Volume 993cf03f-b9c8-4f53-b1ef-44ee249b13e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-993cf03f-b9c8-4f53-b1ef-44ee249b13e4', 'volume_size': 1} Sep 16 20:37:26 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-49f2eab3-1e30-4431-8644-d841045c4054 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:37:26 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b2e6376-47f4-40d6-976d-86759a41b00e tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:37:26 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-8b2e6376-47f4-40d6-976d-86759a41b00e tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Flow 'volume_create_manager' (92c2ee6d-6d67-4d9b-94b5-d8848f990f36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:37:26 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-8b2e6376-47f4-40d6-976d-86759a41b00e tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dd9c245-42f5-4127-866d-4058f0ad1642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:26 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-8b2e6376-47f4-40d6-976d-86759a41b00e tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dd9c245-42f5-4127-866d-4058f0ad1642) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:37:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1830245714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=251988dc-8fff-41e4-a83e-5c201f5205ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18ec43261b15442881c1519b383cf38f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:37:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:37:26Z,use_quota=True,user_id='5f83c4f77fe64640a8339e850d297e6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:26 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-8b2e6376-47f4-40d6-976d-86759a41b00e tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d4d907b-43d4-4666-a7e7-c986f5f5836c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:26 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-8b2e6376-47f4-40d6-976d-86759a41b00e tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d4d907b-43d4-4666-a7e7-c986f5f5836c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:26 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-8b2e6376-47f4-40d6-976d-86759a41b00e tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b7ac522-7439-4af2-805a-97daed151524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:26 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-8b2e6376-47f4-40d6-976d-86759a41b00e tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b7ac522-7439-4af2-805a-97daed151524) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '251988dc-8fff-41e4-a83e-5c201f5205ca', 'volume_name': 'volume-251988dc-8fff-41e4-a83e-5c201f5205ca', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:26 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-8b2e6376-47f4-40d6-976d-86759a41b00e tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (141de1d8-5993-4e3c-a37a-80c63ecbecff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:26 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-8b2e6376-47f4-40d6-976d-86759a41b00e tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (141de1d8-5993-4e3c-a37a-80c63ecbecff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:26 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-8b2e6376-47f4-40d6-976d-86759a41b00e tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eac5b7f5-498a-47cd-919b-320a048f6ea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:26 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-8b2e6376-47f4-40d6-976d-86759a41b00e tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Volume 251988dc-8fff-41e4-a83e-5c201f5205ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-251988dc-8fff-41e4-a83e-5c201f5205ca', 'volume_size': 1} Sep 16 20:37:26 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-8b2e6376-47f4-40d6-976d-86759a41b00e tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:37:26 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-bc31dab2-0781-457f-8b20-7a53341df30f tempest-VolumeAndVolumeTypeFromImageTest-1520299628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5021ef7-6c64-4398-a994-88064fb0bb90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e4042f07-d1ca-467b-b61b-75f07a29678d', 'volume_name': 'volume-e4042f07-d1ca-467b-b61b-75f07a29678d', 'volume_size': 1, 'image_id': '09d26537-bd37-46c4-9143-6bbd2b644e90', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/09d26537-bd37-46c4-9143-6bbd2b644e90', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ce01715b28a48363a1bea42763972ef9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3a681c0c0c42478f8b526f392809d000', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '472324f2e26817490bc1c4924f4c4a0cb9b14d4b1d556cee584e3d78a04e6add68ecc9dcad9af8eee02eb9bf61afa23c3d971d143abe6a09be0cfdda9afd11a5', 'id': '09d26537-bd37-46c4-9143-6bbd2b644e90', 'created_at': datetime.datetime(2026, 9, 16, 18, 37, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 18, 37, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/09d26537-bd37-46c4-9143-6bbd2b644e90/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:26 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-bc31dab2-0781-457f-8b20-7a53341df30f tempest-VolumeAndVolumeTypeFromImageTest-1520299628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3cde769-a292-4995-b53c-f873710ebb73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:26 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-bc31dab2-0781-457f-8b20-7a53341df30f tempest-VolumeAndVolumeTypeFromImageTest-1520299628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3cde769-a292-4995-b53c-f873710ebb73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:26 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-bc31dab2-0781-457f-8b20-7a53341df30f tempest-VolumeAndVolumeTypeFromImageTest-1520299628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcd5baeb-9a60-4a88-a4e0-6fa1e2254459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:26 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-bc31dab2-0781-457f-8b20-7a53341df30f tempest-VolumeAndVolumeTypeFromImageTest-1520299628 None] Volume e4042f07-d1ca-467b-b61b-75f07a29678d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e4042f07-d1ca-467b-b61b-75f07a29678d', 'volume_size': 1, 'image_id': '09d26537-bd37-46c4-9143-6bbd2b644e90', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/09d26537-bd37-46c4-9143-6bbd2b644e90', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ce01715b28a48363a1bea42763972ef9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3a681c0c0c42478f8b526f392809d000', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '472324f2e26817490bc1c4924f4c4a0cb9b14d4b1d556cee584e3d78a04e6add68ecc9dcad9af8eee02eb9bf61afa23c3d971d143abe6a09be0cfdda9afd11a5', 'id': '09d26537-bd37-46c4-9143-6bbd2b644e90', 'created_at': datetime.datetime(2026, 9, 16, 18, 37, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 18, 37, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/09d26537-bd37-46c4-9143-6bbd2b644e90/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 16 20:37:26 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc31dab2-0781-457f-8b20-7a53341df30f tempest-VolumeAndVolumeTypeFromImageTest-1520299628 None] Trying to clone e4042f07-d1ca-467b-b61b-75f07a29678d from image 09d26537-bd37-46c4-9143-6bbd2b644e90 at location (None, [{'url': 'file:///opt/stack/data/glance/images/09d26537-bd37-46c4-9143-6bbd2b644e90', 'metadata': {}}]). {{(pid=86188) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 16 20:37:26 devstack cinder-volume[86188]: DEBUG cinder.image.image_utils [None req-bc31dab2-0781-457f-8b20-7a53341df30f tempest-VolumeAndVolumeTypeFromImageTest-1520299628 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_09d26537-bd37-46c4-9143-6bbd2b644e90_eusp__medevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86188) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 16 20:37:26 devstack cinder-volume[86188]: INFO cinder.image.image_utils [None req-bc31dab2-0781-457f-8b20-7a53341df30f tempest-VolumeAndVolumeTypeFromImageTest-1520299628 None] Image download 0.00 MB at 0.00 MB/s Sep 16 20:37:26 devstack sudo[105536]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:26 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-20b19d29-909a-4459-a4cb-c7be1c881301 tempest-CreateVolumesFromImageTest-954412085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-8703a730-3262-4585-a970-e8ddcd3eaf54 1073741824" returned: 0 in 0.669s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:26 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[893644f8-2642-4c34-bcf0-89c9f6afbd62]: (4, 'raw') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:37:26 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-bc31dab2-0781-457f-8b20-7a53341df30f tempest-VolumeAndVolumeTypeFromImageTest-1520299628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_09d26537-bd37-46c4-9143-6bbd2b644e90_eusp__medevstack@QuobyteHD {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:26 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-20b19d29-909a-4459-a4cb-c7be1c881301 tempest-CreateVolumesFromImageTest-954412085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-8703a730-3262-4585-a970-e8ddcd3eaf54 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:26 devstack sudo[105543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-8703a730-3262-4585-a970-e8ddcd3eaf54 Sep 16 20:37:26 devstack sudo[105543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:26 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac7c6af6-fcc7-4597-a3eb-5be75895bf20 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:37:26 devstack sudo[105542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_09d26537-bd37-46c4-9143-6bbd2b644e90_eusp__medevstack@QuobyteHD Sep 16 20:37:26 devstack sudo[105542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:26 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ac7c6af6-fcc7-4597-a3eb-5be75895bf20 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Flow 'volume_create_manager' (b7a2effd-b90d-4824-a81e-1fbdf2ab4b64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:37:26 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ac7c6af6-fcc7-4597-a3eb-5be75895bf20 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1af2e99-2aa3-4f16-af3b-46717cd000ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:26 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ac7c6af6-fcc7-4597-a3eb-5be75895bf20 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1af2e99-2aa3-4f16-af3b-46717cd000ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:37:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-299744537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a0cdb82-2d7a-4c36-94e6-6518dcbff139,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18ec43261b15442881c1519b383cf38f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:37:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:37:27Z,use_quota=True,user_id='5f83c4f77fe64640a8339e850d297e6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:26 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ac7c6af6-fcc7-4597-a3eb-5be75895bf20 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (731d50dc-8d7f-44a4-89ae-e1e9097ab932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:26 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ac7c6af6-fcc7-4597-a3eb-5be75895bf20 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (731d50dc-8d7f-44a4-89ae-e1e9097ab932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:26 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ac7c6af6-fcc7-4597-a3eb-5be75895bf20 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19fbd5b0-3aea-4441-b49f-cf4ada0a8d46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:26 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ac7c6af6-fcc7-4597-a3eb-5be75895bf20 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19fbd5b0-3aea-4441-b49f-cf4ada0a8d46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a0cdb82-2d7a-4c36-94e6-6518dcbff139', 'volume_name': 'volume-3a0cdb82-2d7a-4c36-94e6-6518dcbff139', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:26 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ac7c6af6-fcc7-4597-a3eb-5be75895bf20 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (327aaa33-c5e0-457b-af8d-eed5e63449e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:26 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ac7c6af6-fcc7-4597-a3eb-5be75895bf20 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (327aaa33-c5e0-457b-af8d-eed5e63449e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:26 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ac7c6af6-fcc7-4597-a3eb-5be75895bf20 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1d7a25f-7527-4c1f-a46f-08fcfbabc53c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:26 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-ac7c6af6-fcc7-4597-a3eb-5be75895bf20 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Volume 3a0cdb82-2d7a-4c36-94e6-6518dcbff139: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a0cdb82-2d7a-4c36-94e6-6518dcbff139', 'volume_size': 1} Sep 16 20:37:26 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-ac7c6af6-fcc7-4597-a3eb-5be75895bf20 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:37:26 devstack sudo[105543]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:26 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-20b19d29-909a-4459-a4cb-c7be1c881301 tempest-CreateVolumesFromImageTest-954412085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-8703a730-3262-4585-a970-e8ddcd3eaf54" returned: 0 in 0.310s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:26 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-20b19d29-909a-4459-a4cb-c7be1c881301 tempest-CreateVolumesFromImageTest-954412085 None] <== create_volume: return (1066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:37:26 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-20b19d29-909a-4459-a4cb-c7be1c881301 tempest-CreateVolumesFromImageTest-954412085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.068s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:37:26 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-190a2e03-a8e4-4112-8f8c-122c4de2cc5c tempest-CreateVolumesFromImageTest-954412085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.039s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:37:26 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-190a2e03-a8e4-4112-8f8c-122c4de2cc5c tempest-CreateVolumesFromImageTest-954412085 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:37:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1612992829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a05225dc-dba4-4bb3-bb9a-e4780dc4f36e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f4504a8ae8f48d4b29d92538b02aa25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:37:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:37:23Z,use_quota=True,user_id='24b3690b16a04bc4b55445552a68a6bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:37:26 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-190a2e03-a8e4-4112-8f8c-122c4de2cc5c tempest-CreateVolumesFromImageTest-954412085 None] Creating volume a05225dc-dba4-4bb3-bb9a-e4780dc4f36e {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:37:26 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-190a2e03-a8e4-4112-8f8c-122c4de2cc5c tempest-CreateVolumesFromImageTest-954412085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:37:26 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-190a2e03-a8e4-4112-8f8c-122c4de2cc5c tempest-CreateVolumesFromImageTest-954412085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:37:26 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-190a2e03-a8e4-4112-8f8c-122c4de2cc5c tempest-CreateVolumesFromImageTest-954412085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:37:26 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-190a2e03-a8e4-4112-8f8c-122c4de2cc5c tempest-CreateVolumesFromImageTest-954412085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:37:26 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-190a2e03-a8e4-4112-8f8c-122c4de2cc5c tempest-CreateVolumesFromImageTest-954412085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:37:26 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-190a2e03-a8e4-4112-8f8c-122c4de2cc5c tempest-CreateVolumesFromImageTest-954412085 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:37:26 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-190a2e03-a8e4-4112-8f8c-122c4de2cc5c tempest-CreateVolumesFromImageTest-954412085 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:37:26 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-190a2e03-a8e4-4112-8f8c-122c4de2cc5c tempest-CreateVolumesFromImageTest-954412085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a05225dc-dba4-4bb3-bb9a-e4780dc4f36e 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:26 devstack sudo[105542]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:26 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-20b19d29-909a-4459-a4cb-c7be1c881301 tempest-CreateVolumesFromImageTest-954412085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0905539e-7400-4d42-b34d-68bd1bdbd0ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8703a730-3262-4585-a970-e8ddcd3eaf54', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:26 devstack sudo[105549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a05225dc-dba4-4bb3-bb9a-e4780dc4f36e 1073741824 Sep 16 20:37:26 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-20b19d29-909a-4459-a4cb-c7be1c881301 tempest-CreateVolumesFromImageTest-954412085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42445396-c35b-4031-af8d-169fb43bed68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:26 devstack sudo[105549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:26 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-bc31dab2-0781-457f-8b20-7a53341df30f tempest-VolumeAndVolumeTypeFromImageTest-1520299628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_09d26537-bd37-46c4-9143-6bbd2b644e90_eusp__medevstack@QuobyteHD" returned: 0 in 0.394s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:26 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-bc31dab2-0781-457f-8b20-7a53341df30f tempest-VolumeAndVolumeTypeFromImageTest-1520299628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_09d26537-bd37-46c4-9143-6bbd2b644e90_eusp__medevstack@QuobyteHD {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:26 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-20b19d29-909a-4459-a4cb-c7be1c881301 tempest-CreateVolumesFromImageTest-954412085 None] Volume volume-8703a730-3262-4585-a970-e8ddcd3eaf54 (8703a730-3262-4585-a970-e8ddcd3eaf54): created successfully Sep 16 20:37:26 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-20b19d29-909a-4459-a4cb-c7be1c881301 tempest-CreateVolumesFromImageTest-954412085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42445396-c35b-4031-af8d-169fb43bed68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:26 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-20b19d29-909a-4459-a4cb-c7be1c881301 tempest-CreateVolumesFromImageTest-954412085 None] Flow 'volume_create_manager' (9bfda702-f135-4fcf-b009-cfa4bc3ef1d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:37:27 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-20b19d29-909a-4459-a4cb-c7be1c881301 tempest-CreateVolumesFromImageTest-954412085 None] Created volume successfully. Sep 16 20:37:27 devstack sudo[105551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_09d26537-bd37-46c4-9143-6bbd2b644e90_eusp__medevstack@QuobyteHD Sep 16 20:37:27 devstack sudo[105551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:27 devstack sudo[105551]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:27 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-bc31dab2-0781-457f-8b20-7a53341df30f tempest-VolumeAndVolumeTypeFromImageTest-1520299628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_09d26537-bd37-46c4-9143-6bbd2b644e90_eusp__medevstack@QuobyteHD" returned: 1 in 0.350s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:27 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-bc31dab2-0781-457f-8b20-7a53341df30f tempest-VolumeAndVolumeTypeFromImageTest-1520299628 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_09d26537-bd37-46c4-9143-6bbd2b644e90_eusp__medevstack@QuobyteHD' failed. Not Retrying. {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 16 20:37:27 devstack cinder-volume[86188]: DEBUG cinder.image.image_utils [None req-bc31dab2-0781-457f-8b20-7a53341df30f tempest-VolumeAndVolumeTypeFromImageTest-1520299628 None] Temporary image 09d26537-bd37-46c4-9143-6bbd2b644e90 is fetched for user f6938bea3fc34eedb99509653e73ab1b. {{(pid=86188) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 16 20:37:27 devstack sudo[105549]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:27 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-190a2e03-a8e4-4112-8f8c-122c4de2cc5c tempest-CreateVolumesFromImageTest-954412085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a05225dc-dba4-4bb3-bb9a-e4780dc4f36e 1073741824" returned: 0 in 0.420s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:27 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[791323d0-831c-4818-b3e6-2a9d456223d0]: (4, 'raw') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:37:27 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-bc31dab2-0781-457f-8b20-7a53341df30f tempest-VolumeAndVolumeTypeFromImageTest-1520299628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_09d26537-bd37-46c4-9143-6bbd2b644e90_eusp__medevstack@QuobyteHD {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:27 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-190a2e03-a8e4-4112-8f8c-122c4de2cc5c tempest-CreateVolumesFromImageTest-954412085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a05225dc-dba4-4bb3-bb9a-e4780dc4f36e {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:27 devstack sudo[105561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a05225dc-dba4-4bb3-bb9a-e4780dc4f36e Sep 16 20:37:27 devstack sudo[105561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:27 devstack sudo[105560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_09d26537-bd37-46c4-9143-6bbd2b644e90_eusp__medevstack@QuobyteHD Sep 16 20:37:27 devstack sudo[105560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:27 devstack sudo[105561]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:27 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-190a2e03-a8e4-4112-8f8c-122c4de2cc5c tempest-CreateVolumesFromImageTest-954412085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a05225dc-dba4-4bb3-bb9a-e4780dc4f36e" returned: 0 in 0.253s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:27 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-190a2e03-a8e4-4112-8f8c-122c4de2cc5c tempest-CreateVolumesFromImageTest-954412085 None] <== create_volume: return (729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:37:27 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-190a2e03-a8e4-4112-8f8c-122c4de2cc5c tempest-CreateVolumesFromImageTest-954412085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.732s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:37:27 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-eabfff95-8d86-4d26-ba50-ba9491d76746 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.722s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:37:27 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-eabfff95-8d86-4d26-ba50-ba9491d76746 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:37:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-64499132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2c64f04-0698-4340-8f7e-62265a895a5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18ec43261b15442881c1519b383cf38f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:37:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:37:25Z,use_quota=True,user_id='5f83c4f77fe64640a8339e850d297e6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:37:27 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-eabfff95-8d86-4d26-ba50-ba9491d76746 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Creating volume b2c64f04-0698-4340-8f7e-62265a895a5a {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:37:27 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-eabfff95-8d86-4d26-ba50-ba9491d76746 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:37:27 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-eabfff95-8d86-4d26-ba50-ba9491d76746 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:37:27 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-eabfff95-8d86-4d26-ba50-ba9491d76746 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:37:27 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-eabfff95-8d86-4d26-ba50-ba9491d76746 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:37:27 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-eabfff95-8d86-4d26-ba50-ba9491d76746 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:37:27 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-eabfff95-8d86-4d26-ba50-ba9491d76746 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:37:27 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-eabfff95-8d86-4d26-ba50-ba9491d76746 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:37:27 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-eabfff95-8d86-4d26-ba50-ba9491d76746 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b2c64f04-0698-4340-8f7e-62265a895a5a 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:27 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-190a2e03-a8e4-4112-8f8c-122c4de2cc5c tempest-CreateVolumesFromImageTest-954412085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8668f347-bc0e-4759-b53b-763428b79cda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a05225dc-dba4-4bb3-bb9a-e4780dc4f36e', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:27 devstack sudo[105565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b2c64f04-0698-4340-8f7e-62265a895a5a 1073741824 Sep 16 20:37:27 devstack sudo[105565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:27 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-190a2e03-a8e4-4112-8f8c-122c4de2cc5c tempest-CreateVolumesFromImageTest-954412085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3c7c040-bd0b-49c6-8aa2-ec9e270fbf7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:27 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-190a2e03-a8e4-4112-8f8c-122c4de2cc5c tempest-CreateVolumesFromImageTest-954412085 None] Volume volume-a05225dc-dba4-4bb3-bb9a-e4780dc4f36e (a05225dc-dba4-4bb3-bb9a-e4780dc4f36e): created successfully Sep 16 20:37:27 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-190a2e03-a8e4-4112-8f8c-122c4de2cc5c tempest-CreateVolumesFromImageTest-954412085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3c7c040-bd0b-49c6-8aa2-ec9e270fbf7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:27 devstack sudo[105560]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:27 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-190a2e03-a8e4-4112-8f8c-122c4de2cc5c tempest-CreateVolumesFromImageTest-954412085 None] Flow 'volume_create_manager' (0d582a00-27ea-4ae9-b2a1-88f24a305b53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:37:27 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-bc31dab2-0781-457f-8b20-7a53341df30f tempest-VolumeAndVolumeTypeFromImageTest-1520299628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_09d26537-bd37-46c4-9143-6bbd2b644e90_eusp__medevstack@QuobyteHD" returned: 0 in 0.358s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:27 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-bc31dab2-0781-457f-8b20-7a53341df30f tempest-VolumeAndVolumeTypeFromImageTest-1520299628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_09d26537-bd37-46c4-9143-6bbd2b644e90_eusp__medevstack@QuobyteHD {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:27 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-190a2e03-a8e4-4112-8f8c-122c4de2cc5c tempest-CreateVolumesFromImageTest-954412085 None] Created volume successfully. Sep 16 20:37:27 devstack sudo[105569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_09d26537-bd37-46c4-9143-6bbd2b644e90_eusp__medevstack@QuobyteHD Sep 16 20:37:27 devstack sudo[105569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:28 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-ffeaf547-de0a-4e8a-830b-eeb426976860 tempest-CreateVolumesFromImageTest-954412085 None] Acquiring lock "cinder-a05225dc-dba4-4bb3-bb9a-e4780dc4f36e-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:37:28 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-ffeaf547-de0a-4e8a-830b-eeb426976860 tempest-CreateVolumesFromImageTest-954412085 None] Lock "cinder-a05225dc-dba4-4bb3-bb9a-e4780dc4f36e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:37:28 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-ffeaf547-de0a-4e8a-830b-eeb426976860 tempest-CreateVolumesFromImageTest-954412085 None] Acquiring lock "cinder-quobyte-a05225dc-dba4-4bb3-bb9a-e4780dc4f36e" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:37:28 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-ffeaf547-de0a-4e8a-830b-eeb426976860 tempest-CreateVolumesFromImageTest-954412085 None] Lock "cinder-quobyte-a05225dc-dba4-4bb3-bb9a-e4780dc4f36e" acquired by "delete_volume" :: waited 0.016s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:37:28 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f9be283-71ed-4faf-b02b-becbaead234e]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:37:28 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ffeaf547-de0a-4e8a-830b-eeb426976860 tempest-CreateVolumesFromImageTest-954412085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a05225dc-dba4-4bb3-bb9a-e4780dc4f36e {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:28 devstack sudo[105569]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:28 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-bc31dab2-0781-457f-8b20-7a53341df30f tempest-VolumeAndVolumeTypeFromImageTest-1520299628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_09d26537-bd37-46c4-9143-6bbd2b644e90_eusp__medevstack@QuobyteHD" returned: 1 in 0.413s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:28 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-bc31dab2-0781-457f-8b20-7a53341df30f tempest-VolumeAndVolumeTypeFromImageTest-1520299628 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_09d26537-bd37-46c4-9143-6bbd2b644e90_eusp__medevstack@QuobyteHD' failed. Not Retrying. {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 16 20:37:28 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-bc31dab2-0781-457f-8b20-7a53341df30f tempest-VolumeAndVolumeTypeFromImageTest-1520299628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:37:28 devstack sudo[105565]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:28 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-eabfff95-8d86-4d26-ba50-ba9491d76746 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b2c64f04-0698-4340-8f7e-62265a895a5a 1073741824" returned: 0 in 0.536s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:28 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-eabfff95-8d86-4d26-ba50-ba9491d76746 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b2c64f04-0698-4340-8f7e-62265a895a5a {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:28 devstack sudo[105578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a05225dc-dba4-4bb3-bb9a-e4780dc4f36e Sep 16 20:37:28 devstack sudo[105579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b2c64f04-0698-4340-8f7e-62265a895a5a Sep 16 20:37:28 devstack sudo[105578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:28 devstack sudo[105579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:28 devstack sudo[105579]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:28 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-eabfff95-8d86-4d26-ba50-ba9491d76746 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b2c64f04-0698-4340-8f7e-62265a895a5a" returned: 0 in 0.248s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:28 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-eabfff95-8d86-4d26-ba50-ba9491d76746 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] <== create_volume: return (826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:37:28 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-eabfff95-8d86-4d26-ba50-ba9491d76746 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.829s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:37:28 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-ba54fc4e-db0a-489b-bfd1-6fc5107a6b49 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.137s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:37:28 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-ba54fc4e-db0a-489b-bfd1-6fc5107a6b49 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:37:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-205317904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b8bde32-db2d-4e69-b8d3-9e079a444698,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18ec43261b15442881c1519b383cf38f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:37:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:37:25Z,use_quota=True,user_id='5f83c4f77fe64640a8339e850d297e6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:37:28 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-ba54fc4e-db0a-489b-bfd1-6fc5107a6b49 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Creating volume 2b8bde32-db2d-4e69-b8d3-9e079a444698 {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:37:28 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-ba54fc4e-db0a-489b-bfd1-6fc5107a6b49 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:37:28 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-ba54fc4e-db0a-489b-bfd1-6fc5107a6b49 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:37:28 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-ba54fc4e-db0a-489b-bfd1-6fc5107a6b49 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:37:28 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-ba54fc4e-db0a-489b-bfd1-6fc5107a6b49 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:37:28 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-ba54fc4e-db0a-489b-bfd1-6fc5107a6b49 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:37:28 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-ba54fc4e-db0a-489b-bfd1-6fc5107a6b49 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:37:28 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-ba54fc4e-db0a-489b-bfd1-6fc5107a6b49 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:37:28 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ba54fc4e-db0a-489b-bfd1-6fc5107a6b49 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-2b8bde32-db2d-4e69-b8d3-9e079a444698 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:28 devstack sudo[105578]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:28 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ffeaf547-de0a-4e8a-830b-eeb426976860 tempest-CreateVolumesFromImageTest-954412085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a05225dc-dba4-4bb3-bb9a-e4780dc4f36e" returned: 0 in 0.371s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:28 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ffeaf547-de0a-4e8a-830b-eeb426976860 tempest-CreateVolumesFromImageTest-954412085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a05225dc-dba4-4bb3-bb9a-e4780dc4f36e {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:28 devstack sudo[105586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-2b8bde32-db2d-4e69-b8d3-9e079a444698 1073741824 Sep 16 20:37:28 devstack sudo[105586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:28 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-eabfff95-8d86-4d26-ba50-ba9491d76746 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d73f778-5d04-42fd-84ee-827028ed4d6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2c64f04-0698-4340-8f7e-62265a895a5a', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:28 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-eabfff95-8d86-4d26-ba50-ba9491d76746 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (585296a5-1b6e-4561-a245-8957a9fba790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:28 devstack sudo[105587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a05225dc-dba4-4bb3-bb9a-e4780dc4f36e Sep 16 20:37:28 devstack sudo[105587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:28 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-eabfff95-8d86-4d26-ba50-ba9491d76746 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Volume volume-b2c64f04-0698-4340-8f7e-62265a895a5a (b2c64f04-0698-4340-8f7e-62265a895a5a): created successfully Sep 16 20:37:28 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-eabfff95-8d86-4d26-ba50-ba9491d76746 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (585296a5-1b6e-4561-a245-8957a9fba790) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:28 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-eabfff95-8d86-4d26-ba50-ba9491d76746 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Flow 'volume_create_manager' (8df231ee-1482-4696-8f97-d89a00d7ec51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:37:28 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-eabfff95-8d86-4d26-ba50-ba9491d76746 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Created volume successfully. Sep 16 20:37:28 devstack sudo[105587]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:28 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ffeaf547-de0a-4e8a-830b-eeb426976860 tempest-CreateVolumesFromImageTest-954412085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-a05225dc-dba4-4bb3-bb9a-e4780dc4f36e" returned: 0 in 0.257s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:28 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-ffeaf547-de0a-4e8a-830b-eeb426976860 tempest-CreateVolumesFromImageTest-954412085 None] Lock "cinder-quobyte-a05225dc-dba4-4bb3-bb9a-e4780dc4f36e" released by "delete_volume" :: held 0.672s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:37:28 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-ffeaf547-de0a-4e8a-830b-eeb426976860 tempest-CreateVolumesFromImageTest-954412085 None] Created reservations ['ddba0b83-247c-4aeb-9327-789cb6a6f179', '2b80d3cf-c71c-415b-b640-03adaa585e2f', '50b16752-a108-494e-ab9a-7e6b8b1775cd', 'fa60f9a5-241b-4059-9004-f869ae92dc71'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:37:28 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-ffeaf547-de0a-4e8a-830b-eeb426976860 tempest-CreateVolumesFromImageTest-954412085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:37:28 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-ffeaf547-de0a-4e8a-830b-eeb426976860 tempest-CreateVolumesFromImageTest-954412085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:37:28 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-ffeaf547-de0a-4e8a-830b-eeb426976860 tempest-CreateVolumesFromImageTest-954412085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:37:28 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-ffeaf547-de0a-4e8a-830b-eeb426976860 tempest-CreateVolumesFromImageTest-954412085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:37:28 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-ffeaf547-de0a-4e8a-830b-eeb426976860 tempest-CreateVolumesFromImageTest-954412085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:37:28 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ffeaf547-de0a-4e8a-830b-eeb426976860 tempest-CreateVolumesFromImageTest-954412085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:28 devstack sudo[105595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:37:28 devstack sudo[105595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:28 devstack sudo[105586]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:28 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ba54fc4e-db0a-489b-bfd1-6fc5107a6b49 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-2b8bde32-db2d-4e69-b8d3-9e079a444698 1073741824" returned: 0 in 0.474s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:29 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ba54fc4e-db0a-489b-bfd1-6fc5107a6b49 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-2b8bde32-db2d-4e69-b8d3-9e079a444698 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:29 devstack sudo[105597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-2b8bde32-db2d-4e69-b8d3-9e079a444698 Sep 16 20:37:29 devstack sudo[105597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:29 devstack sudo[105595]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:29 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ffeaf547-de0a-4e8a-830b-eeb426976860 tempest-CreateVolumesFromImageTest-954412085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.250s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:29 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-ffeaf547-de0a-4e8a-830b-eeb426976860 tempest-CreateVolumesFromImageTest-954412085 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:37:29 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-ffeaf547-de0a-4e8a-830b-eeb426976860 tempest-CreateVolumesFromImageTest-954412085 None] Deleted volume successfully. Sep 16 20:37:29 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-ffeaf547-de0a-4e8a-830b-eeb426976860 tempest-CreateVolumesFromImageTest-954412085 None] Lock "cinder-a05225dc-dba4-4bb3-bb9a-e4780dc4f36e-delete_volume" released by "delete_volume" :: held 1.148s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:37:29 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-90f196db-82be-4255-9c78-ef4b777ba532 tempest-CreateVolumesFromImageTest-954412085 None] Acquiring lock "cinder-8703a730-3262-4585-a970-e8ddcd3eaf54-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:37:29 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-90f196db-82be-4255-9c78-ef4b777ba532 tempest-CreateVolumesFromImageTest-954412085 None] Lock "cinder-8703a730-3262-4585-a970-e8ddcd3eaf54-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:37:29 devstack sudo[105597]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:29 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ba54fc4e-db0a-489b-bfd1-6fc5107a6b49 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-2b8bde32-db2d-4e69-b8d3-9e079a444698" returned: 0 in 0.259s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:29 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-ba54fc4e-db0a-489b-bfd1-6fc5107a6b49 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] <== create_volume: return (778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:37:29 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-ba54fc4e-db0a-489b-bfd1-6fc5107a6b49 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.780s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:37:29 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-816616ea-072a-42f7-8a62-d07d79740c1e tempest-CreateVolumesFromSnapshotTest-1978168872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.477s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:37:29 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ba54fc4e-db0a-489b-bfd1-6fc5107a6b49 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (141a4cec-ff3e-4774-abc3-16a7f4ab63a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b8bde32-db2d-4e69-b8d3-9e079a444698', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:29 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ba54fc4e-db0a-489b-bfd1-6fc5107a6b49 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (261bbfca-66f9-452e-ab6f-7127e76a69e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:29 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-816616ea-072a-42f7-8a62-d07d79740c1e tempest-CreateVolumesFromSnapshotTest-1978168872 None] Creating offline snapshot 889e5b91-2bf0-4f43-9e3a-e55a5c189562 of volume ae09469c-8d27-4806-ac32-eac559656845 {{(pid=86188) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 20:37:29 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-90f196db-82be-4255-9c78-ef4b777ba532 tempest-CreateVolumesFromImageTest-954412085 None] Acquiring lock "cinder-quobyte-8703a730-3262-4585-a970-e8ddcd3eaf54" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:37:29 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[10d6f846-e182-4d9a-b45b-be9082f5051e]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:37:29 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-816616ea-072a-42f7-8a62-d07d79740c1e tempest-CreateVolumesFromSnapshotTest-1978168872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ae09469c-8d27-4806-ac32-eac559656845 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:29 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-90f196db-82be-4255-9c78-ef4b777ba532 tempest-CreateVolumesFromImageTest-954412085 None] Lock "cinder-quobyte-8703a730-3262-4585-a970-e8ddcd3eaf54" acquired by "delete_volume" :: waited 0.024s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:37:29 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-ba54fc4e-db0a-489b-bfd1-6fc5107a6b49 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Volume volume-2b8bde32-db2d-4e69-b8d3-9e079a444698 (2b8bde32-db2d-4e69-b8d3-9e079a444698): created successfully Sep 16 20:37:29 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ba54fc4e-db0a-489b-bfd1-6fc5107a6b49 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (261bbfca-66f9-452e-ab6f-7127e76a69e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:29 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ba54fc4e-db0a-489b-bfd1-6fc5107a6b49 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Flow 'volume_create_manager' (ab23222d-9c28-420a-85ba-85c82d4356bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:37:29 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[4366bff4-d83f-4435-a222-37c601eb5cd0]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:37:29 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-90f196db-82be-4255-9c78-ef4b777ba532 tempest-CreateVolumesFromImageTest-954412085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-8703a730-3262-4585-a970-e8ddcd3eaf54 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:29 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-ba54fc4e-db0a-489b-bfd1-6fc5107a6b49 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Created volume successfully. Sep 16 20:37:29 devstack sudo[105601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ae09469c-8d27-4806-ac32-eac559656845 Sep 16 20:37:29 devstack sudo[105601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:29 devstack sudo[105603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-8703a730-3262-4585-a970-e8ddcd3eaf54 Sep 16 20:37:29 devstack sudo[105603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:29 devstack sudo[105601]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:29 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-816616ea-072a-42f7-8a62-d07d79740c1e tempest-CreateVolumesFromSnapshotTest-1978168872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ae09469c-8d27-4806-ac32-eac559656845" returned: 0 in 0.360s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:29 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-816616ea-072a-42f7-8a62-d07d79740c1e tempest-CreateVolumesFromSnapshotTest-1978168872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ae09469c-8d27-4806-ac32-eac559656845,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ae09469c-8d27-4806-ac32-eac559656845.889e5b91-2bf0-4f43-9e3a-e55a5c189562 1G {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:29 devstack sudo[105612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ae09469c-8d27-4806-ac32-eac559656845,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ae09469c-8d27-4806-ac32-eac559656845.889e5b91-2bf0-4f43-9e3a-e55a5c189562 1G Sep 16 20:37:29 devstack sudo[105612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:29 devstack sudo[105603]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:29 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-90f196db-82be-4255-9c78-ef4b777ba532 tempest-CreateVolumesFromImageTest-954412085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-8703a730-3262-4585-a970-e8ddcd3eaf54" returned: 0 in 0.364s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:29 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-90f196db-82be-4255-9c78-ef4b777ba532 tempest-CreateVolumesFromImageTest-954412085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-8703a730-3262-4585-a970-e8ddcd3eaf54 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:29 devstack sudo[105614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-8703a730-3262-4585-a970-e8ddcd3eaf54 Sep 16 20:37:29 devstack sudo[105614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:30 devstack sudo[105614]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:30 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-90f196db-82be-4255-9c78-ef4b777ba532 tempest-CreateVolumesFromImageTest-954412085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-8703a730-3262-4585-a970-e8ddcd3eaf54" returned: 0 in 0.286s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:30 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-90f196db-82be-4255-9c78-ef4b777ba532 tempest-CreateVolumesFromImageTest-954412085 None] Lock "cinder-quobyte-8703a730-3262-4585-a970-e8ddcd3eaf54" released by "delete_volume" :: held 0.699s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:37:30 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-90f196db-82be-4255-9c78-ef4b777ba532 tempest-CreateVolumesFromImageTest-954412085 None] Created reservations ['7c10f29c-0bbf-489c-8516-9e458d323ff7', 'be61b51c-1ac3-4145-82ee-beace97419cc', 'aaf8b117-f583-472e-8c4e-ac2064cd7f69', '19cb708f-373b-418a-a282-ed789a0de1d6'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:37:30 devstack sudo[105612]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:30 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-816616ea-072a-42f7-8a62-d07d79740c1e tempest-CreateVolumesFromSnapshotTest-1978168872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ae09469c-8d27-4806-ac32-eac559656845,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ae09469c-8d27-4806-ac32-eac559656845.889e5b91-2bf0-4f43-9e3a-e55a5c189562 1G" returned: 0 in 0.421s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:30 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-816616ea-072a-42f7-8a62-d07d79740c1e tempest-CreateVolumesFromSnapshotTest-1978168872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae09469c-8d27-4806-ac32-eac559656845 -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ae09469c-8d27-4806-ac32-eac559656845.889e5b91-2bf0-4f43-9e3a-e55a5c189562 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:30 devstack sudo[105621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae09469c-8d27-4806-ac32-eac559656845 -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ae09469c-8d27-4806-ac32-eac559656845.889e5b91-2bf0-4f43-9e3a-e55a5c189562 Sep 16 20:37:30 devstack sudo[105621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:30 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-90f196db-82be-4255-9c78-ef4b777ba532 tempest-CreateVolumesFromImageTest-954412085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:37:30 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-90f196db-82be-4255-9c78-ef4b777ba532 tempest-CreateVolumesFromImageTest-954412085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:37:30 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-90f196db-82be-4255-9c78-ef4b777ba532 tempest-CreateVolumesFromImageTest-954412085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:37:30 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-90f196db-82be-4255-9c78-ef4b777ba532 tempest-CreateVolumesFromImageTest-954412085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:37:30 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-90f196db-82be-4255-9c78-ef4b777ba532 tempest-CreateVolumesFromImageTest-954412085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:37:30 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-90f196db-82be-4255-9c78-ef4b777ba532 tempest-CreateVolumesFromImageTest-954412085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:30 devstack sudo[105623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:37:30 devstack sudo[105623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:30 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-76865c0e-e9a6-4857-9831-bdad62619651 tempest-CreateVolumesFromImageTest-954412085 None] Acquiring lock "cinder-7af2fa70-c81c-40be-b02d-5623573883cb-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:37:30 devstack sudo[105621]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:30 devstack sudo[105623]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:30 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-90f196db-82be-4255-9c78-ef4b777ba532 tempest-CreateVolumesFromImageTest-954412085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.261s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:30 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-90f196db-82be-4255-9c78-ef4b777ba532 tempest-CreateVolumesFromImageTest-954412085 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:37:30 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-816616ea-072a-42f7-8a62-d07d79740c1e tempest-CreateVolumesFromSnapshotTest-1978168872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae09469c-8d27-4806-ac32-eac559656845 -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ae09469c-8d27-4806-ac32-eac559656845.889e5b91-2bf0-4f43-9e3a-e55a5c189562" returned: 0 in 0.326s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:30 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-76865c0e-e9a6-4857-9831-bdad62619651 tempest-CreateVolumesFromImageTest-954412085 None] Lock "cinder-7af2fa70-c81c-40be-b02d-5623573883cb-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:37:30 devstack cinder-volume[86188]: WARNING cinder.volume.drivers.remotefs [None req-816616ea-072a-42f7-8a62-d07d79740c1e tempest-CreateVolumesFromSnapshotTest-1978168872 None] /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ae09469c-8d27-4806-ac32-eac559656845.889e5b91-2bf0-4f43-9e3a-e55a5c189562 is being set with open permissions: ugo+rw Sep 16 20:37:30 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-816616ea-072a-42f7-8a62-d07d79740c1e tempest-CreateVolumesFromSnapshotTest-1978168872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ae09469c-8d27-4806-ac32-eac559656845.889e5b91-2bf0-4f43-9e3a-e55a5c189562 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:30 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-90f196db-82be-4255-9c78-ef4b777ba532 tempest-CreateVolumesFromImageTest-954412085 None] Deleted volume successfully. Sep 16 20:37:30 devstack sudo[105631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ae09469c-8d27-4806-ac32-eac559656845.889e5b91-2bf0-4f43-9e3a-e55a5c189562 Sep 16 20:37:30 devstack sudo[105631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:30 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-90f196db-82be-4255-9c78-ef4b777ba532 tempest-CreateVolumesFromImageTest-954412085 None] Lock "cinder-8703a730-3262-4585-a970-e8ddcd3eaf54-delete_volume" released by "delete_volume" :: held 1.241s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:37:30 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-76865c0e-e9a6-4857-9831-bdad62619651 tempest-CreateVolumesFromImageTest-954412085 None] Acquiring lock "cinder-quobyte-7af2fa70-c81c-40be-b02d-5623573883cb" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:37:30 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-76865c0e-e9a6-4857-9831-bdad62619651 tempest-CreateVolumesFromImageTest-954412085 None] Lock "cinder-quobyte-7af2fa70-c81c-40be-b02d-5623573883cb" acquired by "delete_volume" :: waited 0.015s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:37:30 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[8befe370-ad60-4b41-af53-f68eb4da3799]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:37:30 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-76865c0e-e9a6-4857-9831-bdad62619651 tempest-CreateVolumesFromImageTest-954412085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-7af2fa70-c81c-40be-b02d-5623573883cb {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:30 devstack sudo[105633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-7af2fa70-c81c-40be-b02d-5623573883cb Sep 16 20:37:30 devstack sudo[105633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:30 devstack sudo[105631]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:30 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-816616ea-072a-42f7-8a62-d07d79740c1e tempest-CreateVolumesFromSnapshotTest-1978168872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ae09469c-8d27-4806-ac32-eac559656845.889e5b91-2bf0-4f43-9e3a-e55a5c189562" returned: 0 in 0.272s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:30 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-816616ea-072a-42f7-8a62-d07d79740c1e tempest-CreateVolumesFromSnapshotTest-1978168872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ae09469c-8d27-4806-ac32-eac559656845.info {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:30 devstack sudo[105636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ae09469c-8d27-4806-ac32-eac559656845.info Sep 16 20:37:30 devstack sudo[105636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:30 devstack sudo[105633]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:30 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-76865c0e-e9a6-4857-9831-bdad62619651 tempest-CreateVolumesFromImageTest-954412085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-7af2fa70-c81c-40be-b02d-5623573883cb" returned: 0 in 0.383s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:30 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-76865c0e-e9a6-4857-9831-bdad62619651 tempest-CreateVolumesFromImageTest-954412085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-7af2fa70-c81c-40be-b02d-5623573883cb {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:30 devstack sudo[105641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-7af2fa70-c81c-40be-b02d-5623573883cb Sep 16 20:37:30 devstack sudo[105641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:31 devstack sudo[105636]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:31 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-816616ea-072a-42f7-8a62-d07d79740c1e tempest-CreateVolumesFromSnapshotTest-1978168872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ae09469c-8d27-4806-ac32-eac559656845.info" returned: 0 in 0.276s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:31 devstack cinder-volume[86188]: WARNING cinder.volume.drivers.remotefs [None req-816616ea-072a-42f7-8a62-d07d79740c1e tempest-CreateVolumesFromSnapshotTest-1978168872 None] /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ae09469c-8d27-4806-ac32-eac559656845.info is being set with open permissions: ugo+rw Sep 16 20:37:31 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-816616ea-072a-42f7-8a62-d07d79740c1e tempest-CreateVolumesFromSnapshotTest-1978168872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ae09469c-8d27-4806-ac32-eac559656845.info {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:31 devstack sudo[105644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ae09469c-8d27-4806-ac32-eac559656845.info Sep 16 20:37:31 devstack sudo[105644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:31 devstack sudo[105641]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:31 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-76865c0e-e9a6-4857-9831-bdad62619651 tempest-CreateVolumesFromImageTest-954412085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-7af2fa70-c81c-40be-b02d-5623573883cb" returned: 0 in 0.253s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:31 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-76865c0e-e9a6-4857-9831-bdad62619651 tempest-CreateVolumesFromImageTest-954412085 None] Lock "cinder-quobyte-7af2fa70-c81c-40be-b02d-5623573883cb" released by "delete_volume" :: held 0.683s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:37:31 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-76865c0e-e9a6-4857-9831-bdad62619651 tempest-CreateVolumesFromImageTest-954412085 None] Created reservations ['c2c03802-0a52-4671-a39d-690386906042', 'a3210ebf-0957-41fa-bc11-faa96746ff6e', '5685b603-205e-49dc-99ff-9f36e903719b', 'b9980729-7659-4c25-ac0d-5e9c835f05e3'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:37:31 devstack sudo[105644]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:31 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-816616ea-072a-42f7-8a62-d07d79740c1e tempest-CreateVolumesFromSnapshotTest-1978168872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ae09469c-8d27-4806-ac32-eac559656845.info" returned: 0 in 0.257s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:31 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-816616ea-072a-42f7-8a62-d07d79740c1e tempest-CreateVolumesFromSnapshotTest-1978168872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.034s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:37:31 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-49f2eab3-1e30-4431-8644-d841045c4054 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.150s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:37:31 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-49f2eab3-1e30-4431-8644-d841045c4054 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:37:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1067831635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=993cf03f-b9c8-4f53-b1ef-44ee249b13e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18ec43261b15442881c1519b383cf38f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:37:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:37:26Z,use_quota=True,user_id='5f83c4f77fe64640a8339e850d297e6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:37:31 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-49f2eab3-1e30-4431-8644-d841045c4054 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Creating volume 993cf03f-b9c8-4f53-b1ef-44ee249b13e4 {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:37:31 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-49f2eab3-1e30-4431-8644-d841045c4054 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:37:31 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-49f2eab3-1e30-4431-8644-d841045c4054 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:37:31 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-49f2eab3-1e30-4431-8644-d841045c4054 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:37:31 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-49f2eab3-1e30-4431-8644-d841045c4054 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:37:31 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-49f2eab3-1e30-4431-8644-d841045c4054 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:37:31 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-49f2eab3-1e30-4431-8644-d841045c4054 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:37:31 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-49f2eab3-1e30-4431-8644-d841045c4054 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:37:31 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-49f2eab3-1e30-4431-8644-d841045c4054 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-993cf03f-b9c8-4f53-b1ef-44ee249b13e4 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:31 devstack sudo[105648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-993cf03f-b9c8-4f53-b1ef-44ee249b13e4 1073741824 Sep 16 20:37:31 devstack sudo[105648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:31 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-816616ea-072a-42f7-8a62-d07d79740c1e tempest-CreateVolumesFromSnapshotTest-1978168872 None] Create snapshot completed successfully Sep 16 20:37:31 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-76865c0e-e9a6-4857-9831-bdad62619651 tempest-CreateVolumesFromImageTest-954412085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:37:31 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-76865c0e-e9a6-4857-9831-bdad62619651 tempest-CreateVolumesFromImageTest-954412085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:37:31 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-76865c0e-e9a6-4857-9831-bdad62619651 tempest-CreateVolumesFromImageTest-954412085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:37:31 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-76865c0e-e9a6-4857-9831-bdad62619651 tempest-CreateVolumesFromImageTest-954412085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:37:31 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-76865c0e-e9a6-4857-9831-bdad62619651 tempest-CreateVolumesFromImageTest-954412085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:37:31 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-76865c0e-e9a6-4857-9831-bdad62619651 tempest-CreateVolumesFromImageTest-954412085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:31 devstack sudo[105650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:37:31 devstack sudo[105650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:31 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-d0d1d287-3d21-46ab-81b1-2124ed983bb2 tempest-CreateVolumesFromImageTest-954412085 None] Acquiring lock "cinder-62d44ba1-4aa6-4652-935c-074516bdfda5-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:37:31 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-d0d1d287-3d21-46ab-81b1-2124ed983bb2 tempest-CreateVolumesFromImageTest-954412085 None] Lock "cinder-62d44ba1-4aa6-4652-935c-074516bdfda5-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:37:31 devstack sudo[105650]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:31 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-76865c0e-e9a6-4857-9831-bdad62619651 tempest-CreateVolumesFromImageTest-954412085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.258s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:31 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-76865c0e-e9a6-4857-9831-bdad62619651 tempest-CreateVolumesFromImageTest-954412085 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:37:31 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-76865c0e-e9a6-4857-9831-bdad62619651 tempest-CreateVolumesFromImageTest-954412085 None] Deleted volume successfully. Sep 16 20:37:31 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-76865c0e-e9a6-4857-9831-bdad62619651 tempest-CreateVolumesFromImageTest-954412085 None] Lock "cinder-7af2fa70-c81c-40be-b02d-5623573883cb-delete_volume" released by "delete_volume" :: held 1.230s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:37:31 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-d0d1d287-3d21-46ab-81b1-2124ed983bb2 tempest-CreateVolumesFromImageTest-954412085 None] Acquiring lock "cinder-quobyte-62d44ba1-4aa6-4652-935c-074516bdfda5" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:37:31 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-d0d1d287-3d21-46ab-81b1-2124ed983bb2 tempest-CreateVolumesFromImageTest-954412085 None] Lock "cinder-quobyte-62d44ba1-4aa6-4652-935c-074516bdfda5" acquired by "delete_volume" :: waited 0.013s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:37:31 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[12682ac4-9057-4ee4-92ef-15fa678eb2d3]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:37:31 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-d0d1d287-3d21-46ab-81b1-2124ed983bb2 tempest-CreateVolumesFromImageTest-954412085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-62d44ba1-4aa6-4652-935c-074516bdfda5 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:31 devstack sudo[105648]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:31 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-49f2eab3-1e30-4431-8644-d841045c4054 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-993cf03f-b9c8-4f53-b1ef-44ee249b13e4 1073741824" returned: 0 in 0.493s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:31 devstack sudo[105657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-62d44ba1-4aa6-4652-935c-074516bdfda5 Sep 16 20:37:31 devstack sudo[105657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:31 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-49f2eab3-1e30-4431-8644-d841045c4054 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-993cf03f-b9c8-4f53-b1ef-44ee249b13e4 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:31 devstack sudo[105659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-993cf03f-b9c8-4f53-b1ef-44ee249b13e4 Sep 16 20:37:31 devstack sudo[105659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:32 devstack sudo[105657]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:32 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-d0d1d287-3d21-46ab-81b1-2124ed983bb2 tempest-CreateVolumesFromImageTest-954412085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-62d44ba1-4aa6-4652-935c-074516bdfda5" returned: 0 in 0.403s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:32 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-d0d1d287-3d21-46ab-81b1-2124ed983bb2 tempest-CreateVolumesFromImageTest-954412085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-62d44ba1-4aa6-4652-935c-074516bdfda5 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:32 devstack sudo[105659]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:32 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-49f2eab3-1e30-4431-8644-d841045c4054 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-993cf03f-b9c8-4f53-b1ef-44ee249b13e4" returned: 0 in 0.287s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:32 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-49f2eab3-1e30-4431-8644-d841045c4054 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] <== create_volume: return (820ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:37:32 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-49f2eab3-1e30-4431-8644-d841045c4054 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.823s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:37:32 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-8b2e6376-47f4-40d6-976d-86759a41b00e tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.837s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:37:32 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-8b2e6376-47f4-40d6-976d-86759a41b00e tempest-CreateVolumesFromSourceVolumeTest-205230560 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:37:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1830245714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=251988dc-8fff-41e4-a83e-5c201f5205ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18ec43261b15442881c1519b383cf38f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:37:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:37:26Z,use_quota=True,user_id='5f83c4f77fe64640a8339e850d297e6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:37:32 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-8b2e6376-47f4-40d6-976d-86759a41b00e tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Creating volume 251988dc-8fff-41e4-a83e-5c201f5205ca {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:37:32 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-8b2e6376-47f4-40d6-976d-86759a41b00e tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:37:32 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-8b2e6376-47f4-40d6-976d-86759a41b00e tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:37:32 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-8b2e6376-47f4-40d6-976d-86759a41b00e tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:37:32 devstack sudo[105665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-62d44ba1-4aa6-4652-935c-074516bdfda5 Sep 16 20:37:32 devstack sudo[105665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:32 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-8b2e6376-47f4-40d6-976d-86759a41b00e tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:37:32 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-8b2e6376-47f4-40d6-976d-86759a41b00e tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:37:32 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-8b2e6376-47f4-40d6-976d-86759a41b00e tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:37:32 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-8b2e6376-47f4-40d6-976d-86759a41b00e tempest-CreateVolumesFromSourceVolumeTest-205230560 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:37:32 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-8b2e6376-47f4-40d6-976d-86759a41b00e tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-251988dc-8fff-41e4-a83e-5c201f5205ca 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:32 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-49f2eab3-1e30-4431-8644-d841045c4054 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3eddecef-f74c-41f4-bc11-b1d90e3e9d3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-993cf03f-b9c8-4f53-b1ef-44ee249b13e4', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:32 devstack sudo[105667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-251988dc-8fff-41e4-a83e-5c201f5205ca 1073741824 Sep 16 20:37:32 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-49f2eab3-1e30-4431-8644-d841045c4054 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25f82599-f582-4157-83d6-fc1ff77880e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:32 devstack sudo[105667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:32 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-49f2eab3-1e30-4431-8644-d841045c4054 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Volume volume-993cf03f-b9c8-4f53-b1ef-44ee249b13e4 (993cf03f-b9c8-4f53-b1ef-44ee249b13e4): created successfully Sep 16 20:37:32 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-49f2eab3-1e30-4431-8644-d841045c4054 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25f82599-f582-4157-83d6-fc1ff77880e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:32 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-49f2eab3-1e30-4431-8644-d841045c4054 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Flow 'volume_create_manager' (21003237-a0f7-4c5a-bf9e-e8be038dedcc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:37:32 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-49f2eab3-1e30-4431-8644-d841045c4054 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Created volume successfully. Sep 16 20:37:32 devstack sudo[105665]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:32 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-d0d1d287-3d21-46ab-81b1-2124ed983bb2 tempest-CreateVolumesFromImageTest-954412085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-62d44ba1-4aa6-4652-935c-074516bdfda5" returned: 0 in 0.288s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:32 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-d0d1d287-3d21-46ab-81b1-2124ed983bb2 tempest-CreateVolumesFromImageTest-954412085 None] Lock "cinder-quobyte-62d44ba1-4aa6-4652-935c-074516bdfda5" released by "delete_volume" :: held 0.739s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:37:32 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-5603e476-f5a2-4a3b-8340-dce0a72a846d tempest-CreateVolumesFromSnapshotTest-1978168872 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:37:32 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-5603e476-f5a2-4a3b-8340-dce0a72a846d tempest-CreateVolumesFromSnapshotTest-1978168872 None] Flow 'volume_create_manager' (6da5bc97-9ce1-4d64-9e08-1c1275a48ed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:37:32 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-5603e476-f5a2-4a3b-8340-dce0a72a846d tempest-CreateVolumesFromSnapshotTest-1978168872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f1be44b-1db6-4eb9-b6cd-cd91dcbbf6cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:32 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-5603e476-f5a2-4a3b-8340-dce0a72a846d tempest-CreateVolumesFromSnapshotTest-1978168872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f1be44b-1db6-4eb9-b6cd-cd91dcbbf6cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:37:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-731368375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99bbf506-f00a-4e50-80f0-3f53881a333f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be14f2fbcae04804b6ead8457652572b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:37:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:37:32Z,use_quota=True,user_id='0a42ae2d85c14e9c9bd48a96c1cc43ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:32 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-5603e476-f5a2-4a3b-8340-dce0a72a846d tempest-CreateVolumesFromSnapshotTest-1978168872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c824ad17-9f5a-4c12-8742-c98d5b283668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:32 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-5603e476-f5a2-4a3b-8340-dce0a72a846d tempest-CreateVolumesFromSnapshotTest-1978168872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c824ad17-9f5a-4c12-8742-c98d5b283668) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:32 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-5603e476-f5a2-4a3b-8340-dce0a72a846d tempest-CreateVolumesFromSnapshotTest-1978168872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdce5ec6-a02f-41d2-a945-b8e96ea954ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:32 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-5603e476-f5a2-4a3b-8340-dce0a72a846d tempest-CreateVolumesFromSnapshotTest-1978168872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdce5ec6-a02f-41d2-a945-b8e96ea954ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99bbf506-f00a-4e50-80f0-3f53881a333f', 'volume_name': 'volume-99bbf506-f00a-4e50-80f0-3f53881a333f', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:32 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-5603e476-f5a2-4a3b-8340-dce0a72a846d tempest-CreateVolumesFromSnapshotTest-1978168872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce78604e-4d4b-47cf-925f-2eb5d6382945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:32 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-5603e476-f5a2-4a3b-8340-dce0a72a846d tempest-CreateVolumesFromSnapshotTest-1978168872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce78604e-4d4b-47cf-925f-2eb5d6382945) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:32 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-5603e476-f5a2-4a3b-8340-dce0a72a846d tempest-CreateVolumesFromSnapshotTest-1978168872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0161bc02-acdd-4e7e-845c-115e4c9651ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:32 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-5603e476-f5a2-4a3b-8340-dce0a72a846d tempest-CreateVolumesFromSnapshotTest-1978168872 None] Volume 99bbf506-f00a-4e50-80f0-3f53881a333f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99bbf506-f00a-4e50-80f0-3f53881a333f', 'volume_size': 1} Sep 16 20:37:32 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-5603e476-f5a2-4a3b-8340-dce0a72a846d tempest-CreateVolumesFromSnapshotTest-1978168872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:37:32 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-d0d1d287-3d21-46ab-81b1-2124ed983bb2 tempest-CreateVolumesFromImageTest-954412085 None] Created reservations ['4ab064f4-a242-4a60-98de-dbd36335faee', '8bcccde6-f151-4a82-b7b1-4442b7ee584a', 'd2feca04-846d-40f7-b165-0470825b1e81', 'db46934c-c30c-4ada-8067-4cf17ae11c80'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:37:32 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-d0d1d287-3d21-46ab-81b1-2124ed983bb2 tempest-CreateVolumesFromImageTest-954412085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:37:32 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-d0d1d287-3d21-46ab-81b1-2124ed983bb2 tempest-CreateVolumesFromImageTest-954412085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:37:32 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-d0d1d287-3d21-46ab-81b1-2124ed983bb2 tempest-CreateVolumesFromImageTest-954412085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:37:32 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-d0d1d287-3d21-46ab-81b1-2124ed983bb2 tempest-CreateVolumesFromImageTest-954412085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:37:32 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-d0d1d287-3d21-46ab-81b1-2124ed983bb2 tempest-CreateVolumesFromImageTest-954412085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:37:32 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-d0d1d287-3d21-46ab-81b1-2124ed983bb2 tempest-CreateVolumesFromImageTest-954412085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:32 devstack sudo[105674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:37:32 devstack sudo[105674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:32 devstack sudo[105667]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:32 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-8b2e6376-47f4-40d6-976d-86759a41b00e tempest-CreateVolumesFromSourceVolumeTest-205230560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-251988dc-8fff-41e4-a83e-5c201f5205ca 1073741824" returned: 0 in 0.583s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:32 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-8b2e6376-47f4-40d6-976d-86759a41b00e tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-251988dc-8fff-41e4-a83e-5c201f5205ca {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:32 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-d214320e-0711-4b41-8c85-b04d33bf4ae5 tempest-CreateVolumesFromImageTest-954412085 None] Acquiring lock "cinder-40df3fd1-702e-4d27-aba9-3cbc21484afc-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:37:32 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-d214320e-0711-4b41-8c85-b04d33bf4ae5 tempest-CreateVolumesFromImageTest-954412085 None] Lock "cinder-40df3fd1-702e-4d27-aba9-3cbc21484afc-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:37:32 devstack sudo[105676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-251988dc-8fff-41e4-a83e-5c201f5205ca Sep 16 20:37:32 devstack sudo[105676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:32 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-d214320e-0711-4b41-8c85-b04d33bf4ae5 tempest-CreateVolumesFromImageTest-954412085 None] Acquiring lock "cinder-quobyte-40df3fd1-702e-4d27-aba9-3cbc21484afc" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:37:32 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-d214320e-0711-4b41-8c85-b04d33bf4ae5 tempest-CreateVolumesFromImageTest-954412085 None] Lock "cinder-quobyte-40df3fd1-702e-4d27-aba9-3cbc21484afc" acquired by "delete_volume" :: waited 0.019s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:37:32 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fdea5d0-f379-4061-b59d-7e0cf2e39ddb]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:37:32 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-d214320e-0711-4b41-8c85-b04d33bf4ae5 tempest-CreateVolumesFromImageTest-954412085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-40df3fd1-702e-4d27-aba9-3cbc21484afc {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:32 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f637dab-d445-4c03-8030-22597d5f3abb tempest-CreateVolumesFromSnapshotTest-1978168872 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:37:33 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-4f637dab-d445-4c03-8030-22597d5f3abb tempest-CreateVolumesFromSnapshotTest-1978168872 None] Flow 'volume_create_manager' (392f9073-98b1-476f-9215-580b47c8d7db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:37:33 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-4f637dab-d445-4c03-8030-22597d5f3abb tempest-CreateVolumesFromSnapshotTest-1978168872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6669d89d-53c0-4654-beb8-159c09d77a24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:33 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-4f637dab-d445-4c03-8030-22597d5f3abb tempest-CreateVolumesFromSnapshotTest-1978168872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6669d89d-53c0-4654-beb8-159c09d77a24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:37:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1197422581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ee02ef4-0fcd-4505-9f09-2fd3c172b112,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be14f2fbcae04804b6ead8457652572b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:37:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:37:33Z,use_quota=True,user_id='0a42ae2d85c14e9c9bd48a96c1cc43ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:33 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-4f637dab-d445-4c03-8030-22597d5f3abb tempest-CreateVolumesFromSnapshotTest-1978168872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42a25c00-386c-400c-aadb-452b7750ef8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:33 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-4f637dab-d445-4c03-8030-22597d5f3abb tempest-CreateVolumesFromSnapshotTest-1978168872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42a25c00-386c-400c-aadb-452b7750ef8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:33 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-4f637dab-d445-4c03-8030-22597d5f3abb tempest-CreateVolumesFromSnapshotTest-1978168872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (602e6d2c-aaa8-4b19-8d08-2bb0dd20fcda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:33 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-4f637dab-d445-4c03-8030-22597d5f3abb tempest-CreateVolumesFromSnapshotTest-1978168872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (602e6d2c-aaa8-4b19-8d08-2bb0dd20fcda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ee02ef4-0fcd-4505-9f09-2fd3c172b112', 'volume_name': 'volume-2ee02ef4-0fcd-4505-9f09-2fd3c172b112', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:33 devstack sudo[105676]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:33 devstack sudo[105678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-40df3fd1-702e-4d27-aba9-3cbc21484afc Sep 16 20:37:33 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-4f637dab-d445-4c03-8030-22597d5f3abb tempest-CreateVolumesFromSnapshotTest-1978168872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ad47e2f-a2bc-4167-be4a-3c3f109a5b64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:33 devstack sudo[105678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:33 devstack sudo[105674]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:33 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-4f637dab-d445-4c03-8030-22597d5f3abb tempest-CreateVolumesFromSnapshotTest-1978168872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ad47e2f-a2bc-4167-be4a-3c3f109a5b64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:33 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-4f637dab-d445-4c03-8030-22597d5f3abb tempest-CreateVolumesFromSnapshotTest-1978168872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (491b0752-b2b6-44b1-91d2-844e4d22b3ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:33 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-4f637dab-d445-4c03-8030-22597d5f3abb tempest-CreateVolumesFromSnapshotTest-1978168872 None] Volume 2ee02ef4-0fcd-4505-9f09-2fd3c172b112: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ee02ef4-0fcd-4505-9f09-2fd3c172b112', 'volume_size': 1} Sep 16 20:37:33 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-4f637dab-d445-4c03-8030-22597d5f3abb tempest-CreateVolumesFromSnapshotTest-1978168872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:37:33 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-8b2e6376-47f4-40d6-976d-86759a41b00e tempest-CreateVolumesFromSourceVolumeTest-205230560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-251988dc-8fff-41e4-a83e-5c201f5205ca" returned: 0 in 0.376s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:33 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-8b2e6376-47f4-40d6-976d-86759a41b00e tempest-CreateVolumesFromSourceVolumeTest-205230560 None] <== create_volume: return (1030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:37:33 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-8b2e6376-47f4-40d6-976d-86759a41b00e tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.034s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:37:33 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-ac7c6af6-fcc7-4597-a3eb-5be75895bf20 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.371s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:37:33 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-ac7c6af6-fcc7-4597-a3eb-5be75895bf20 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:37:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-299744537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a0cdb82-2d7a-4c36-94e6-6518dcbff139,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18ec43261b15442881c1519b383cf38f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:37:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:37:27Z,use_quota=True,user_id='5f83c4f77fe64640a8339e850d297e6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:37:33 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-ac7c6af6-fcc7-4597-a3eb-5be75895bf20 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Creating volume 3a0cdb82-2d7a-4c36-94e6-6518dcbff139 {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:37:33 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-ac7c6af6-fcc7-4597-a3eb-5be75895bf20 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:37:33 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-ac7c6af6-fcc7-4597-a3eb-5be75895bf20 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:37:33 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-ac7c6af6-fcc7-4597-a3eb-5be75895bf20 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:37:33 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-ac7c6af6-fcc7-4597-a3eb-5be75895bf20 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:37:33 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-ac7c6af6-fcc7-4597-a3eb-5be75895bf20 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:37:33 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-ac7c6af6-fcc7-4597-a3eb-5be75895bf20 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:37:33 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-ac7c6af6-fcc7-4597-a3eb-5be75895bf20 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:37:33 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ac7c6af6-fcc7-4597-a3eb-5be75895bf20 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-3a0cdb82-2d7a-4c36-94e6-6518dcbff139 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:33 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-d0d1d287-3d21-46ab-81b1-2124ed983bb2 tempest-CreateVolumesFromImageTest-954412085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.516s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:33 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-d0d1d287-3d21-46ab-81b1-2124ed983bb2 tempest-CreateVolumesFromImageTest-954412085 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:37:33 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-d0d1d287-3d21-46ab-81b1-2124ed983bb2 tempest-CreateVolumesFromImageTest-954412085 None] Deleted volume successfully. Sep 16 20:37:33 devstack sudo[105682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-3a0cdb82-2d7a-4c36-94e6-6518dcbff139 1073741824 Sep 16 20:37:33 devstack sudo[105682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:33 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-8b2e6376-47f4-40d6-976d-86759a41b00e tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eac5b7f5-498a-47cd-919b-320a048f6ea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-251988dc-8fff-41e4-a83e-5c201f5205ca', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:33 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-8b2e6376-47f4-40d6-976d-86759a41b00e tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36f80ede-2f7a-4563-b87a-77abe7228bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:33 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-d0d1d287-3d21-46ab-81b1-2124ed983bb2 tempest-CreateVolumesFromImageTest-954412085 None] Lock "cinder-62d44ba1-4aa6-4652-935c-074516bdfda5-delete_volume" released by "delete_volume" :: held 1.683s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:37:33 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-8b2e6376-47f4-40d6-976d-86759a41b00e tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Volume volume-251988dc-8fff-41e4-a83e-5c201f5205ca (251988dc-8fff-41e4-a83e-5c201f5205ca): created successfully Sep 16 20:37:33 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-8b2e6376-47f4-40d6-976d-86759a41b00e tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36f80ede-2f7a-4563-b87a-77abe7228bd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:33 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-8b2e6376-47f4-40d6-976d-86759a41b00e tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Flow 'volume_create_manager' (92c2ee6d-6d67-4d9b-94b5-d8848f990f36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:37:33 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-8b2e6376-47f4-40d6-976d-86759a41b00e tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Created volume successfully. Sep 16 20:37:33 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf5170dd-feaf-40e3-a636-cd57aa9459bf tempest-CreateVolumesFromSnapshotTest-1978168872 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:37:33 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-cf5170dd-feaf-40e3-a636-cd57aa9459bf tempest-CreateVolumesFromSnapshotTest-1978168872 None] Flow 'volume_create_manager' (199ca4fd-394c-44c3-a12f-eb6c7f329b6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:37:33 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-cf5170dd-feaf-40e3-a636-cd57aa9459bf tempest-CreateVolumesFromSnapshotTest-1978168872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d08bfe2-96f0-4327-81b7-7d48a538d9fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:33 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-cf5170dd-feaf-40e3-a636-cd57aa9459bf tempest-CreateVolumesFromSnapshotTest-1978168872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d08bfe2-96f0-4327-81b7-7d48a538d9fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:37:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-505572021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f20fca9-c7c1-4819-82bf-a4d86c00017e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be14f2fbcae04804b6ead8457652572b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:37:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:37:33Z,use_quota=True,user_id='0a42ae2d85c14e9c9bd48a96c1cc43ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:33 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-cf5170dd-feaf-40e3-a636-cd57aa9459bf tempest-CreateVolumesFromSnapshotTest-1978168872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0df7fedb-7b28-444f-b3b6-13f9b01990ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:33 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-cf5170dd-feaf-40e3-a636-cd57aa9459bf tempest-CreateVolumesFromSnapshotTest-1978168872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0df7fedb-7b28-444f-b3b6-13f9b01990ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:33 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-cf5170dd-feaf-40e3-a636-cd57aa9459bf tempest-CreateVolumesFromSnapshotTest-1978168872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8d20771-9eed-4371-8d3f-fde00ebd5b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:33 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-cf5170dd-feaf-40e3-a636-cd57aa9459bf tempest-CreateVolumesFromSnapshotTest-1978168872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8d20771-9eed-4371-8d3f-fde00ebd5b45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f20fca9-c7c1-4819-82bf-a4d86c00017e', 'volume_name': 'volume-7f20fca9-c7c1-4819-82bf-a4d86c00017e', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:33 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-cf5170dd-feaf-40e3-a636-cd57aa9459bf tempest-CreateVolumesFromSnapshotTest-1978168872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da9a1765-c5e4-44af-b2d8-e126cb9d1466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:33 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-cf5170dd-feaf-40e3-a636-cd57aa9459bf tempest-CreateVolumesFromSnapshotTest-1978168872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da9a1765-c5e4-44af-b2d8-e126cb9d1466) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:33 devstack sudo[105678]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:33 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-cf5170dd-feaf-40e3-a636-cd57aa9459bf tempest-CreateVolumesFromSnapshotTest-1978168872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92ea15f4-223a-4b8e-9ab6-24844553b2a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:33 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-cf5170dd-feaf-40e3-a636-cd57aa9459bf tempest-CreateVolumesFromSnapshotTest-1978168872 None] Volume 7f20fca9-c7c1-4819-82bf-a4d86c00017e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f20fca9-c7c1-4819-82bf-a4d86c00017e', 'volume_size': 1} Sep 16 20:37:33 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-cf5170dd-feaf-40e3-a636-cd57aa9459bf tempest-CreateVolumesFromSnapshotTest-1978168872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:37:33 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-d214320e-0711-4b41-8c85-b04d33bf4ae5 tempest-CreateVolumesFromImageTest-954412085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-40df3fd1-702e-4d27-aba9-3cbc21484afc" returned: 0 in 0.636s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:33 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-d214320e-0711-4b41-8c85-b04d33bf4ae5 tempest-CreateVolumesFromImageTest-954412085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-40df3fd1-702e-4d27-aba9-3cbc21484afc {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:33 devstack sudo[105690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-40df3fd1-702e-4d27-aba9-3cbc21484afc Sep 16 20:37:33 devstack sudo[105690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:33 devstack sudo[105682]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:33 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ac7c6af6-fcc7-4597-a3eb-5be75895bf20 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-3a0cdb82-2d7a-4c36-94e6-6518dcbff139 1073741824" returned: 0 in 0.640s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:33 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-109fcf96-1f65-49b0-a162-52021cee1218 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:37:33 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-109fcf96-1f65-49b0-a162-52021cee1218 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Flow 'volume_create_manager' (9920d875-09f3-4c31-8ee7-0b25809d1724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:37:33 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-109fcf96-1f65-49b0-a162-52021cee1218 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf0fa78a-f770-49bf-9cf0-adf12324375e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:33 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-109fcf96-1f65-49b0-a162-52021cee1218 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf0fa78a-f770-49bf-9cf0-adf12324375e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:37:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1808746942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=933d099e-ae13-4acc-bdde-3c490b6ebeeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be14f2fbcae04804b6ead8457652572b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:37:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:37:34Z,use_quota=True,user_id='0a42ae2d85c14e9c9bd48a96c1cc43ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:33 devstack sudo[105690]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:33 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-109fcf96-1f65-49b0-a162-52021cee1218 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e055e88-bc22-462e-8c90-2541e1e223e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:33 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-109fcf96-1f65-49b0-a162-52021cee1218 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e055e88-bc22-462e-8c90-2541e1e223e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:33 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-109fcf96-1f65-49b0-a162-52021cee1218 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0b8ff47-0e20-4603-b889-0decfbd77086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:33 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-109fcf96-1f65-49b0-a162-52021cee1218 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0b8ff47-0e20-4603-b889-0decfbd77086) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '933d099e-ae13-4acc-bdde-3c490b6ebeeb', 'volume_name': 'volume-933d099e-ae13-4acc-bdde-3c490b6ebeeb', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:33 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-109fcf96-1f65-49b0-a162-52021cee1218 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0842ebf2-4ccf-4665-8aae-3c62933f2103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:33 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-109fcf96-1f65-49b0-a162-52021cee1218 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0842ebf2-4ccf-4665-8aae-3c62933f2103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:33 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-109fcf96-1f65-49b0-a162-52021cee1218 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68ec9e78-7ff1-4713-9573-1ab85537b813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:33 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-109fcf96-1f65-49b0-a162-52021cee1218 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Volume 933d099e-ae13-4acc-bdde-3c490b6ebeeb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-933d099e-ae13-4acc-bdde-3c490b6ebeeb', 'volume_size': 1} Sep 16 20:37:33 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-109fcf96-1f65-49b0-a162-52021cee1218 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:37:33 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-d214320e-0711-4b41-8c85-b04d33bf4ae5 tempest-CreateVolumesFromImageTest-954412085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-40df3fd1-702e-4d27-aba9-3cbc21484afc" returned: 0 in 0.363s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:33 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ac7c6af6-fcc7-4597-a3eb-5be75895bf20 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-3a0cdb82-2d7a-4c36-94e6-6518dcbff139 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:34 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-d214320e-0711-4b41-8c85-b04d33bf4ae5 tempest-CreateVolumesFromImageTest-954412085 None] Lock "cinder-quobyte-40df3fd1-702e-4d27-aba9-3cbc21484afc" released by "delete_volume" :: held 1.094s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:37:34 devstack sudo[105694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-3a0cdb82-2d7a-4c36-94e6-6518dcbff139 Sep 16 20:37:34 devstack sudo[105694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:34 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-d214320e-0711-4b41-8c85-b04d33bf4ae5 tempest-CreateVolumesFromImageTest-954412085 None] Created reservations ['8dcf9a10-4158-4192-8bad-a08a9637864c', '3e67637c-d322-4f9b-acd7-ffce0bb942eb', 'ddac5e02-b836-42bf-9595-942f826e52ea', '5e01c8d1-1610-4021-b9be-370d460feaaa'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:37:34 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-d214320e-0711-4b41-8c85-b04d33bf4ae5 tempest-CreateVolumesFromImageTest-954412085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:37:34 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-d214320e-0711-4b41-8c85-b04d33bf4ae5 tempest-CreateVolumesFromImageTest-954412085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:37:34 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-d214320e-0711-4b41-8c85-b04d33bf4ae5 tempest-CreateVolumesFromImageTest-954412085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:37:34 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-d214320e-0711-4b41-8c85-b04d33bf4ae5 tempest-CreateVolumesFromImageTest-954412085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:37:34 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-d214320e-0711-4b41-8c85-b04d33bf4ae5 tempest-CreateVolumesFromImageTest-954412085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:37:34 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-d214320e-0711-4b41-8c85-b04d33bf4ae5 tempest-CreateVolumesFromImageTest-954412085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:34 devstack sudo[105696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:37:34 devstack sudo[105696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:34 devstack sudo[105694]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:34 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ac7c6af6-fcc7-4597-a3eb-5be75895bf20 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-3a0cdb82-2d7a-4c36-94e6-6518dcbff139" returned: 0 in 0.286s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:34 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-ac7c6af6-fcc7-4597-a3eb-5be75895bf20 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] <== create_volume: return (1090ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:37:34 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-ac7c6af6-fcc7-4597-a3eb-5be75895bf20 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.095s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:37:34 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-bc31dab2-0781-457f-8b20-7a53341df30f tempest-VolumeAndVolumeTypeFromImageTest-1520299628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.121s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:37:34 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-bc31dab2-0781-457f-8b20-7a53341df30f tempest-VolumeAndVolumeTypeFromImageTest-1520299628 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:37:25Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4042f07-d1ca-467b-b61b-75f07a29678d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a681c0c0c42478f8b526f392809d000',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:37:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:37:26Z,use_quota=True,user_id='f6938bea3fc34eedb99509653e73ab1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(65fef380-75d2-48da-bce5-c94117e39c19),volume_type_id=65fef380-75d2-48da-bce5-c94117e39c19)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:37:34 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-bc31dab2-0781-457f-8b20-7a53341df30f tempest-VolumeAndVolumeTypeFromImageTest-1520299628 None] Creating volume e4042f07-d1ca-467b-b61b-75f07a29678d {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:37:34 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-bc31dab2-0781-457f-8b20-7a53341df30f tempest-VolumeAndVolumeTypeFromImageTest-1520299628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:37:34 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-bc31dab2-0781-457f-8b20-7a53341df30f tempest-VolumeAndVolumeTypeFromImageTest-1520299628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:37:34 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-bc31dab2-0781-457f-8b20-7a53341df30f tempest-VolumeAndVolumeTypeFromImageTest-1520299628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:37:34 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-bc31dab2-0781-457f-8b20-7a53341df30f tempest-VolumeAndVolumeTypeFromImageTest-1520299628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:37:34 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-bc31dab2-0781-457f-8b20-7a53341df30f tempest-VolumeAndVolumeTypeFromImageTest-1520299628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:37:34 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-bc31dab2-0781-457f-8b20-7a53341df30f tempest-VolumeAndVolumeTypeFromImageTest-1520299628 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:37:34 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-bc31dab2-0781-457f-8b20-7a53341df30f tempest-VolumeAndVolumeTypeFromImageTest-1520299628 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:37:34 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-bc31dab2-0781-457f-8b20-7a53341df30f tempest-VolumeAndVolumeTypeFromImageTest-1520299628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e4042f07-d1ca-467b-b61b-75f07a29678d 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:34 devstack sudo[105699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e4042f07-d1ca-467b-b61b-75f07a29678d 1073741824 Sep 16 20:37:34 devstack sudo[105699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:34 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ac7c6af6-fcc7-4597-a3eb-5be75895bf20 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1d7a25f-7527-4c1f-a46f-08fcfbabc53c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a0cdb82-2d7a-4c36-94e6-6518dcbff139', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:34 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ac7c6af6-fcc7-4597-a3eb-5be75895bf20 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a40f4572-c565-4a41-a4cf-68c29d0d5a21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:34 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-5903259f-3bfa-4330-8f2f-0738f9fcc04a tempest-CreateVolumesFromSnapshotTest-1978168872 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:37:34 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-5903259f-3bfa-4330-8f2f-0738f9fcc04a tempest-CreateVolumesFromSnapshotTest-1978168872 None] Flow 'volume_create_manager' (ec595bc1-cb58-45fa-854f-deced9ac529f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:37:34 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-5903259f-3bfa-4330-8f2f-0738f9fcc04a tempest-CreateVolumesFromSnapshotTest-1978168872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b0f3801-0bf6-49cf-aa0a-715bfa54945a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:34 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-ac7c6af6-fcc7-4597-a3eb-5be75895bf20 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Volume volume-3a0cdb82-2d7a-4c36-94e6-6518dcbff139 (3a0cdb82-2d7a-4c36-94e6-6518dcbff139): created successfully Sep 16 20:37:34 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ac7c6af6-fcc7-4597-a3eb-5be75895bf20 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a40f4572-c565-4a41-a4cf-68c29d0d5a21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:34 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ac7c6af6-fcc7-4597-a3eb-5be75895bf20 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Flow 'volume_create_manager' (b7a2effd-b90d-4824-a81e-1fbdf2ab4b64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:37:34 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-5903259f-3bfa-4330-8f2f-0738f9fcc04a tempest-CreateVolumesFromSnapshotTest-1978168872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b0f3801-0bf6-49cf-aa0a-715bfa54945a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:37:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1259878666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3224fd64-50e9-42d5-b7ff-8aee24a706ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be14f2fbcae04804b6ead8457652572b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:37:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:37:34Z,use_quota=True,user_id='0a42ae2d85c14e9c9bd48a96c1cc43ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:34 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-5903259f-3bfa-4330-8f2f-0738f9fcc04a tempest-CreateVolumesFromSnapshotTest-1978168872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76bd0b88-9764-4f00-b72c-33c7ddee9cc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:34 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-5903259f-3bfa-4330-8f2f-0738f9fcc04a tempest-CreateVolumesFromSnapshotTest-1978168872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76bd0b88-9764-4f00-b72c-33c7ddee9cc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:34 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-5903259f-3bfa-4330-8f2f-0738f9fcc04a tempest-CreateVolumesFromSnapshotTest-1978168872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2027feb-7e31-435e-a673-6d812c048660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:34 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-5903259f-3bfa-4330-8f2f-0738f9fcc04a tempest-CreateVolumesFromSnapshotTest-1978168872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2027feb-7e31-435e-a673-6d812c048660) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3224fd64-50e9-42d5-b7ff-8aee24a706ca', 'volume_name': 'volume-3224fd64-50e9-42d5-b7ff-8aee24a706ca', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:34 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-5903259f-3bfa-4330-8f2f-0738f9fcc04a tempest-CreateVolumesFromSnapshotTest-1978168872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0836677-5e30-4970-ad70-94f744ebec3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:34 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-5903259f-3bfa-4330-8f2f-0738f9fcc04a tempest-CreateVolumesFromSnapshotTest-1978168872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0836677-5e30-4970-ad70-94f744ebec3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:34 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-5903259f-3bfa-4330-8f2f-0738f9fcc04a tempest-CreateVolumesFromSnapshotTest-1978168872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dd857ec-90b6-47fa-b132-74a772a3d1bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:34 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-5903259f-3bfa-4330-8f2f-0738f9fcc04a tempest-CreateVolumesFromSnapshotTest-1978168872 None] Volume 3224fd64-50e9-42d5-b7ff-8aee24a706ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3224fd64-50e9-42d5-b7ff-8aee24a706ca', 'volume_size': 1} Sep 16 20:37:34 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-5903259f-3bfa-4330-8f2f-0738f9fcc04a tempest-CreateVolumesFromSnapshotTest-1978168872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:37:34 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-ac7c6af6-fcc7-4597-a3eb-5be75895bf20 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Created volume successfully. Sep 16 20:37:34 devstack sudo[105696]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:34 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-d214320e-0711-4b41-8c85-b04d33bf4ae5 tempest-CreateVolumesFromImageTest-954412085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.328s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:34 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-d214320e-0711-4b41-8c85-b04d33bf4ae5 tempest-CreateVolumesFromImageTest-954412085 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:37:34 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-d214320e-0711-4b41-8c85-b04d33bf4ae5 tempest-CreateVolumesFromImageTest-954412085 None] Deleted volume successfully. Sep 16 20:37:34 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-d214320e-0711-4b41-8c85-b04d33bf4ae5 tempest-CreateVolumesFromImageTest-954412085 None] Lock "cinder-40df3fd1-702e-4d27-aba9-3cbc21484afc-delete_volume" released by "delete_volume" :: held 1.687s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:37:34 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-f1b94815-d5ce-46df-854e-41ad97b02f8b tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Acquiring lock "cinder-3a0cdb82-2d7a-4c36-94e6-6518dcbff139-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:37:34 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-f1b94815-d5ce-46df-854e-41ad97b02f8b tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Lock "cinder-3a0cdb82-2d7a-4c36-94e6-6518dcbff139-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:37:34 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-f1b94815-d5ce-46df-854e-41ad97b02f8b tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Acquiring lock "cinder-quobyte-3a0cdb82-2d7a-4c36-94e6-6518dcbff139" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:37:34 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-f1b94815-d5ce-46df-854e-41ad97b02f8b tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Lock "cinder-quobyte-3a0cdb82-2d7a-4c36-94e6-6518dcbff139" acquired by "delete_volume" :: waited 0.017s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:37:34 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[b27a6b52-57d4-4ffa-8b60-538c64f8be4c]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:37:34 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f1b94815-d5ce-46df-854e-41ad97b02f8b tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-3a0cdb82-2d7a-4c36-94e6-6518dcbff139 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:34 devstack sudo[105705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-3a0cdb82-2d7a-4c36-94e6-6518dcbff139 Sep 16 20:37:34 devstack sudo[105705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:34 devstack sudo[105699]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:34 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-bc31dab2-0781-457f-8b20-7a53341df30f tempest-VolumeAndVolumeTypeFromImageTest-1520299628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e4042f07-d1ca-467b-b61b-75f07a29678d 1073741824" returned: 0 in 0.513s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:34 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-bc31dab2-0781-457f-8b20-7a53341df30f tempest-VolumeAndVolumeTypeFromImageTest-1520299628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e4042f07-d1ca-467b-b61b-75f07a29678d {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:34 devstack sudo[105707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e4042f07-d1ca-467b-b61b-75f07a29678d Sep 16 20:37:34 devstack sudo[105707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:35 devstack sudo[105705]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:35 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f1b94815-d5ce-46df-854e-41ad97b02f8b tempest-CreateVolumesFromSourceVolumeTest-205230560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-3a0cdb82-2d7a-4c36-94e6-6518dcbff139" returned: 0 in 0.382s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:35 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f1b94815-d5ce-46df-854e-41ad97b02f8b tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-3a0cdb82-2d7a-4c36-94e6-6518dcbff139 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:35 devstack sudo[105713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-3a0cdb82-2d7a-4c36-94e6-6518dcbff139 Sep 16 20:37:35 devstack sudo[105713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:35 devstack sudo[105707]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:35 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-bc31dab2-0781-457f-8b20-7a53341df30f tempest-VolumeAndVolumeTypeFromImageTest-1520299628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e4042f07-d1ca-467b-b61b-75f07a29678d" returned: 0 in 0.255s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:35 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-bc31dab2-0781-457f-8b20-7a53341df30f tempest-VolumeAndVolumeTypeFromImageTest-1520299628 None] <== create_volume: return (811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:37:35 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-bc31dab2-0781-457f-8b20-7a53341df30f tempest-VolumeAndVolumeTypeFromImageTest-1520299628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.814s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:37:35 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-5603e476-f5a2-4a3b-8340-dce0a72a846d tempest-CreateVolumesFromSnapshotTest-1978168872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.500s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:37:35 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-5603e476-f5a2-4a3b-8340-dce0a72a846d tempest-CreateVolumesFromSnapshotTest-1978168872 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:37:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-731368375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99bbf506-f00a-4e50-80f0-3f53881a333f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be14f2fbcae04804b6ead8457652572b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:37:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:37:32Z,use_quota=True,user_id='0a42ae2d85c14e9c9bd48a96c1cc43ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:37:35 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-5603e476-f5a2-4a3b-8340-dce0a72a846d tempest-CreateVolumesFromSnapshotTest-1978168872 None] Creating volume 99bbf506-f00a-4e50-80f0-3f53881a333f {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:37:35 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-5603e476-f5a2-4a3b-8340-dce0a72a846d tempest-CreateVolumesFromSnapshotTest-1978168872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:37:35 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-5603e476-f5a2-4a3b-8340-dce0a72a846d tempest-CreateVolumesFromSnapshotTest-1978168872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:37:35 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-5603e476-f5a2-4a3b-8340-dce0a72a846d tempest-CreateVolumesFromSnapshotTest-1978168872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:37:35 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-5603e476-f5a2-4a3b-8340-dce0a72a846d tempest-CreateVolumesFromSnapshotTest-1978168872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:37:35 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-5603e476-f5a2-4a3b-8340-dce0a72a846d tempest-CreateVolumesFromSnapshotTest-1978168872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:37:35 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-5603e476-f5a2-4a3b-8340-dce0a72a846d tempest-CreateVolumesFromSnapshotTest-1978168872 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:37:35 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-5603e476-f5a2-4a3b-8340-dce0a72a846d tempest-CreateVolumesFromSnapshotTest-1978168872 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:37:35 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-5603e476-f5a2-4a3b-8340-dce0a72a846d tempest-CreateVolumesFromSnapshotTest-1978168872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-99bbf506-f00a-4e50-80f0-3f53881a333f 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:35 devstack sudo[105715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-99bbf506-f00a-4e50-80f0-3f53881a333f 1073741824 Sep 16 20:37:35 devstack sudo[105715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:35 devstack cinder-volume[86188]: DEBUG cinder.volume.volume_utils [None req-bc31dab2-0781-457f-8b20-7a53341df30f tempest-VolumeAndVolumeTypeFromImageTest-1520299628 None] Attempting download of 09d26537-bd37-46c4-9143-6bbd2b644e90 ((None, [{'url': 'file:///opt/stack/data/glance/images/09d26537-bd37-46c4-9143-6bbd2b644e90', 'metadata': {}}])) to volume e4042f07-d1ca-467b-b61b-75f07a29678d. {{(pid=86188) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 16 20:37:35 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[dce5c938-b948-4f27-b87f-119b15a76d0c]: (4, 'raw') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:37:35 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-bc31dab2-0781-457f-8b20-7a53341df30f tempest-VolumeAndVolumeTypeFromImageTest-1520299628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_09d26537-bd37-46c4-9143-6bbd2b644e90_o4l_fumg {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:35 devstack sudo[105717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_09d26537-bd37-46c4-9143-6bbd2b644e90_o4l_fumg Sep 16 20:37:35 devstack sudo[105717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:35 devstack sudo[105713]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:35 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f1b94815-d5ce-46df-854e-41ad97b02f8b tempest-CreateVolumesFromSourceVolumeTest-205230560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-3a0cdb82-2d7a-4c36-94e6-6518dcbff139" returned: 0 in 0.328s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:35 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-f1b94815-d5ce-46df-854e-41ad97b02f8b tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Lock "cinder-quobyte-3a0cdb82-2d7a-4c36-94e6-6518dcbff139" released by "delete_volume" :: held 0.758s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:37:35 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-f1b94815-d5ce-46df-854e-41ad97b02f8b tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Created reservations ['4f69a650-2ef9-4764-bac3-6119fff9204f', '01feced2-f52d-4263-aa51-6c5d12d916d8', 'f1f8d4f3-bc64-49ac-9cdf-aef266ea9671', '7924e737-c6d2-4a3a-85fd-edc8011c8d16'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:37:35 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-f1b94815-d5ce-46df-854e-41ad97b02f8b tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:37:35 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-f1b94815-d5ce-46df-854e-41ad97b02f8b tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:37:35 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-f1b94815-d5ce-46df-854e-41ad97b02f8b tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:37:35 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-f1b94815-d5ce-46df-854e-41ad97b02f8b tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:37:35 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-f1b94815-d5ce-46df-854e-41ad97b02f8b tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:37:35 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f1b94815-d5ce-46df-854e-41ad97b02f8b tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:35 devstack sudo[105724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:37:35 devstack sudo[105724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:35 devstack sudo[105717]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:35 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-bc31dab2-0781-457f-8b20-7a53341df30f tempest-VolumeAndVolumeTypeFromImageTest-1520299628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_09d26537-bd37-46c4-9143-6bbd2b644e90_o4l_fumg" returned: 0 in 0.416s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:35 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-bc31dab2-0781-457f-8b20-7a53341df30f tempest-VolumeAndVolumeTypeFromImageTest-1520299628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_09d26537-bd37-46c4-9143-6bbd2b644e90_o4l_fumg {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:35 devstack sudo[105715]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:35 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-5603e476-f5a2-4a3b-8340-dce0a72a846d tempest-CreateVolumesFromSnapshotTest-1978168872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-99bbf506-f00a-4e50-80f0-3f53881a333f 1073741824" returned: 0 in 0.535s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:35 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-5603e476-f5a2-4a3b-8340-dce0a72a846d tempest-CreateVolumesFromSnapshotTest-1978168872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-99bbf506-f00a-4e50-80f0-3f53881a333f {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:35 devstack sudo[105728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_09d26537-bd37-46c4-9143-6bbd2b644e90_o4l_fumg Sep 16 20:37:35 devstack sudo[105728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:35 devstack sudo[105729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-99bbf506-f00a-4e50-80f0-3f53881a333f Sep 16 20:37:35 devstack sudo[105729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:35 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-62ed7079-3fca-4f15-a920-c71df4942f76 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Acquiring lock "cinder-251988dc-8fff-41e4-a83e-5c201f5205ca-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:37:35 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-62ed7079-3fca-4f15-a920-c71df4942f76 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Lock "cinder-251988dc-8fff-41e4-a83e-5c201f5205ca-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:37:35 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-62ed7079-3fca-4f15-a920-c71df4942f76 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Acquiring lock "cinder-quobyte-251988dc-8fff-41e4-a83e-5c201f5205ca" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:37:35 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-62ed7079-3fca-4f15-a920-c71df4942f76 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Lock "cinder-quobyte-251988dc-8fff-41e4-a83e-5c201f5205ca" acquired by "delete_volume" :: waited 0.025s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:37:35 devstack sudo[105724]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:35 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f1b94815-d5ce-46df-854e-41ad97b02f8b tempest-CreateVolumesFromSourceVolumeTest-205230560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.396s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:35 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-f1b94815-d5ce-46df-854e-41ad97b02f8b tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:37:35 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[27846735-79a7-4f3f-afdc-ddf831ab9d91]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:37:35 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-62ed7079-3fca-4f15-a920-c71df4942f76 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-251988dc-8fff-41e4-a83e-5c201f5205ca {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:35 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-f1b94815-d5ce-46df-854e-41ad97b02f8b tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Deleted volume successfully. Sep 16 20:37:36 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-f1b94815-d5ce-46df-854e-41ad97b02f8b tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Lock "cinder-3a0cdb82-2d7a-4c36-94e6-6518dcbff139-delete_volume" released by "delete_volume" :: held 1.421s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:37:36 devstack sudo[105728]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:36 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-bc31dab2-0781-457f-8b20-7a53341df30f tempest-VolumeAndVolumeTypeFromImageTest-1520299628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_09d26537-bd37-46c4-9143-6bbd2b644e90_o4l_fumg" returned: 1 in 0.418s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:36 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-bc31dab2-0781-457f-8b20-7a53341df30f tempest-VolumeAndVolumeTypeFromImageTest-1520299628 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_09d26537-bd37-46c4-9143-6bbd2b644e90_o4l_fumg' failed. Not Retrying. {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 16 20:37:36 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb6dc0dd-d4c4-4183-998a-23bdd94912ec]: (4, 'raw') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:37:36 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-bc31dab2-0781-457f-8b20-7a53341df30f tempest-VolumeAndVolumeTypeFromImageTest-1520299628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_09d26537-bd37-46c4-9143-6bbd2b644e90_eusp__medevstack@QuobyteHD {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:36 devstack sudo[105729]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:36 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-5603e476-f5a2-4a3b-8340-dce0a72a846d tempest-CreateVolumesFromSnapshotTest-1978168872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-99bbf506-f00a-4e50-80f0-3f53881a333f" returned: 0 in 0.366s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:36 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-5603e476-f5a2-4a3b-8340-dce0a72a846d tempest-CreateVolumesFromSnapshotTest-1978168872 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:37:36 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-5603e476-f5a2-4a3b-8340-dce0a72a846d tempest-CreateVolumesFromSnapshotTest-1978168872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:37:36 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-4f637dab-d445-4c03-8030-22597d5f3abb tempest-CreateVolumesFromSnapshotTest-1978168872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.911s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:37:36 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-4f637dab-d445-4c03-8030-22597d5f3abb tempest-CreateVolumesFromSnapshotTest-1978168872 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:37:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1197422581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ee02ef4-0fcd-4505-9f09-2fd3c172b112,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be14f2fbcae04804b6ead8457652572b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:37:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:37:33Z,use_quota=True,user_id='0a42ae2d85c14e9c9bd48a96c1cc43ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:37:36 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-4f637dab-d445-4c03-8030-22597d5f3abb tempest-CreateVolumesFromSnapshotTest-1978168872 None] Creating volume 2ee02ef4-0fcd-4505-9f09-2fd3c172b112 {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:37:36 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-4f637dab-d445-4c03-8030-22597d5f3abb tempest-CreateVolumesFromSnapshotTest-1978168872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:37:36 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-4f637dab-d445-4c03-8030-22597d5f3abb tempest-CreateVolumesFromSnapshotTest-1978168872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:37:36 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-4f637dab-d445-4c03-8030-22597d5f3abb tempest-CreateVolumesFromSnapshotTest-1978168872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:37:36 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-4f637dab-d445-4c03-8030-22597d5f3abb tempest-CreateVolumesFromSnapshotTest-1978168872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:37:36 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-4f637dab-d445-4c03-8030-22597d5f3abb tempest-CreateVolumesFromSnapshotTest-1978168872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:37:36 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-4f637dab-d445-4c03-8030-22597d5f3abb tempest-CreateVolumesFromSnapshotTest-1978168872 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:37:36 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-4f637dab-d445-4c03-8030-22597d5f3abb tempest-CreateVolumesFromSnapshotTest-1978168872 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:37:36 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-4f637dab-d445-4c03-8030-22597d5f3abb tempest-CreateVolumesFromSnapshotTest-1978168872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-2ee02ef4-0fcd-4505-9f09-2fd3c172b112 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:36 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-5603e476-f5a2-4a3b-8340-dce0a72a846d tempest-CreateVolumesFromSnapshotTest-1978168872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0161bc02-acdd-4e7e-845c-115e4c9651ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99bbf506-f00a-4e50-80f0-3f53881a333f', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:36 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-5603e476-f5a2-4a3b-8340-dce0a72a846d tempest-CreateVolumesFromSnapshotTest-1978168872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (789bd401-5241-4e87-99b3-1c5852a33b3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:36 devstack sudo[105733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-251988dc-8fff-41e4-a83e-5c201f5205ca Sep 16 20:37:36 devstack sudo[105733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:36 devstack sudo[105738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-2ee02ef4-0fcd-4505-9f09-2fd3c172b112 1073741824 Sep 16 20:37:36 devstack sudo[105738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:36 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-5603e476-f5a2-4a3b-8340-dce0a72a846d tempest-CreateVolumesFromSnapshotTest-1978168872 None] Volume volume-99bbf506-f00a-4e50-80f0-3f53881a333f (99bbf506-f00a-4e50-80f0-3f53881a333f): created successfully Sep 16 20:37:36 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-5603e476-f5a2-4a3b-8340-dce0a72a846d tempest-CreateVolumesFromSnapshotTest-1978168872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (789bd401-5241-4e87-99b3-1c5852a33b3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:36 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-5603e476-f5a2-4a3b-8340-dce0a72a846d tempest-CreateVolumesFromSnapshotTest-1978168872 None] Flow 'volume_create_manager' (6da5bc97-9ce1-4d64-9e08-1c1275a48ed7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:37:36 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-5603e476-f5a2-4a3b-8340-dce0a72a846d tempest-CreateVolumesFromSnapshotTest-1978168872 None] Created volume successfully. Sep 16 20:37:36 devstack sudo[105737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_09d26537-bd37-46c4-9143-6bbd2b644e90_eusp__medevstack@QuobyteHD Sep 16 20:37:36 devstack sudo[105737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:36 devstack sudo[105737]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:36 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-bc31dab2-0781-457f-8b20-7a53341df30f tempest-VolumeAndVolumeTypeFromImageTest-1520299628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_09d26537-bd37-46c4-9143-6bbd2b644e90_eusp__medevstack@QuobyteHD" returned: 0 in 0.471s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:36 devstack sudo[105733]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:36 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-bc31dab2-0781-457f-8b20-7a53341df30f tempest-VolumeAndVolumeTypeFromImageTest-1520299628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_09d26537-bd37-46c4-9143-6bbd2b644e90_eusp__medevstack@QuobyteHD {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:36 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-62ed7079-3fca-4f15-a920-c71df4942f76 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-251988dc-8fff-41e4-a83e-5c201f5205ca" returned: 0 in 0.605s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:36 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-62ed7079-3fca-4f15-a920-c71df4942f76 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-251988dc-8fff-41e4-a83e-5c201f5205ca {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:36 devstack sudo[105753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-251988dc-8fff-41e4-a83e-5c201f5205ca Sep 16 20:37:36 devstack sudo[105753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:36 devstack sudo[105751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_09d26537-bd37-46c4-9143-6bbd2b644e90_eusp__medevstack@QuobyteHD Sep 16 20:37:36 devstack sudo[105751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:36 devstack sudo[105738]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:36 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-4f637dab-d445-4c03-8030-22597d5f3abb tempest-CreateVolumesFromSnapshotTest-1978168872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-2ee02ef4-0fcd-4505-9f09-2fd3c172b112 1073741824" returned: 0 in 0.589s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:36 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-4f637dab-d445-4c03-8030-22597d5f3abb tempest-CreateVolumesFromSnapshotTest-1978168872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-2ee02ef4-0fcd-4505-9f09-2fd3c172b112 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:36 devstack sudo[105756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-2ee02ef4-0fcd-4505-9f09-2fd3c172b112 Sep 16 20:37:36 devstack sudo[105756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:36 devstack sudo[105753]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:36 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-62ed7079-3fca-4f15-a920-c71df4942f76 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-251988dc-8fff-41e4-a83e-5c201f5205ca" returned: 0 in 0.310s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:36 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-62ed7079-3fca-4f15-a920-c71df4942f76 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Lock "cinder-quobyte-251988dc-8fff-41e4-a83e-5c201f5205ca" released by "delete_volume" :: held 0.998s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:37:36 devstack sudo[105751]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:36 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-bc31dab2-0781-457f-8b20-7a53341df30f tempest-VolumeAndVolumeTypeFromImageTest-1520299628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_09d26537-bd37-46c4-9143-6bbd2b644e90_eusp__medevstack@QuobyteHD" returned: 1 in 0.426s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:36 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-bc31dab2-0781-457f-8b20-7a53341df30f tempest-VolumeAndVolumeTypeFromImageTest-1520299628 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_09d26537-bd37-46c4-9143-6bbd2b644e90_eusp__medevstack@QuobyteHD' failed. Not Retrying. {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 16 20:37:36 devstack cinder-volume[86188]: DEBUG cinder.image.image_utils [None req-bc31dab2-0781-457f-8b20-7a53341df30f tempest-VolumeAndVolumeTypeFromImageTest-1520299628 None] 09d26537-bd37-46c4-9143-6bbd2b644e90 was raw, converting to qcow2 {{(pid=86188) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 16 20:37:36 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-bc31dab2-0781-457f-8b20-7a53341df30f tempest-VolumeAndVolumeTypeFromImageTest-1520299628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_09d26537-bd37-46c4-9143-6bbd2b644e90_eusp__medevstack@QuobyteHD /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e4042f07-d1ca-467b-b61b-75f07a29678d {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:36 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-62ed7079-3fca-4f15-a920-c71df4942f76 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Created reservations ['43132f55-1abd-4185-8da2-eed344fa7027', 'c9800091-b404-48cf-a9e7-1102449daffe', '07b5d164-eb41-4088-97b4-511b9f3b1ba9', 'b35fc4ec-4e03-4d4b-9879-79cbea10ea62'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:37:36 devstack sudo[105762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_09d26537-bd37-46c4-9143-6bbd2b644e90_eusp__medevstack@QuobyteHD /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e4042f07-d1ca-467b-b61b-75f07a29678d Sep 16 20:37:37 devstack sudo[105762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:37 devstack sudo[105756]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:37 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-62ed7079-3fca-4f15-a920-c71df4942f76 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:37:37 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-62ed7079-3fca-4f15-a920-c71df4942f76 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:37:37 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-62ed7079-3fca-4f15-a920-c71df4942f76 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:37:37 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-62ed7079-3fca-4f15-a920-c71df4942f76 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:37:37 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-62ed7079-3fca-4f15-a920-c71df4942f76 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:37:37 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-62ed7079-3fca-4f15-a920-c71df4942f76 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:37 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-4f637dab-d445-4c03-8030-22597d5f3abb tempest-CreateVolumesFromSnapshotTest-1978168872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-2ee02ef4-0fcd-4505-9f09-2fd3c172b112" returned: 0 in 0.345s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:37 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-4f637dab-d445-4c03-8030-22597d5f3abb tempest-CreateVolumesFromSnapshotTest-1978168872 None] <== create_volume: return (1010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:37:37 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-4f637dab-d445-4c03-8030-22597d5f3abb tempest-CreateVolumesFromSnapshotTest-1978168872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.013s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:37:37 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-cf5170dd-feaf-40e3-a636-cd57aa9459bf tempest-CreateVolumesFromSnapshotTest-1978168872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.499s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:37:37 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-cf5170dd-feaf-40e3-a636-cd57aa9459bf tempest-CreateVolumesFromSnapshotTest-1978168872 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:37:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-505572021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f20fca9-c7c1-4819-82bf-a4d86c00017e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be14f2fbcae04804b6ead8457652572b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:37:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:37:33Z,use_quota=True,user_id='0a42ae2d85c14e9c9bd48a96c1cc43ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:37:37 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-cf5170dd-feaf-40e3-a636-cd57aa9459bf tempest-CreateVolumesFromSnapshotTest-1978168872 None] Creating volume 7f20fca9-c7c1-4819-82bf-a4d86c00017e {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:37:37 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-cf5170dd-feaf-40e3-a636-cd57aa9459bf tempest-CreateVolumesFromSnapshotTest-1978168872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:37:37 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-cf5170dd-feaf-40e3-a636-cd57aa9459bf tempest-CreateVolumesFromSnapshotTest-1978168872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:37:37 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-cf5170dd-feaf-40e3-a636-cd57aa9459bf tempest-CreateVolumesFromSnapshotTest-1978168872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:37:37 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-cf5170dd-feaf-40e3-a636-cd57aa9459bf tempest-CreateVolumesFromSnapshotTest-1978168872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:37:37 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-cf5170dd-feaf-40e3-a636-cd57aa9459bf tempest-CreateVolumesFromSnapshotTest-1978168872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:37:37 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-cf5170dd-feaf-40e3-a636-cd57aa9459bf tempest-CreateVolumesFromSnapshotTest-1978168872 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:37:37 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-cf5170dd-feaf-40e3-a636-cd57aa9459bf tempest-CreateVolumesFromSnapshotTest-1978168872 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:37:37 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-cf5170dd-feaf-40e3-a636-cd57aa9459bf tempest-CreateVolumesFromSnapshotTest-1978168872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-7f20fca9-c7c1-4819-82bf-a4d86c00017e 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:37 devstack sudo[105765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:37:37 devstack sudo[105765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:37 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-4f637dab-d445-4c03-8030-22597d5f3abb tempest-CreateVolumesFromSnapshotTest-1978168872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (491b0752-b2b6-44b1-91d2-844e4d22b3ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ee02ef4-0fcd-4505-9f09-2fd3c172b112', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:37 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-4f637dab-d445-4c03-8030-22597d5f3abb tempest-CreateVolumesFromSnapshotTest-1978168872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08953c73-e5f7-4cc5-bdfc-231991a07ba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:37 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-4f637dab-d445-4c03-8030-22597d5f3abb tempest-CreateVolumesFromSnapshotTest-1978168872 None] Volume volume-2ee02ef4-0fcd-4505-9f09-2fd3c172b112 (2ee02ef4-0fcd-4505-9f09-2fd3c172b112): created successfully Sep 16 20:37:37 devstack sudo[105767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-7f20fca9-c7c1-4819-82bf-a4d86c00017e 1073741824 Sep 16 20:37:37 devstack sudo[105767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:37 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-4f637dab-d445-4c03-8030-22597d5f3abb tempest-CreateVolumesFromSnapshotTest-1978168872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08953c73-e5f7-4cc5-bdfc-231991a07ba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:37 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-4f637dab-d445-4c03-8030-22597d5f3abb tempest-CreateVolumesFromSnapshotTest-1978168872 None] Flow 'volume_create_manager' (392f9073-98b1-476f-9215-580b47c8d7db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:37:37 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-4f637dab-d445-4c03-8030-22597d5f3abb tempest-CreateVolumesFromSnapshotTest-1978168872 None] Created volume successfully. Sep 16 20:37:37 devstack sudo[105765]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:37 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-62ed7079-3fca-4f15-a920-c71df4942f76 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.344s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:37 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-62ed7079-3fca-4f15-a920-c71df4942f76 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:37:37 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-62ed7079-3fca-4f15-a920-c71df4942f76 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Deleted volume successfully. Sep 16 20:37:37 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-62ed7079-3fca-4f15-a920-c71df4942f76 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Lock "cinder-251988dc-8fff-41e4-a83e-5c201f5205ca-delete_volume" released by "delete_volume" :: held 1.655s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:37:37 devstack sudo[105762]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:37 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-bc31dab2-0781-457f-8b20-7a53341df30f tempest-VolumeAndVolumeTypeFromImageTest-1520299628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_09d26537-bd37-46c4-9143-6bbd2b644e90_eusp__medevstack@QuobyteHD /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e4042f07-d1ca-467b-b61b-75f07a29678d" returned: 0 in 0.606s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:37 devstack cinder-volume[86188]: DEBUG cinder.image.image_utils [None req-bc31dab2-0781-457f-8b20-7a53341df30f tempest-VolumeAndVolumeTypeFromImageTest-1520299628 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_09d26537-bd37-46c4-9143-6bbd2b644e90_eusp__medevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e4042f07-d1ca-467b-b61b-75f07a29678d {{(pid=86188) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 16 20:37:37 devstack cinder-volume[86188]: INFO cinder.image.image_utils [None req-bc31dab2-0781-457f-8b20-7a53341df30f tempest-VolumeAndVolumeTypeFromImageTest-1520299628 None] Converted 0.00 MB image at 0.00 MB/s Sep 16 20:37:37 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-bc31dab2-0781-457f-8b20-7a53341df30f tempest-VolumeAndVolumeTypeFromImageTest-1520299628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e4042f07-d1ca-467b-b61b-75f07a29678d 1G {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:37 devstack sudo[105778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e4042f07-d1ca-467b-b61b-75f07a29678d 1G Sep 16 20:37:37 devstack sudo[105778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:37 devstack sudo[105767]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:37 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-cf5170dd-feaf-40e3-a636-cd57aa9459bf tempest-CreateVolumesFromSnapshotTest-1978168872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-7f20fca9-c7c1-4819-82bf-a4d86c00017e 1073741824" returned: 0 in 0.610s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:37 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-cf5170dd-feaf-40e3-a636-cd57aa9459bf tempest-CreateVolumesFromSnapshotTest-1978168872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-7f20fca9-c7c1-4819-82bf-a4d86c00017e {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:37 devstack sudo[105780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-7f20fca9-c7c1-4819-82bf-a4d86c00017e Sep 16 20:37:37 devstack sudo[105780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:37 devstack sudo[105778]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:37 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-bc31dab2-0781-457f-8b20-7a53341df30f tempest-VolumeAndVolumeTypeFromImageTest-1520299628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e4042f07-d1ca-467b-b61b-75f07a29678d 1G" returned: 0 in 0.413s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:37 devstack cinder-volume[86188]: DEBUG cinder.volume.volume_utils [None req-bc31dab2-0781-457f-8b20-7a53341df30f tempest-VolumeAndVolumeTypeFromImageTest-1520299628 None] Downloaded image 09d26537-bd37-46c4-9143-6bbd2b644e90 ((None, [{'url': 'file:///opt/stack/data/glance/images/09d26537-bd37-46c4-9143-6bbd2b644e90', 'metadata': {}}])) to volume e4042f07-d1ca-467b-b61b-75f07a29678d successfully. {{(pid=86188) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 16 20:37:37 devstack cinder-volume[86188]: DEBUG cinder.image.image_utils [None req-bc31dab2-0781-457f-8b20-7a53341df30f tempest-VolumeAndVolumeTypeFromImageTest-1520299628 None] Temporary image 09d26537-bd37-46c4-9143-6bbd2b644e90 for user f6938bea3fc34eedb99509653e73ab1b is deleted. {{(pid=86188) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 16 20:37:37 devstack cinder-volume[86188]: DEBUG cinder.volume.volume_utils [None req-bc31dab2-0781-457f-8b20-7a53341df30f tempest-VolumeAndVolumeTypeFromImageTest-1520299628 None] Marking volume e4042f07-d1ca-467b-b61b-75f07a29678d as bootable. {{(pid=86188) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 16 20:37:38 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc31dab2-0781-457f-8b20-7a53341df30f tempest-VolumeAndVolumeTypeFromImageTest-1520299628 None] Copying metadata from image 09d26537-bd37-46c4-9143-6bbd2b644e90 to e4042f07-d1ca-467b-b61b-75f07a29678d. {{(pid=86188) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 16 20:37:38 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc31dab2-0781-457f-8b20-7a53341df30f tempest-VolumeAndVolumeTypeFromImageTest-1520299628 None] Creating volume glance metadata for volume e4042f07-d1ca-467b-b61b-75f07a29678d backed by image 09d26537-bd37-46c4-9143-6bbd2b644e90 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '09d26537-bd37-46c4-9143-6bbd2b644e90', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'ce01715b28a48363a1bea42763972ef9', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86188) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 16 20:37:38 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-4ede4c34-4e0d-40eb-9e0d-512206a9d973 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Acquiring lock "cinder-993cf03f-b9c8-4f53-b1ef-44ee249b13e4-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:37:38 devstack sudo[105780]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:38 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-cf5170dd-feaf-40e3-a636-cd57aa9459bf tempest-CreateVolumesFromSnapshotTest-1978168872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-7f20fca9-c7c1-4819-82bf-a4d86c00017e" returned: 0 in 0.325s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:38 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-cf5170dd-feaf-40e3-a636-cd57aa9459bf tempest-CreateVolumesFromSnapshotTest-1978168872 None] <== create_volume: return (986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:37:38 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-cf5170dd-feaf-40e3-a636-cd57aa9459bf tempest-CreateVolumesFromSnapshotTest-1978168872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:37:38 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-4ede4c34-4e0d-40eb-9e0d-512206a9d973 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Lock "cinder-993cf03f-b9c8-4f53-b1ef-44ee249b13e4-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:37:38 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-109fcf96-1f65-49b0-a162-52021cee1218 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.133s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:37:38 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-109fcf96-1f65-49b0-a162-52021cee1218 tempest-CreateVolumesFromSnapshotTest-1978168872 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:37:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1808746942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=933d099e-ae13-4acc-bdde-3c490b6ebeeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be14f2fbcae04804b6ead8457652572b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:37:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:37:34Z,use_quota=True,user_id='0a42ae2d85c14e9c9bd48a96c1cc43ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:37:38 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-109fcf96-1f65-49b0-a162-52021cee1218 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Creating volume 933d099e-ae13-4acc-bdde-3c490b6ebeeb {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:37:38 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-109fcf96-1f65-49b0-a162-52021cee1218 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:37:38 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-109fcf96-1f65-49b0-a162-52021cee1218 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:37:38 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-109fcf96-1f65-49b0-a162-52021cee1218 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:37:38 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-109fcf96-1f65-49b0-a162-52021cee1218 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:37:38 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-109fcf96-1f65-49b0-a162-52021cee1218 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:37:38 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-109fcf96-1f65-49b0-a162-52021cee1218 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:37:38 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-109fcf96-1f65-49b0-a162-52021cee1218 tempest-CreateVolumesFromSnapshotTest-1978168872 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:37:38 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-109fcf96-1f65-49b0-a162-52021cee1218 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-933d099e-ae13-4acc-bdde-3c490b6ebeeb 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:38 devstack sudo[105787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-933d099e-ae13-4acc-bdde-3c490b6ebeeb 1073741824 Sep 16 20:37:38 devstack sudo[105787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:38 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-cf5170dd-feaf-40e3-a636-cd57aa9459bf tempest-CreateVolumesFromSnapshotTest-1978168872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92ea15f4-223a-4b8e-9ab6-24844553b2a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f20fca9-c7c1-4819-82bf-a4d86c00017e', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:38 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-cf5170dd-feaf-40e3-a636-cd57aa9459bf tempest-CreateVolumesFromSnapshotTest-1978168872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e1d649c-7177-4857-ad88-8a9d48bc0456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:38 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-bc31dab2-0781-457f-8b20-7a53341df30f tempest-VolumeAndVolumeTypeFromImageTest-1520299628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcd5baeb-9a60-4a88-a4e0-6fa1e2254459) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4042f07-d1ca-467b-b61b-75f07a29678d', 'volume_size': 1, 'image_id': '09d26537-bd37-46c4-9143-6bbd2b644e90', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/09d26537-bd37-46c4-9143-6bbd2b644e90', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ce01715b28a48363a1bea42763972ef9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3a681c0c0c42478f8b526f392809d000', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '472324f2e26817490bc1c4924f4c4a0cb9b14d4b1d556cee584e3d78a04e6add68ecc9dcad9af8eee02eb9bf61afa23c3d971d143abe6a09be0cfdda9afd11a5', 'id': '09d26537-bd37-46c4-9143-6bbd2b644e90', 'created_at': datetime.datetime(2026, 9, 16, 18, 37, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 18, 37, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/09d26537-bd37-46c4-9143-6bbd2b644e90/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:38 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-bc31dab2-0781-457f-8b20-7a53341df30f tempest-VolumeAndVolumeTypeFromImageTest-1520299628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9ab4855-5aa8-434b-b33d-330f67119f60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:38 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-cf5170dd-feaf-40e3-a636-cd57aa9459bf tempest-CreateVolumesFromSnapshotTest-1978168872 None] Volume volume-7f20fca9-c7c1-4819-82bf-a4d86c00017e (7f20fca9-c7c1-4819-82bf-a4d86c00017e): created successfully Sep 16 20:37:38 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-cf5170dd-feaf-40e3-a636-cd57aa9459bf tempest-CreateVolumesFromSnapshotTest-1978168872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e1d649c-7177-4857-ad88-8a9d48bc0456) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:38 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-cf5170dd-feaf-40e3-a636-cd57aa9459bf tempest-CreateVolumesFromSnapshotTest-1978168872 None] Flow 'volume_create_manager' (199ca4fd-394c-44c3-a12f-eb6c7f329b6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:37:38 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-cf5170dd-feaf-40e3-a636-cd57aa9459bf tempest-CreateVolumesFromSnapshotTest-1978168872 None] Created volume successfully. Sep 16 20:37:38 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-4ede4c34-4e0d-40eb-9e0d-512206a9d973 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Acquiring lock "cinder-quobyte-993cf03f-b9c8-4f53-b1ef-44ee249b13e4" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:37:38 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-bc31dab2-0781-457f-8b20-7a53341df30f tempest-VolumeAndVolumeTypeFromImageTest-1520299628 None] Volume volume-e4042f07-d1ca-467b-b61b-75f07a29678d (e4042f07-d1ca-467b-b61b-75f07a29678d): created successfully Sep 16 20:37:38 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-bc31dab2-0781-457f-8b20-7a53341df30f tempest-VolumeAndVolumeTypeFromImageTest-1520299628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9ab4855-5aa8-434b-b33d-330f67119f60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:38 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-bc31dab2-0781-457f-8b20-7a53341df30f tempest-VolumeAndVolumeTypeFromImageTest-1520299628 None] Flow 'volume_create_manager' (318b1e75-d02f-4509-8313-60a2ec2461a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:37:38 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-4ede4c34-4e0d-40eb-9e0d-512206a9d973 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Lock "cinder-quobyte-993cf03f-b9c8-4f53-b1ef-44ee249b13e4" acquired by "delete_volume" :: waited 0.031s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:37:38 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-bc31dab2-0781-457f-8b20-7a53341df30f tempest-VolumeAndVolumeTypeFromImageTest-1520299628 None] Created volume successfully. Sep 16 20:37:38 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[98f8d6df-70ec-4e3c-be3b-5bf34e0fd425]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:37:38 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-4ede4c34-4e0d-40eb-9e0d-512206a9d973 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-993cf03f-b9c8-4f53-b1ef-44ee249b13e4 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:38 devstack sudo[105789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-993cf03f-b9c8-4f53-b1ef-44ee249b13e4 Sep 16 20:37:38 devstack sudo[105789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:38 devstack sudo[105787]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:38 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-109fcf96-1f65-49b0-a162-52021cee1218 tempest-CreateVolumesFromSnapshotTest-1978168872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-933d099e-ae13-4acc-bdde-3c490b6ebeeb 1073741824" returned: 0 in 0.471s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:38 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-109fcf96-1f65-49b0-a162-52021cee1218 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-933d099e-ae13-4acc-bdde-3c490b6ebeeb {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:38 devstack sudo[105797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-933d099e-ae13-4acc-bdde-3c490b6ebeeb Sep 16 20:37:38 devstack sudo[105797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:38 devstack sudo[105789]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:38 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-4ede4c34-4e0d-40eb-9e0d-512206a9d973 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-993cf03f-b9c8-4f53-b1ef-44ee249b13e4" returned: 0 in 0.475s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:38 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-4ede4c34-4e0d-40eb-9e0d-512206a9d973 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-993cf03f-b9c8-4f53-b1ef-44ee249b13e4 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:38 devstack sudo[105801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-993cf03f-b9c8-4f53-b1ef-44ee249b13e4 Sep 16 20:37:38 devstack sudo[105801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:38 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-8f04d4d3-dcd3-4c6e-8da5-072afb43b02a tempest-VolumeAndVolumeTypeFromImageTest-1520299628 None] Acquiring lock "cinder-e4042f07-d1ca-467b-b61b-75f07a29678d-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:37:38 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-8f04d4d3-dcd3-4c6e-8da5-072afb43b02a tempest-VolumeAndVolumeTypeFromImageTest-1520299628 None] Lock "cinder-e4042f07-d1ca-467b-b61b-75f07a29678d-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:37:38 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-8f04d4d3-dcd3-4c6e-8da5-072afb43b02a tempest-VolumeAndVolumeTypeFromImageTest-1520299628 None] Acquiring lock "cinder-quobyte-e4042f07-d1ca-467b-b61b-75f07a29678d" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:37:38 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-8f04d4d3-dcd3-4c6e-8da5-072afb43b02a tempest-VolumeAndVolumeTypeFromImageTest-1520299628 None] Lock "cinder-quobyte-e4042f07-d1ca-467b-b61b-75f07a29678d" acquired by "delete_volume" :: waited 0.027s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:37:39 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[638d0c39-7c75-431d-8e32-633257f4a824]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:37:39 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-8f04d4d3-dcd3-4c6e-8da5-072afb43b02a tempest-VolumeAndVolumeTypeFromImageTest-1520299628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e4042f07-d1ca-467b-b61b-75f07a29678d {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:39 devstack sudo[105797]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:39 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-109fcf96-1f65-49b0-a162-52021cee1218 tempest-CreateVolumesFromSnapshotTest-1978168872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-933d099e-ae13-4acc-bdde-3c490b6ebeeb" returned: 0 in 0.409s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:39 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-109fcf96-1f65-49b0-a162-52021cee1218 tempest-CreateVolumesFromSnapshotTest-1978168872 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:37:39 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-109fcf96-1f65-49b0-a162-52021cee1218 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:37:39 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-5903259f-3bfa-4330-8f2f-0738f9fcc04a tempest-CreateVolumesFromSnapshotTest-1978168872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.604s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:37:39 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-5903259f-3bfa-4330-8f2f-0738f9fcc04a tempest-CreateVolumesFromSnapshotTest-1978168872 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:37:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1259878666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3224fd64-50e9-42d5-b7ff-8aee24a706ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be14f2fbcae04804b6ead8457652572b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:37:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:37:34Z,use_quota=True,user_id='0a42ae2d85c14e9c9bd48a96c1cc43ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:37:39 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-5903259f-3bfa-4330-8f2f-0738f9fcc04a tempest-CreateVolumesFromSnapshotTest-1978168872 None] Creating volume 3224fd64-50e9-42d5-b7ff-8aee24a706ca {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:37:39 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-5903259f-3bfa-4330-8f2f-0738f9fcc04a tempest-CreateVolumesFromSnapshotTest-1978168872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:37:39 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-5903259f-3bfa-4330-8f2f-0738f9fcc04a tempest-CreateVolumesFromSnapshotTest-1978168872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:37:39 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-5903259f-3bfa-4330-8f2f-0738f9fcc04a tempest-CreateVolumesFromSnapshotTest-1978168872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:37:39 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-5903259f-3bfa-4330-8f2f-0738f9fcc04a tempest-CreateVolumesFromSnapshotTest-1978168872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:37:39 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-5903259f-3bfa-4330-8f2f-0738f9fcc04a tempest-CreateVolumesFromSnapshotTest-1978168872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:37:39 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-5903259f-3bfa-4330-8f2f-0738f9fcc04a tempest-CreateVolumesFromSnapshotTest-1978168872 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:37:39 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-5903259f-3bfa-4330-8f2f-0738f9fcc04a tempest-CreateVolumesFromSnapshotTest-1978168872 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:37:39 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-5903259f-3bfa-4330-8f2f-0738f9fcc04a tempest-CreateVolumesFromSnapshotTest-1978168872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-3224fd64-50e9-42d5-b7ff-8aee24a706ca 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:39 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-491d45b6-9383-4a98-a7b8-38d8b8e2238d tempest-VolumeDependencyTests-1304260226 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:37:39 devstack sudo[105805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-3224fd64-50e9-42d5-b7ff-8aee24a706ca 1073741824 Sep 16 20:37:39 devstack sudo[105805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:39 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-491d45b6-9383-4a98-a7b8-38d8b8e2238d tempest-VolumeDependencyTests-1304260226 None] Flow 'volume_create_manager' (b931fa3b-6190-4723-847c-6b1d2dfa3c41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:37:39 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-491d45b6-9383-4a98-a7b8-38d8b8e2238d tempest-VolumeDependencyTests-1304260226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea0995ab-d247-4252-b09b-98b53af8ae39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:39 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-109fcf96-1f65-49b0-a162-52021cee1218 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68ec9e78-7ff1-4713-9573-1ab85537b813) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-933d099e-ae13-4acc-bdde-3c490b6ebeeb', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:39 devstack sudo[105801]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:39 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-109fcf96-1f65-49b0-a162-52021cee1218 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77495902-9eb5-43d4-8e02-4e71d1008f19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:39 devstack sudo[105804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e4042f07-d1ca-467b-b61b-75f07a29678d Sep 16 20:37:39 devstack sudo[105804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:39 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-491d45b6-9383-4a98-a7b8-38d8b8e2238d tempest-VolumeDependencyTests-1304260226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea0995ab-d247-4252-b09b-98b53af8ae39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:37:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-108634501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=098c751a-2f07-49fd-9d90-2493c701313e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='daa7e4ffb3754f54835be9f4502d53aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:37:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:37:39Z,use_quota=True,user_id='9c70e7ce17da4083a9e890b9e9a77a17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:39 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-491d45b6-9383-4a98-a7b8-38d8b8e2238d tempest-VolumeDependencyTests-1304260226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87561aaf-1b97-4d94-bf78-11970e4897ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:39 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-491d45b6-9383-4a98-a7b8-38d8b8e2238d tempest-VolumeDependencyTests-1304260226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87561aaf-1b97-4d94-bf78-11970e4897ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:39 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-491d45b6-9383-4a98-a7b8-38d8b8e2238d tempest-VolumeDependencyTests-1304260226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5050ca44-75d4-407d-aa03-eec496061b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:39 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-491d45b6-9383-4a98-a7b8-38d8b8e2238d tempest-VolumeDependencyTests-1304260226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5050ca44-75d4-407d-aa03-eec496061b82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '098c751a-2f07-49fd-9d90-2493c701313e', 'volume_name': 'volume-098c751a-2f07-49fd-9d90-2493c701313e', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:39 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-491d45b6-9383-4a98-a7b8-38d8b8e2238d tempest-VolumeDependencyTests-1304260226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93105aac-69bc-4c1f-bea7-6ff6b0c9f669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:39 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-491d45b6-9383-4a98-a7b8-38d8b8e2238d tempest-VolumeDependencyTests-1304260226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93105aac-69bc-4c1f-bea7-6ff6b0c9f669) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:39 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-491d45b6-9383-4a98-a7b8-38d8b8e2238d tempest-VolumeDependencyTests-1304260226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e501658-090c-4467-9919-1eea54357311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:39 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-491d45b6-9383-4a98-a7b8-38d8b8e2238d tempest-VolumeDependencyTests-1304260226 None] Volume 098c751a-2f07-49fd-9d90-2493c701313e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-098c751a-2f07-49fd-9d90-2493c701313e', 'volume_size': 1} Sep 16 20:37:39 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-491d45b6-9383-4a98-a7b8-38d8b8e2238d tempest-VolumeDependencyTests-1304260226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:37:39 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-4ede4c34-4e0d-40eb-9e0d-512206a9d973 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-993cf03f-b9c8-4f53-b1ef-44ee249b13e4" returned: 0 in 0.416s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:39 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-4ede4c34-4e0d-40eb-9e0d-512206a9d973 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Lock "cinder-quobyte-993cf03f-b9c8-4f53-b1ef-44ee249b13e4" released by "delete_volume" :: held 0.953s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:37:39 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-109fcf96-1f65-49b0-a162-52021cee1218 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Volume volume-933d099e-ae13-4acc-bdde-3c490b6ebeeb (933d099e-ae13-4acc-bdde-3c490b6ebeeb): created successfully Sep 16 20:37:39 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-109fcf96-1f65-49b0-a162-52021cee1218 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77495902-9eb5-43d4-8e02-4e71d1008f19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:39 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-109fcf96-1f65-49b0-a162-52021cee1218 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Flow 'volume_create_manager' (9920d875-09f3-4c31-8ee7-0b25809d1724) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:37:39 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-109fcf96-1f65-49b0-a162-52021cee1218 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Created volume successfully. Sep 16 20:37:39 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-4ede4c34-4e0d-40eb-9e0d-512206a9d973 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Created reservations ['4b643e1e-2cd1-4a2c-8b06-f0f974585365', '1b7ffb79-0dd6-4c56-bc9f-45014ae058d3', 'ee34b94b-bfaa-4266-98d3-d6d8771775d6', 'ae232a48-f319-4e0b-bf02-c43f158dc5b6'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:37:39 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-4ede4c34-4e0d-40eb-9e0d-512206a9d973 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:37:39 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-4ede4c34-4e0d-40eb-9e0d-512206a9d973 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:37:39 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-4ede4c34-4e0d-40eb-9e0d-512206a9d973 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:37:39 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-4ede4c34-4e0d-40eb-9e0d-512206a9d973 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:37:39 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-4ede4c34-4e0d-40eb-9e0d-512206a9d973 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:37:39 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-4ede4c34-4e0d-40eb-9e0d-512206a9d973 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:39 devstack sudo[105814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:37:39 devstack sudo[105814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:39 devstack sudo[105804]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:39 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-8f04d4d3-dcd3-4c6e-8da5-072afb43b02a tempest-VolumeAndVolumeTypeFromImageTest-1520299628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e4042f07-d1ca-467b-b61b-75f07a29678d" returned: 0 in 0.416s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:39 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-8f04d4d3-dcd3-4c6e-8da5-072afb43b02a tempest-VolumeAndVolumeTypeFromImageTest-1520299628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e4042f07-d1ca-467b-b61b-75f07a29678d {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:39 devstack sudo[105818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e4042f07-d1ca-467b-b61b-75f07a29678d Sep 16 20:37:39 devstack sudo[105818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:39 devstack sudo[105805]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:39 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-5903259f-3bfa-4330-8f2f-0738f9fcc04a tempest-CreateVolumesFromSnapshotTest-1978168872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-3224fd64-50e9-42d5-b7ff-8aee24a706ca 1073741824" returned: 0 in 0.516s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:39 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-5903259f-3bfa-4330-8f2f-0738f9fcc04a tempest-CreateVolumesFromSnapshotTest-1978168872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-3224fd64-50e9-42d5-b7ff-8aee24a706ca {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:39 devstack sudo[105814]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:39 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-4ede4c34-4e0d-40eb-9e0d-512206a9d973 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.275s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:39 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-4ede4c34-4e0d-40eb-9e0d-512206a9d973 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:37:39 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-4ede4c34-4e0d-40eb-9e0d-512206a9d973 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Deleted volume successfully. Sep 16 20:37:39 devstack sudo[105821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-3224fd64-50e9-42d5-b7ff-8aee24a706ca Sep 16 20:37:39 devstack sudo[105821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:39 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-4ede4c34-4e0d-40eb-9e0d-512206a9d973 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Lock "cinder-993cf03f-b9c8-4f53-b1ef-44ee249b13e4-delete_volume" released by "delete_volume" :: held 1.574s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:37:39 devstack sudo[105818]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:39 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-8f04d4d3-dcd3-4c6e-8da5-072afb43b02a tempest-VolumeAndVolumeTypeFromImageTest-1520299628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e4042f07-d1ca-467b-b61b-75f07a29678d" returned: 0 in 0.282s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:39 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-8f04d4d3-dcd3-4c6e-8da5-072afb43b02a tempest-VolumeAndVolumeTypeFromImageTest-1520299628 None] Lock "cinder-quobyte-e4042f07-d1ca-467b-b61b-75f07a29678d" released by "delete_volume" :: held 0.760s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:37:39 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-8f04d4d3-dcd3-4c6e-8da5-072afb43b02a tempest-VolumeAndVolumeTypeFromImageTest-1520299628 None] Created reservations ['e0b9dc4c-28fe-45a1-b286-c4cf25237374', '7f473088-2fed-496a-aac0-b1b6ad8f41f1', '66096665-2aaa-454e-b109-c062ac6de8ed', '5513e5bc-a02f-40a9-a566-6a824bb42377'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:37:39 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-8f04d4d3-dcd3-4c6e-8da5-072afb43b02a tempest-VolumeAndVolumeTypeFromImageTest-1520299628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:37:39 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-8f04d4d3-dcd3-4c6e-8da5-072afb43b02a tempest-VolumeAndVolumeTypeFromImageTest-1520299628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:37:39 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-8f04d4d3-dcd3-4c6e-8da5-072afb43b02a tempest-VolumeAndVolumeTypeFromImageTest-1520299628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:37:39 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-8f04d4d3-dcd3-4c6e-8da5-072afb43b02a tempest-VolumeAndVolumeTypeFromImageTest-1520299628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:37:39 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-8f04d4d3-dcd3-4c6e-8da5-072afb43b02a tempest-VolumeAndVolumeTypeFromImageTest-1520299628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:37:39 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-8f04d4d3-dcd3-4c6e-8da5-072afb43b02a tempest-VolumeAndVolumeTypeFromImageTest-1520299628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:39 devstack sudo[105821]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:39 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-5903259f-3bfa-4330-8f2f-0738f9fcc04a tempest-CreateVolumesFromSnapshotTest-1978168872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-3224fd64-50e9-42d5-b7ff-8aee24a706ca" returned: 0 in 0.277s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:39 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-5903259f-3bfa-4330-8f2f-0738f9fcc04a tempest-CreateVolumesFromSnapshotTest-1978168872 None] <== create_volume: return (838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:37:39 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-5903259f-3bfa-4330-8f2f-0738f9fcc04a tempest-CreateVolumesFromSnapshotTest-1978168872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.841s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:37:39 devstack sudo[105825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:37:39 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-491d45b6-9383-4a98-a7b8-38d8b8e2238d tempest-VolumeDependencyTests-1304260226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.707s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:37:39 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-491d45b6-9383-4a98-a7b8-38d8b8e2238d tempest-VolumeDependencyTests-1304260226 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:37:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-108634501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=098c751a-2f07-49fd-9d90-2493c701313e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='daa7e4ffb3754f54835be9f4502d53aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:37:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:37:39Z,use_quota=True,user_id='9c70e7ce17da4083a9e890b9e9a77a17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:37:39 devstack sudo[105825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:39 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-491d45b6-9383-4a98-a7b8-38d8b8e2238d tempest-VolumeDependencyTests-1304260226 None] Creating volume 098c751a-2f07-49fd-9d90-2493c701313e {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:37:39 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-491d45b6-9383-4a98-a7b8-38d8b8e2238d tempest-VolumeDependencyTests-1304260226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:37:39 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-491d45b6-9383-4a98-a7b8-38d8b8e2238d tempest-VolumeDependencyTests-1304260226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:37:39 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-491d45b6-9383-4a98-a7b8-38d8b8e2238d tempest-VolumeDependencyTests-1304260226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:37:39 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-491d45b6-9383-4a98-a7b8-38d8b8e2238d tempest-VolumeDependencyTests-1304260226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:37:39 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-491d45b6-9383-4a98-a7b8-38d8b8e2238d tempest-VolumeDependencyTests-1304260226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:37:39 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-491d45b6-9383-4a98-a7b8-38d8b8e2238d tempest-VolumeDependencyTests-1304260226 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:37:39 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-491d45b6-9383-4a98-a7b8-38d8b8e2238d tempest-VolumeDependencyTests-1304260226 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:37:39 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-491d45b6-9383-4a98-a7b8-38d8b8e2238d tempest-VolumeDependencyTests-1304260226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-098c751a-2f07-49fd-9d90-2493c701313e 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:39 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-5903259f-3bfa-4330-8f2f-0738f9fcc04a tempest-CreateVolumesFromSnapshotTest-1978168872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dd857ec-90b6-47fa-b132-74a772a3d1bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3224fd64-50e9-42d5-b7ff-8aee24a706ca', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:39 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-5903259f-3bfa-4330-8f2f-0738f9fcc04a tempest-CreateVolumesFromSnapshotTest-1978168872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d618592-2364-4913-b13b-24a031660a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:39 devstack sudo[105827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-098c751a-2f07-49fd-9d90-2493c701313e 1073741824 Sep 16 20:37:39 devstack sudo[105827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:39 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-5903259f-3bfa-4330-8f2f-0738f9fcc04a tempest-CreateVolumesFromSnapshotTest-1978168872 None] Volume volume-3224fd64-50e9-42d5-b7ff-8aee24a706ca (3224fd64-50e9-42d5-b7ff-8aee24a706ca): created successfully Sep 16 20:37:39 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-5903259f-3bfa-4330-8f2f-0738f9fcc04a tempest-CreateVolumesFromSnapshotTest-1978168872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d618592-2364-4913-b13b-24a031660a5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:39 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-5903259f-3bfa-4330-8f2f-0738f9fcc04a tempest-CreateVolumesFromSnapshotTest-1978168872 None] Flow 'volume_create_manager' (ec595bc1-cb58-45fa-854f-deced9ac529f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:37:39 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-5903259f-3bfa-4330-8f2f-0738f9fcc04a tempest-CreateVolumesFromSnapshotTest-1978168872 None] Created volume successfully. Sep 16 20:37:40 devstack sudo[105825]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:40 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-8f04d4d3-dcd3-4c6e-8da5-072afb43b02a tempest-VolumeAndVolumeTypeFromImageTest-1520299628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.284s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:40 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-8f04d4d3-dcd3-4c6e-8da5-072afb43b02a tempest-VolumeAndVolumeTypeFromImageTest-1520299628 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:37:40 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-8f04d4d3-dcd3-4c6e-8da5-072afb43b02a tempest-VolumeAndVolumeTypeFromImageTest-1520299628 None] Deleted volume successfully. Sep 16 20:37:40 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-8f04d4d3-dcd3-4c6e-8da5-072afb43b02a tempest-VolumeAndVolumeTypeFromImageTest-1520299628 None] Lock "cinder-e4042f07-d1ca-467b-b61b-75f07a29678d-delete_volume" released by "delete_volume" :: held 1.291s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:37:40 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-ffab9b38-4a78-4dc3-86f9-f839a2a4f69d tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Acquiring lock "cinder-2b8bde32-db2d-4e69-b8d3-9e079a444698-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:37:40 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-ffab9b38-4a78-4dc3-86f9-f839a2a4f69d tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Lock "cinder-2b8bde32-db2d-4e69-b8d3-9e079a444698-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:37:40 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-ffab9b38-4a78-4dc3-86f9-f839a2a4f69d tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Acquiring lock "cinder-quobyte-2b8bde32-db2d-4e69-b8d3-9e079a444698" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:37:40 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-ffab9b38-4a78-4dc3-86f9-f839a2a4f69d tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Lock "cinder-quobyte-2b8bde32-db2d-4e69-b8d3-9e079a444698" acquired by "delete_volume" :: waited 0.017s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:37:40 devstack sudo[105827]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:40 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3d6586c-6e1a-4b1d-904c-f2810dc1ed72]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:37:40 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ffab9b38-4a78-4dc3-86f9-f839a2a4f69d tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-2b8bde32-db2d-4e69-b8d3-9e079a444698 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:40 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-491d45b6-9383-4a98-a7b8-38d8b8e2238d tempest-VolumeDependencyTests-1304260226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-098c751a-2f07-49fd-9d90-2493c701313e 1073741824" returned: 0 in 0.542s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:40 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-491d45b6-9383-4a98-a7b8-38d8b8e2238d tempest-VolumeDependencyTests-1304260226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-098c751a-2f07-49fd-9d90-2493c701313e {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:40 devstack sudo[105835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-098c751a-2f07-49fd-9d90-2493c701313e Sep 16 20:37:40 devstack sudo[105835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:40 devstack sudo[105834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-2b8bde32-db2d-4e69-b8d3-9e079a444698 Sep 16 20:37:40 devstack sudo[105834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:40 devstack sudo[105835]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:40 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-491d45b6-9383-4a98-a7b8-38d8b8e2238d tempest-VolumeDependencyTests-1304260226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-098c751a-2f07-49fd-9d90-2493c701313e" returned: 0 in 0.244s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:40 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-491d45b6-9383-4a98-a7b8-38d8b8e2238d tempest-VolumeDependencyTests-1304260226 None] <== create_volume: return (832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:37:40 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-491d45b6-9383-4a98-a7b8-38d8b8e2238d tempest-VolumeDependencyTests-1304260226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.835s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:37:40 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-491d45b6-9383-4a98-a7b8-38d8b8e2238d tempest-VolumeDependencyTests-1304260226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e501658-090c-4467-9919-1eea54357311) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-098c751a-2f07-49fd-9d90-2493c701313e', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:40 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-491d45b6-9383-4a98-a7b8-38d8b8e2238d tempest-VolumeDependencyTests-1304260226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (684b092a-0e24-4462-9ad4-d0c6bdb263bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:40 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-491d45b6-9383-4a98-a7b8-38d8b8e2238d tempest-VolumeDependencyTests-1304260226 None] Volume volume-098c751a-2f07-49fd-9d90-2493c701313e (098c751a-2f07-49fd-9d90-2493c701313e): created successfully Sep 16 20:37:40 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-491d45b6-9383-4a98-a7b8-38d8b8e2238d tempest-VolumeDependencyTests-1304260226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (684b092a-0e24-4462-9ad4-d0c6bdb263bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:40 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-491d45b6-9383-4a98-a7b8-38d8b8e2238d tempest-VolumeDependencyTests-1304260226 None] Flow 'volume_create_manager' (b931fa3b-6190-4723-847c-6b1d2dfa3c41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:37:40 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-491d45b6-9383-4a98-a7b8-38d8b8e2238d tempest-VolumeDependencyTests-1304260226 None] Created volume successfully. Sep 16 20:37:40 devstack sudo[105834]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:40 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ffab9b38-4a78-4dc3-86f9-f839a2a4f69d tempest-CreateVolumesFromSourceVolumeTest-205230560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-2b8bde32-db2d-4e69-b8d3-9e079a444698" returned: 0 in 0.383s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:40 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ffab9b38-4a78-4dc3-86f9-f839a2a4f69d tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-2b8bde32-db2d-4e69-b8d3-9e079a444698 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:40 devstack sudo[105842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-2b8bde32-db2d-4e69-b8d3-9e079a444698 Sep 16 20:37:40 devstack sudo[105842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:41 devstack sudo[105842]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:41 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ffab9b38-4a78-4dc3-86f9-f839a2a4f69d tempest-CreateVolumesFromSourceVolumeTest-205230560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-2b8bde32-db2d-4e69-b8d3-9e079a444698" returned: 0 in 0.267s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:41 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-c12081b0-01c2-47bf-9cc5-5ac779a5b172 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Acquiring lock "cinder-3224fd64-50e9-42d5-b7ff-8aee24a706ca-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:37:41 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-ffab9b38-4a78-4dc3-86f9-f839a2a4f69d tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Lock "cinder-quobyte-2b8bde32-db2d-4e69-b8d3-9e079a444698" released by "delete_volume" :: held 0.714s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:37:41 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-c12081b0-01c2-47bf-9cc5-5ac779a5b172 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Lock "cinder-3224fd64-50e9-42d5-b7ff-8aee24a706ca-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:37:41 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-c12081b0-01c2-47bf-9cc5-5ac779a5b172 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Acquiring lock "cinder-quobyte-3224fd64-50e9-42d5-b7ff-8aee24a706ca" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:37:41 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-ffab9b38-4a78-4dc3-86f9-f839a2a4f69d tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Created reservations ['8c2a985b-3062-4a03-8889-1e6a56ded8e6', '463f5c10-f707-4b26-935c-72a686471c3c', '4d9fed10-2201-4e89-98b8-cbf9171e68db', '8bd5a760-2f39-44aa-9b28-be5f340bddb4'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:37:41 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-c12081b0-01c2-47bf-9cc5-5ac779a5b172 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Lock "cinder-quobyte-3224fd64-50e9-42d5-b7ff-8aee24a706ca" acquired by "delete_volume" :: waited 0.034s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:37:41 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb6704fb-6aaf-4172-a160-d5c2e7d45172]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:37:41 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-c12081b0-01c2-47bf-9cc5-5ac779a5b172 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-3224fd64-50e9-42d5-b7ff-8aee24a706ca {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:41 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a65b535a-2288-469e-bcdf-957ce7bdea64 tempest-VolumeDependencyTests-1304260226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:37:41 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a65b535a-2288-469e-bcdf-957ce7bdea64 tempest-VolumeDependencyTests-1304260226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:37:41 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-a65b535a-2288-469e-bcdf-957ce7bdea64 tempest-VolumeDependencyTests-1304260226 None] Creating offline snapshot fdaadeed-f2ce-49ba-933c-89b9cf3f493a of volume 098c751a-2f07-49fd-9d90-2493c701313e {{(pid=86188) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 20:37:41 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-ffab9b38-4a78-4dc3-86f9-f839a2a4f69d tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:37:41 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-ffab9b38-4a78-4dc3-86f9-f839a2a4f69d tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:37:41 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-ffab9b38-4a78-4dc3-86f9-f839a2a4f69d tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:37:41 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-ffab9b38-4a78-4dc3-86f9-f839a2a4f69d tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:37:41 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-ffab9b38-4a78-4dc3-86f9-f839a2a4f69d tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:37:41 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ffab9b38-4a78-4dc3-86f9-f839a2a4f69d tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:41 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a13f932-e8e0-4c7e-9c32-4c12d4e59ead]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:37:41 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a65b535a-2288-469e-bcdf-957ce7bdea64 tempest-VolumeDependencyTests-1304260226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-098c751a-2f07-49fd-9d90-2493c701313e {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:41 devstack sudo[105846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:37:41 devstack sudo[105846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:41 devstack sudo[105845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-3224fd64-50e9-42d5-b7ff-8aee24a706ca Sep 16 20:37:41 devstack sudo[105845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:41 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-40a9e972-df3b-4054-a9da-78d1bb6c0f53 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Acquiring lock "cinder-b2c64f04-0698-4340-8f7e-62265a895a5a-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:37:41 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-40a9e972-df3b-4054-a9da-78d1bb6c0f53 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Lock "cinder-b2c64f04-0698-4340-8f7e-62265a895a5a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:37:41 devstack sudo[105847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-098c751a-2f07-49fd-9d90-2493c701313e Sep 16 20:37:41 devstack sudo[105847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:41 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-40a9e972-df3b-4054-a9da-78d1bb6c0f53 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Acquiring lock "cinder-quobyte-b2c64f04-0698-4340-8f7e-62265a895a5a" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:37:41 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-40a9e972-df3b-4054-a9da-78d1bb6c0f53 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Lock "cinder-quobyte-b2c64f04-0698-4340-8f7e-62265a895a5a" acquired by "delete_volume" :: waited 0.024s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:37:41 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf37e2f6-848b-464f-bbb6-60e249f4386b]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:37:41 devstack sudo[105846]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:41 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-40a9e972-df3b-4054-a9da-78d1bb6c0f53 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b2c64f04-0698-4340-8f7e-62265a895a5a {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:41 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ffab9b38-4a78-4dc3-86f9-f839a2a4f69d tempest-CreateVolumesFromSourceVolumeTest-205230560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.384s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:41 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-ffab9b38-4a78-4dc3-86f9-f839a2a4f69d tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:37:41 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-ffab9b38-4a78-4dc3-86f9-f839a2a4f69d tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Deleted volume successfully. Sep 16 20:37:41 devstack sudo[105845]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:41 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-c12081b0-01c2-47bf-9cc5-5ac779a5b172 tempest-CreateVolumesFromSnapshotTest-1978168872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-3224fd64-50e9-42d5-b7ff-8aee24a706ca" returned: 0 in 0.507s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:41 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-c12081b0-01c2-47bf-9cc5-5ac779a5b172 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-3224fd64-50e9-42d5-b7ff-8aee24a706ca {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:41 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-ffab9b38-4a78-4dc3-86f9-f839a2a4f69d tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Lock "cinder-2b8bde32-db2d-4e69-b8d3-9e079a444698-delete_volume" released by "delete_volume" :: held 1.506s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:37:41 devstack sudo[105857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-3224fd64-50e9-42d5-b7ff-8aee24a706ca Sep 16 20:37:41 devstack sudo[105857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:41 devstack sudo[105856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b2c64f04-0698-4340-8f7e-62265a895a5a Sep 16 20:37:41 devstack sudo[105856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:42 devstack sudo[105847]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:42 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a65b535a-2288-469e-bcdf-957ce7bdea64 tempest-VolumeDependencyTests-1304260226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-098c751a-2f07-49fd-9d90-2493c701313e" returned: 0 in 0.653s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:42 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a65b535a-2288-469e-bcdf-957ce7bdea64 tempest-VolumeDependencyTests-1304260226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-098c751a-2f07-49fd-9d90-2493c701313e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-098c751a-2f07-49fd-9d90-2493c701313e.fdaadeed-f2ce-49ba-933c-89b9cf3f493a 1G {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:42 devstack sudo[105863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-098c751a-2f07-49fd-9d90-2493c701313e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-098c751a-2f07-49fd-9d90-2493c701313e.fdaadeed-f2ce-49ba-933c-89b9cf3f493a 1G Sep 16 20:37:42 devstack sudo[105863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:42 devstack sudo[105857]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:42 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-c12081b0-01c2-47bf-9cc5-5ac779a5b172 tempest-CreateVolumesFromSnapshotTest-1978168872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-3224fd64-50e9-42d5-b7ff-8aee24a706ca" returned: 0 in 0.324s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:42 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-c12081b0-01c2-47bf-9cc5-5ac779a5b172 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Lock "cinder-quobyte-3224fd64-50e9-42d5-b7ff-8aee24a706ca" released by "delete_volume" :: held 0.911s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:37:42 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-c12081b0-01c2-47bf-9cc5-5ac779a5b172 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Created reservations ['64e818b4-1171-47af-8b05-5e150d318747', 'c67bc907-6524-4870-95c8-756c5c160698', '9565e05d-7f9c-4a9f-bcd8-c0e179f33cbd', 'e24153bc-188b-498f-af41-6816cfd65f58'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:37:42 devstack sudo[105856]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:42 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-40a9e972-df3b-4054-a9da-78d1bb6c0f53 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b2c64f04-0698-4340-8f7e-62265a895a5a" returned: 0 in 0.586s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:42 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-40a9e972-df3b-4054-a9da-78d1bb6c0f53 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b2c64f04-0698-4340-8f7e-62265a895a5a {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:42 devstack sudo[105869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b2c64f04-0698-4340-8f7e-62265a895a5a Sep 16 20:37:42 devstack sudo[105869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:42 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-c12081b0-01c2-47bf-9cc5-5ac779a5b172 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:37:42 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-c12081b0-01c2-47bf-9cc5-5ac779a5b172 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:37:42 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-c12081b0-01c2-47bf-9cc5-5ac779a5b172 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:37:42 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-c12081b0-01c2-47bf-9cc5-5ac779a5b172 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:37:42 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-c12081b0-01c2-47bf-9cc5-5ac779a5b172 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:37:42 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-c12081b0-01c2-47bf-9cc5-5ac779a5b172 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:42 devstack sudo[105873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:37:42 devstack sudo[105873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:42 devstack sudo[105863]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:42 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a65b535a-2288-469e-bcdf-957ce7bdea64 tempest-VolumeDependencyTests-1304260226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-098c751a-2f07-49fd-9d90-2493c701313e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-098c751a-2f07-49fd-9d90-2493c701313e.fdaadeed-f2ce-49ba-933c-89b9cf3f493a 1G" returned: 0 in 0.518s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:42 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a65b535a-2288-469e-bcdf-957ce7bdea64 tempest-VolumeDependencyTests-1304260226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-098c751a-2f07-49fd-9d90-2493c701313e -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-098c751a-2f07-49fd-9d90-2493c701313e.fdaadeed-f2ce-49ba-933c-89b9cf3f493a {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:42 devstack sudo[105877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-098c751a-2f07-49fd-9d90-2493c701313e -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-098c751a-2f07-49fd-9d90-2493c701313e.fdaadeed-f2ce-49ba-933c-89b9cf3f493a Sep 16 20:37:42 devstack sudo[105877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:42 devstack sudo[105869]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:42 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-40a9e972-df3b-4054-a9da-78d1bb6c0f53 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b2c64f04-0698-4340-8f7e-62265a895a5a" returned: 0 in 0.336s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:42 devstack sudo[105873]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:42 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-40a9e972-df3b-4054-a9da-78d1bb6c0f53 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Lock "cinder-quobyte-b2c64f04-0698-4340-8f7e-62265a895a5a" released by "delete_volume" :: held 0.987s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:37:42 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-c12081b0-01c2-47bf-9cc5-5ac779a5b172 tempest-CreateVolumesFromSnapshotTest-1978168872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.308s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:42 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-c12081b0-01c2-47bf-9cc5-5ac779a5b172 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:37:42 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-c12081b0-01c2-47bf-9cc5-5ac779a5b172 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Deleted volume successfully. Sep 16 20:37:42 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-c12081b0-01c2-47bf-9cc5-5ac779a5b172 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Lock "cinder-3224fd64-50e9-42d5-b7ff-8aee24a706ca-delete_volume" released by "delete_volume" :: held 1.589s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:37:42 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-40a9e972-df3b-4054-a9da-78d1bb6c0f53 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Created reservations ['76434997-3078-444b-b8b6-b4dbd069a9a1', '56335e39-4068-4c27-8eb5-ff74162fedbd', '860a4ec0-4cd9-4dcb-9847-88ddfd871d94', '6a9a2743-0b83-4ec2-b5cc-aa5c04f8e74b'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:37:42 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-40a9e972-df3b-4054-a9da-78d1bb6c0f53 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:37:42 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-40a9e972-df3b-4054-a9da-78d1bb6c0f53 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:37:42 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-40a9e972-df3b-4054-a9da-78d1bb6c0f53 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:37:42 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-40a9e972-df3b-4054-a9da-78d1bb6c0f53 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:37:42 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-40a9e972-df3b-4054-a9da-78d1bb6c0f53 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:37:42 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-40a9e972-df3b-4054-a9da-78d1bb6c0f53 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:42 devstack sudo[105883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:37:42 devstack sudo[105883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:42 devstack sudo[105877]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:42 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a65b535a-2288-469e-bcdf-957ce7bdea64 tempest-VolumeDependencyTests-1304260226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-098c751a-2f07-49fd-9d90-2493c701313e -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-098c751a-2f07-49fd-9d90-2493c701313e.fdaadeed-f2ce-49ba-933c-89b9cf3f493a" returned: 0 in 0.391s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:42 devstack cinder-volume[86188]: WARNING cinder.volume.drivers.remotefs [None req-a65b535a-2288-469e-bcdf-957ce7bdea64 tempest-VolumeDependencyTests-1304260226 None] /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-098c751a-2f07-49fd-9d90-2493c701313e.fdaadeed-f2ce-49ba-933c-89b9cf3f493a is being set with open permissions: ugo+rw Sep 16 20:37:42 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a65b535a-2288-469e-bcdf-957ce7bdea64 tempest-VolumeDependencyTests-1304260226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-098c751a-2f07-49fd-9d90-2493c701313e.fdaadeed-f2ce-49ba-933c-89b9cf3f493a {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:42 devstack sudo[105886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-098c751a-2f07-49fd-9d90-2493c701313e.fdaadeed-f2ce-49ba-933c-89b9cf3f493a Sep 16 20:37:42 devstack sudo[105886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:43 devstack sudo[105883]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:43 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-40a9e972-df3b-4054-a9da-78d1bb6c0f53 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.279s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:43 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-40a9e972-df3b-4054-a9da-78d1bb6c0f53 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:37:43 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-40a9e972-df3b-4054-a9da-78d1bb6c0f53 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Deleted volume successfully. Sep 16 20:37:43 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-40a9e972-df3b-4054-a9da-78d1bb6c0f53 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Lock "cinder-b2c64f04-0698-4340-8f7e-62265a895a5a-delete_volume" released by "delete_volume" :: held 1.581s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:37:43 devstack sudo[105886]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:43 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a65b535a-2288-469e-bcdf-957ce7bdea64 tempest-VolumeDependencyTests-1304260226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-098c751a-2f07-49fd-9d90-2493c701313e.fdaadeed-f2ce-49ba-933c-89b9cf3f493a" returned: 0 in 0.279s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:43 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a65b535a-2288-469e-bcdf-957ce7bdea64 tempest-VolumeDependencyTests-1304260226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-098c751a-2f07-49fd-9d90-2493c701313e.info {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:43 devstack sudo[105890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-098c751a-2f07-49fd-9d90-2493c701313e.info Sep 16 20:37:43 devstack sudo[105890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:43 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-be3a4ccc-aec9-4903-a4e8-d9cf0a720088 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Acquiring lock "cinder-933d099e-ae13-4acc-bdde-3c490b6ebeeb-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:37:43 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-be3a4ccc-aec9-4903-a4e8-d9cf0a720088 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Lock "cinder-933d099e-ae13-4acc-bdde-3c490b6ebeeb-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:37:43 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-be3a4ccc-aec9-4903-a4e8-d9cf0a720088 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Acquiring lock "cinder-quobyte-933d099e-ae13-4acc-bdde-3c490b6ebeeb" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:37:43 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-be3a4ccc-aec9-4903-a4e8-d9cf0a720088 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Lock "cinder-quobyte-933d099e-ae13-4acc-bdde-3c490b6ebeeb" acquired by "delete_volume" :: waited 0.020s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:37:43 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[c350273e-9a52-4436-9875-3675fa2c43e4]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:37:43 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-be3a4ccc-aec9-4903-a4e8-d9cf0a720088 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-933d099e-ae13-4acc-bdde-3c490b6ebeeb {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:43 devstack sudo[105890]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:43 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a65b535a-2288-469e-bcdf-957ce7bdea64 tempest-VolumeDependencyTests-1304260226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-098c751a-2f07-49fd-9d90-2493c701313e.info" returned: 0 in 0.321s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:43 devstack cinder-volume[86188]: WARNING cinder.volume.drivers.remotefs [None req-a65b535a-2288-469e-bcdf-957ce7bdea64 tempest-VolumeDependencyTests-1304260226 None] /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-098c751a-2f07-49fd-9d90-2493c701313e.info is being set with open permissions: ugo+rw Sep 16 20:37:43 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a65b535a-2288-469e-bcdf-957ce7bdea64 tempest-VolumeDependencyTests-1304260226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-098c751a-2f07-49fd-9d90-2493c701313e.info {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:43 devstack sudo[105894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-098c751a-2f07-49fd-9d90-2493c701313e.info Sep 16 20:37:43 devstack sudo[105894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:43 devstack sudo[105893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-933d099e-ae13-4acc-bdde-3c490b6ebeeb Sep 16 20:37:43 devstack sudo[105893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:43 devstack sudo[105894]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:43 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a65b535a-2288-469e-bcdf-957ce7bdea64 tempest-VolumeDependencyTests-1304260226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-098c751a-2f07-49fd-9d90-2493c701313e.info" returned: 0 in 0.285s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:43 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a65b535a-2288-469e-bcdf-957ce7bdea64 tempest-VolumeDependencyTests-1304260226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.564s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:37:43 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-e82d85c8-4098-45a0-882a-33b5fb416306 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Acquiring lock "cinder-c63fa010-30d6-42d8-ab10-04c4c913fb00-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:37:43 devstack sudo[105893]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:43 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-e82d85c8-4098-45a0-882a-33b5fb416306 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Lock "cinder-c63fa010-30d6-42d8-ab10-04c4c913fb00-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:37:43 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-be3a4ccc-aec9-4903-a4e8-d9cf0a720088 tempest-CreateVolumesFromSnapshotTest-1978168872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-933d099e-ae13-4acc-bdde-3c490b6ebeeb" returned: 0 in 0.413s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:43 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-be3a4ccc-aec9-4903-a4e8-d9cf0a720088 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-933d099e-ae13-4acc-bdde-3c490b6ebeeb {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:43 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-a65b535a-2288-469e-bcdf-957ce7bdea64 tempest-VolumeDependencyTests-1304260226 None] Create snapshot completed successfully Sep 16 20:37:43 devstack sudo[105901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-933d099e-ae13-4acc-bdde-3c490b6ebeeb Sep 16 20:37:43 devstack sudo[105901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:44 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-e82d85c8-4098-45a0-882a-33b5fb416306 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Acquiring lock "cinder-quobyte-c63fa010-30d6-42d8-ab10-04c4c913fb00" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:37:44 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-e82d85c8-4098-45a0-882a-33b5fb416306 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Lock "cinder-quobyte-c63fa010-30d6-42d8-ab10-04c4c913fb00" acquired by "delete_volume" :: waited 0.034s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:37:44 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[5927010a-8b96-4c56-8ef2-50df943e8bf2]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:37:44 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e82d85c8-4098-45a0-882a-33b5fb416306 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c63fa010-30d6-42d8-ab10-04c4c913fb00 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:44 devstack sudo[105901]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:44 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-be3a4ccc-aec9-4903-a4e8-d9cf0a720088 tempest-CreateVolumesFromSnapshotTest-1978168872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-933d099e-ae13-4acc-bdde-3c490b6ebeeb" returned: 0 in 0.312s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:44 devstack sudo[105903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c63fa010-30d6-42d8-ab10-04c4c913fb00 Sep 16 20:37:44 devstack sudo[105903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:44 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-be3a4ccc-aec9-4903-a4e8-d9cf0a720088 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Lock "cinder-quobyte-933d099e-ae13-4acc-bdde-3c490b6ebeeb" released by "delete_volume" :: held 0.779s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:37:44 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-be3a4ccc-aec9-4903-a4e8-d9cf0a720088 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Created reservations ['10781cc1-449a-4cbc-a684-edbda4251415', '1de63fb2-03ce-4d9c-aa0b-ab551fa81114', 'ec8dd869-ec99-4c36-8bb9-1ca8307a575b', '75b5d220-84b5-407f-8f9d-8c8b30cf854a'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:37:44 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-be3a4ccc-aec9-4903-a4e8-d9cf0a720088 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:37:44 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-be3a4ccc-aec9-4903-a4e8-d9cf0a720088 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:37:44 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-be3a4ccc-aec9-4903-a4e8-d9cf0a720088 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:37:44 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-be3a4ccc-aec9-4903-a4e8-d9cf0a720088 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:37:44 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-be3a4ccc-aec9-4903-a4e8-d9cf0a720088 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:37:44 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-be3a4ccc-aec9-4903-a4e8-d9cf0a720088 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:44 devstack sudo[105906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:37:44 devstack sudo[105906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:44 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-f84cf486-4426-4c6a-977d-539267d72816 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Acquiring lock "cinder-7f20fca9-c7c1-4819-82bf-a4d86c00017e-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:37:44 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-f84cf486-4426-4c6a-977d-539267d72816 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Lock "cinder-7f20fca9-c7c1-4819-82bf-a4d86c00017e-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:37:44 devstack sudo[105903]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:44 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e82d85c8-4098-45a0-882a-33b5fb416306 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c63fa010-30d6-42d8-ab10-04c4c913fb00" returned: 0 in 0.527s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:44 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e82d85c8-4098-45a0-882a-33b5fb416306 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c63fa010-30d6-42d8-ab10-04c4c913fb00 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:44 devstack sudo[105911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c63fa010-30d6-42d8-ab10-04c4c913fb00 Sep 16 20:37:44 devstack sudo[105911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:44 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-f84cf486-4426-4c6a-977d-539267d72816 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Acquiring lock "cinder-quobyte-7f20fca9-c7c1-4819-82bf-a4d86c00017e" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:37:44 devstack sudo[105906]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:44 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-be3a4ccc-aec9-4903-a4e8-d9cf0a720088 tempest-CreateVolumesFromSnapshotTest-1978168872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.337s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:44 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-be3a4ccc-aec9-4903-a4e8-d9cf0a720088 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:37:44 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-f84cf486-4426-4c6a-977d-539267d72816 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Lock "cinder-quobyte-7f20fca9-c7c1-4819-82bf-a4d86c00017e" acquired by "delete_volume" :: waited 0.030s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:37:44 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-be3a4ccc-aec9-4903-a4e8-d9cf0a720088 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Deleted volume successfully. Sep 16 20:37:44 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd4b2bb5-d237-4067-a585-f75393f10ade]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:37:44 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f84cf486-4426-4c6a-977d-539267d72816 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-7f20fca9-c7c1-4819-82bf-a4d86c00017e {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:44 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-be3a4ccc-aec9-4903-a4e8-d9cf0a720088 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Lock "cinder-933d099e-ae13-4acc-bdde-3c490b6ebeeb-delete_volume" released by "delete_volume" :: held 1.402s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:37:44 devstack sudo[105914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-7f20fca9-c7c1-4819-82bf-a4d86c00017e Sep 16 20:37:44 devstack sudo[105914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:45 devstack sudo[105911]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:45 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e82d85c8-4098-45a0-882a-33b5fb416306 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c63fa010-30d6-42d8-ab10-04c4c913fb00" returned: 0 in 0.420s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:45 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-e82d85c8-4098-45a0-882a-33b5fb416306 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Lock "cinder-quobyte-c63fa010-30d6-42d8-ab10-04c4c913fb00" released by "delete_volume" :: held 1.024s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:37:45 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-e82d85c8-4098-45a0-882a-33b5fb416306 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Created reservations ['43b53cac-41ce-4d86-bb6e-3fbd6728720a', 'b152857f-1d67-4fcf-96fc-691967f10eaf', 'b5d63687-f259-4013-82ed-1f387294ce14', '34d8a61f-8b3d-4e6d-ba1c-940e114a16b3'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:37:45 devstack sudo[105914]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:45 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f84cf486-4426-4c6a-977d-539267d72816 tempest-CreateVolumesFromSnapshotTest-1978168872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-7f20fca9-c7c1-4819-82bf-a4d86c00017e" returned: 0 in 0.436s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:45 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f84cf486-4426-4c6a-977d-539267d72816 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-7f20fca9-c7c1-4819-82bf-a4d86c00017e {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:45 devstack sudo[105920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-7f20fca9-c7c1-4819-82bf-a4d86c00017e Sep 16 20:37:45 devstack sudo[105920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:45 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-b638c53a-26a6-414b-b2ae-56736bbb10b6 tempest-VolumeDependencyTests-1304260226 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:37:45 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-e82d85c8-4098-45a0-882a-33b5fb416306 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:37:45 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-e82d85c8-4098-45a0-882a-33b5fb416306 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:37:45 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-e82d85c8-4098-45a0-882a-33b5fb416306 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:37:45 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-e82d85c8-4098-45a0-882a-33b5fb416306 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:37:45 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-e82d85c8-4098-45a0-882a-33b5fb416306 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:37:45 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e82d85c8-4098-45a0-882a-33b5fb416306 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:45 devstack sudo[105922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:37:45 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-b638c53a-26a6-414b-b2ae-56736bbb10b6 tempest-VolumeDependencyTests-1304260226 None] Flow 'volume_create_manager' (f11bedc8-9beb-4832-bd4f-d0dc6a20ba5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:37:45 devstack sudo[105922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:45 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-b638c53a-26a6-414b-b2ae-56736bbb10b6 tempest-VolumeDependencyTests-1304260226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27d96f05-7d79-4530-8a83-d02eb9e3ed4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:45 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-b638c53a-26a6-414b-b2ae-56736bbb10b6 tempest-VolumeDependencyTests-1304260226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27d96f05-7d79-4530-8a83-d02eb9e3ed4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:37:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2073372238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=805aa1e3-47ea-44d3-bf7f-54403b433ef8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='daa7e4ffb3754f54835be9f4502d53aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:37:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=fdaadeed-f2ce-49ba-933c-89b9cf3f493a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:37:45Z,use_quota=True,user_id='9c70e7ce17da4083a9e890b9e9a77a17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:45 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-b638c53a-26a6-414b-b2ae-56736bbb10b6 tempest-VolumeDependencyTests-1304260226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e7973f0-0eb1-4cc7-8667-12dab80e841d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:45 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-b638c53a-26a6-414b-b2ae-56736bbb10b6 tempest-VolumeDependencyTests-1304260226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e7973f0-0eb1-4cc7-8667-12dab80e841d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:45 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-b638c53a-26a6-414b-b2ae-56736bbb10b6 tempest-VolumeDependencyTests-1304260226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (463563ee-2a10-4d1d-8a28-4d3ee5c28d41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:45 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-b638c53a-26a6-414b-b2ae-56736bbb10b6 tempest-VolumeDependencyTests-1304260226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (463563ee-2a10-4d1d-8a28-4d3ee5c28d41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '805aa1e3-47ea-44d3-bf7f-54403b433ef8', 'volume_name': 'volume-805aa1e3-47ea-44d3-bf7f-54403b433ef8', 'volume_size': 1, 'snapshot_id': 'fdaadeed-f2ce-49ba-933c-89b9cf3f493a'}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:45 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-b638c53a-26a6-414b-b2ae-56736bbb10b6 tempest-VolumeDependencyTests-1304260226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a7a8163-6e2e-4b6e-a025-4651b215ab59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:45 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-b638c53a-26a6-414b-b2ae-56736bbb10b6 tempest-VolumeDependencyTests-1304260226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a7a8163-6e2e-4b6e-a025-4651b215ab59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:45 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-b638c53a-26a6-414b-b2ae-56736bbb10b6 tempest-VolumeDependencyTests-1304260226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6ceb3d0-2ea4-4302-b3a2-29b30713b1d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:45 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-b638c53a-26a6-414b-b2ae-56736bbb10b6 tempest-VolumeDependencyTests-1304260226 None] Volume 805aa1e3-47ea-44d3-bf7f-54403b433ef8: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-805aa1e3-47ea-44d3-bf7f-54403b433ef8', 'volume_size': 1, 'snapshot_id': 'fdaadeed-f2ce-49ba-933c-89b9cf3f493a'} Sep 16 20:37:45 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-b638c53a-26a6-414b-b2ae-56736bbb10b6 tempest-VolumeDependencyTests-1304260226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:37:45 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-b638c53a-26a6-414b-b2ae-56736bbb10b6 tempest-VolumeDependencyTests-1304260226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:37:45 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-b638c53a-26a6-414b-b2ae-56736bbb10b6 tempest-VolumeDependencyTests-1304260226 None] Acquiring lock "cinder-quobyte-fdaadeed-f2ce-49ba-933c-89b9cf3f493a-805aa1e3-47ea-44d3-bf7f-54403b433ef8" by "_create_volume_from_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:37:45 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-b638c53a-26a6-414b-b2ae-56736bbb10b6 tempest-VolumeDependencyTests-1304260226 None] Lock "cinder-quobyte-fdaadeed-f2ce-49ba-933c-89b9cf3f493a-805aa1e3-47ea-44d3-bf7f-54403b433ef8" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:37:45 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-b638c53a-26a6-414b-b2ae-56736bbb10b6 tempest-VolumeDependencyTests-1304260226 None] Creating volume 805aa1e3-47ea-44d3-bf7f-54403b433ef8 from snapshot fdaadeed-f2ce-49ba-933c-89b9cf3f493a {{(pid=86188) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 16 20:37:45 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-b638c53a-26a6-414b-b2ae-56736bbb10b6 tempest-VolumeDependencyTests-1304260226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:37:45 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-b638c53a-26a6-414b-b2ae-56736bbb10b6 tempest-VolumeDependencyTests-1304260226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:37:45 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-b638c53a-26a6-414b-b2ae-56736bbb10b6 tempest-VolumeDependencyTests-1304260226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:37:45 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-b638c53a-26a6-414b-b2ae-56736bbb10b6 tempest-VolumeDependencyTests-1304260226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:37:45 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-b638c53a-26a6-414b-b2ae-56736bbb10b6 tempest-VolumeDependencyTests-1304260226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:37:45 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-b638c53a-26a6-414b-b2ae-56736bbb10b6 tempest-VolumeDependencyTests-1304260226 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:37:45 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-b638c53a-26a6-414b-b2ae-56736bbb10b6 tempest-VolumeDependencyTests-1304260226 None] Acquiring lock "cinder-quobyte-805aa1e3-47ea-44d3-bf7f-54403b433ef8" by "_copy_volume_from_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:37:45 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-b638c53a-26a6-414b-b2ae-56736bbb10b6 tempest-VolumeDependencyTests-1304260226 None] Lock "cinder-quobyte-805aa1e3-47ea-44d3-bf7f-54403b433ef8" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:37:45 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-b638c53a-26a6-414b-b2ae-56736bbb10b6 tempest-VolumeDependencyTests-1304260226 None] snapshot: fdaadeed-f2ce-49ba-933c-89b9cf3f493a, volume: 805aa1e3-47ea-44d3-bf7f-54403b433ef8, {{(pid=86188) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 16 20:37:45 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-b638c53a-26a6-414b-b2ae-56736bbb10b6 tempest-VolumeDependencyTests-1304260226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:37:45 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-b638c53a-26a6-414b-b2ae-56736bbb10b6 tempest-VolumeDependencyTests-1304260226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:37:45 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-b638c53a-26a6-414b-b2ae-56736bbb10b6 tempest-VolumeDependencyTests-1304260226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:37:45 devstack sudo[105920]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:45 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-b638c53a-26a6-414b-b2ae-56736bbb10b6 tempest-VolumeDependencyTests-1304260226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:37:45 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-b638c53a-26a6-414b-b2ae-56736bbb10b6 tempest-VolumeDependencyTests-1304260226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:37:45 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f84cf486-4426-4c6a-977d-539267d72816 tempest-CreateVolumesFromSnapshotTest-1978168872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-7f20fca9-c7c1-4819-82bf-a4d86c00017e" returned: 0 in 0.314s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:45 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3d9e6a5-0176-4122-a0a8-c8d311fd842e]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:37:45 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b638c53a-26a6-414b-b2ae-56736bbb10b6 tempest-VolumeDependencyTests-1304260226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-098c751a-2f07-49fd-9d90-2493c701313e.fdaadeed-f2ce-49ba-933c-89b9cf3f493a {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:45 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-f84cf486-4426-4c6a-977d-539267d72816 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Lock "cinder-quobyte-7f20fca9-c7c1-4819-82bf-a4d86c00017e" released by "delete_volume" :: held 0.826s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:37:45 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-f84cf486-4426-4c6a-977d-539267d72816 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Created reservations ['21aed8b9-23c0-4ac0-9d53-5391ef563a6b', '8d9d1388-27ea-424e-8d76-f733b7c73b76', '3aedf895-f2bc-4956-acb7-f3a53e84731f', 'a5d1435a-7805-4493-bf06-3d80ce829aa5'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:37:45 devstack sudo[105922]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:45 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e82d85c8-4098-45a0-882a-33b5fb416306 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.332s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:45 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-e82d85c8-4098-45a0-882a-33b5fb416306 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:37:45 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-e82d85c8-4098-45a0-882a-33b5fb416306 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Deleted volume successfully. Sep 16 20:37:45 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-e82d85c8-4098-45a0-882a-33b5fb416306 tempest-CreateVolumesFromSourceVolumeTest-205230560 None] Lock "cinder-c63fa010-30d6-42d8-ab10-04c4c913fb00-delete_volume" released by "delete_volume" :: held 1.748s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:37:45 devstack sudo[105925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-098c751a-2f07-49fd-9d90-2493c701313e.fdaadeed-f2ce-49ba-933c-89b9cf3f493a Sep 16 20:37:45 devstack sudo[105925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:45 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-f84cf486-4426-4c6a-977d-539267d72816 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:37:45 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-f84cf486-4426-4c6a-977d-539267d72816 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:37:45 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-f84cf486-4426-4c6a-977d-539267d72816 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:37:45 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-f84cf486-4426-4c6a-977d-539267d72816 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:37:45 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-f84cf486-4426-4c6a-977d-539267d72816 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:37:45 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f84cf486-4426-4c6a-977d-539267d72816 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:45 devstack sudo[105928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:37:45 devstack sudo[105928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:45 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-25cea8af-3123-482e-ad52-2b447e81185c tempest-CreateVolumesFromSnapshotTest-1978168872 None] Acquiring lock "cinder-2ee02ef4-0fcd-4505-9f09-2fd3c172b112-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:37:45 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-25cea8af-3123-482e-ad52-2b447e81185c tempest-CreateVolumesFromSnapshotTest-1978168872 None] Lock "cinder-2ee02ef4-0fcd-4505-9f09-2fd3c172b112-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:37:45 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-25cea8af-3123-482e-ad52-2b447e81185c tempest-CreateVolumesFromSnapshotTest-1978168872 None] Acquiring lock "cinder-quobyte-2ee02ef4-0fcd-4505-9f09-2fd3c172b112" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:37:45 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-25cea8af-3123-482e-ad52-2b447e81185c tempest-CreateVolumesFromSnapshotTest-1978168872 None] Lock "cinder-quobyte-2ee02ef4-0fcd-4505-9f09-2fd3c172b112" acquired by "delete_volume" :: waited 0.028s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:37:46 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[b50e5c0d-0319-453e-960c-9353f8cdfd2c]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:37:46 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-25cea8af-3123-482e-ad52-2b447e81185c tempest-CreateVolumesFromSnapshotTest-1978168872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-2ee02ef4-0fcd-4505-9f09-2fd3c172b112 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:46 devstack sudo[105925]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:46 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b638c53a-26a6-414b-b2ae-56736bbb10b6 tempest-VolumeDependencyTests-1304260226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-098c751a-2f07-49fd-9d90-2493c701313e.fdaadeed-f2ce-49ba-933c-89b9cf3f493a" returned: 0 in 0.477s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:46 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-b638c53a-26a6-414b-b2ae-56736bbb10b6 tempest-VolumeDependencyTests-1304260226 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-098c751a-2f07-49fd-9d90-2493c701313e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86188) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 20:37:46 devstack sudo[105928]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:46 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f84cf486-4426-4c6a-977d-539267d72816 tempest-CreateVolumesFromSnapshotTest-1978168872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.347s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:46 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-f84cf486-4426-4c6a-977d-539267d72816 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:37:46 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fe46c95-f65f-4ded-bdf7-3f721ef63ce3]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:37:46 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b638c53a-26a6-414b-b2ae-56736bbb10b6 tempest-VolumeDependencyTests-1304260226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-098c751a-2f07-49fd-9d90-2493c701313e {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:46 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-f84cf486-4426-4c6a-977d-539267d72816 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Deleted volume successfully. Sep 16 20:37:46 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-f84cf486-4426-4c6a-977d-539267d72816 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Lock "cinder-7f20fca9-c7c1-4819-82bf-a4d86c00017e-delete_volume" released by "delete_volume" :: held 1.533s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:37:46 devstack sudo[105933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-2ee02ef4-0fcd-4505-9f09-2fd3c172b112 Sep 16 20:37:46 devstack sudo[105933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:46 devstack sudo[105937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-098c751a-2f07-49fd-9d90-2493c701313e Sep 16 20:37:46 devstack sudo[105937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:46 devstack sudo[105933]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:46 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-25cea8af-3123-482e-ad52-2b447e81185c tempest-CreateVolumesFromSnapshotTest-1978168872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-2ee02ef4-0fcd-4505-9f09-2fd3c172b112" returned: 0 in 0.514s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:46 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-25cea8af-3123-482e-ad52-2b447e81185c tempest-CreateVolumesFromSnapshotTest-1978168872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-2ee02ef4-0fcd-4505-9f09-2fd3c172b112 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:46 devstack sudo[105937]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:46 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b638c53a-26a6-414b-b2ae-56736bbb10b6 tempest-VolumeDependencyTests-1304260226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-098c751a-2f07-49fd-9d90-2493c701313e" returned: 0 in 0.468s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:46 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-b638c53a-26a6-414b-b2ae-56736bbb10b6 tempest-VolumeDependencyTests-1304260226 None] will copy from snapshot at /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-098c751a-2f07-49fd-9d90-2493c701313e {{(pid=86188) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 16 20:37:46 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-b638c53a-26a6-414b-b2ae-56736bbb10b6 tempest-VolumeDependencyTests-1304260226 None] Creating direct copy from snapshot {{(pid=86188) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 16 20:37:46 devstack sudo[105946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-2ee02ef4-0fcd-4505-9f09-2fd3c172b112 Sep 16 20:37:46 devstack sudo[105946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:46 devstack cinder-volume[86188]: DEBUG cinder.utils [None req-b638c53a-26a6-414b-b2ae-56736bbb10b6 tempest-VolumeDependencyTests-1304260226 None] Path /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-805aa1e3-47ea-44d3-bf7f-54403b433ef8 not found in is_blk_device check {{(pid=86188) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 16 20:37:46 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b638c53a-26a6-414b-b2ae-56736bbb10b6 tempest-VolumeDependencyTests-1304260226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-098c751a-2f07-49fd-9d90-2493c701313e /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-805aa1e3-47ea-44d3-bf7f-54403b433ef8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:46 devstack sudo[105948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-098c751a-2f07-49fd-9d90-2493c701313e /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-805aa1e3-47ea-44d3-bf7f-54403b433ef8 Sep 16 20:37:46 devstack sudo[105948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:46 devstack sudo[105946]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:46 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-25cea8af-3123-482e-ad52-2b447e81185c tempest-CreateVolumesFromSnapshotTest-1978168872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-2ee02ef4-0fcd-4505-9f09-2fd3c172b112" returned: 0 in 0.284s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:46 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-25cea8af-3123-482e-ad52-2b447e81185c tempest-CreateVolumesFromSnapshotTest-1978168872 None] Lock "cinder-quobyte-2ee02ef4-0fcd-4505-9f09-2fd3c172b112" released by "delete_volume" :: held 0.860s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:37:46 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-25cea8af-3123-482e-ad52-2b447e81185c tempest-CreateVolumesFromSnapshotTest-1978168872 None] Created reservations ['e3d74387-4948-4558-b0af-ed48e4180e00', '91bd96e2-2942-4c5f-853f-29337c2d8fbe', '2220f014-8631-4ad8-9be7-1b86108e0c14', '0283408e-4c26-4bd4-9799-c8de315bce96'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:37:46 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-25cea8af-3123-482e-ad52-2b447e81185c tempest-CreateVolumesFromSnapshotTest-1978168872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:37:46 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-25cea8af-3123-482e-ad52-2b447e81185c tempest-CreateVolumesFromSnapshotTest-1978168872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:37:46 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-25cea8af-3123-482e-ad52-2b447e81185c tempest-CreateVolumesFromSnapshotTest-1978168872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:37:47 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-25cea8af-3123-482e-ad52-2b447e81185c tempest-CreateVolumesFromSnapshotTest-1978168872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:37:47 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-25cea8af-3123-482e-ad52-2b447e81185c tempest-CreateVolumesFromSnapshotTest-1978168872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:37:47 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-25cea8af-3123-482e-ad52-2b447e81185c tempest-CreateVolumesFromSnapshotTest-1978168872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:47 devstack sudo[105954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:37:47 devstack sudo[105954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:47 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-30023735-a43f-46ac-aa0b-8ad5049edd76 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Acquiring lock "cinder-99bbf506-f00a-4e50-80f0-3f53881a333f-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:37:47 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-30023735-a43f-46ac-aa0b-8ad5049edd76 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Lock "cinder-99bbf506-f00a-4e50-80f0-3f53881a333f-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:37:47 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-30023735-a43f-46ac-aa0b-8ad5049edd76 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Acquiring lock "cinder-quobyte-99bbf506-f00a-4e50-80f0-3f53881a333f" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:37:47 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-30023735-a43f-46ac-aa0b-8ad5049edd76 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Lock "cinder-quobyte-99bbf506-f00a-4e50-80f0-3f53881a333f" acquired by "delete_volume" :: waited 0.036s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:37:47 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[0776e490-a3f3-4102-9a07-9f673886026a]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:37:47 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-30023735-a43f-46ac-aa0b-8ad5049edd76 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-99bbf506-f00a-4e50-80f0-3f53881a333f {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:47 devstack sudo[105959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-99bbf506-f00a-4e50-80f0-3f53881a333f Sep 16 20:37:47 devstack sudo[105959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:47 devstack sudo[105954]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:47 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-25cea8af-3123-482e-ad52-2b447e81185c tempest-CreateVolumesFromSnapshotTest-1978168872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.654s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:47 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-25cea8af-3123-482e-ad52-2b447e81185c tempest-CreateVolumesFromSnapshotTest-1978168872 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:37:47 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-25cea8af-3123-482e-ad52-2b447e81185c tempest-CreateVolumesFromSnapshotTest-1978168872 None] Deleted volume successfully. Sep 16 20:37:47 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-25cea8af-3123-482e-ad52-2b447e81185c tempest-CreateVolumesFromSnapshotTest-1978168872 None] Lock "cinder-2ee02ef4-0fcd-4505-9f09-2fd3c172b112-delete_volume" released by "delete_volume" :: held 1.824s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:37:48 devstack sudo[105959]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:48 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-30023735-a43f-46ac-aa0b-8ad5049edd76 tempest-CreateVolumesFromSnapshotTest-1978168872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-99bbf506-f00a-4e50-80f0-3f53881a333f" returned: 0 in 0.961s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:48 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-30023735-a43f-46ac-aa0b-8ad5049edd76 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-99bbf506-f00a-4e50-80f0-3f53881a333f {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:48 devstack sudo[105971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-99bbf506-f00a-4e50-80f0-3f53881a333f Sep 16 20:37:48 devstack sudo[105971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:48 devstack sudo[105971]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:48 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-30023735-a43f-46ac-aa0b-8ad5049edd76 tempest-CreateVolumesFromSnapshotTest-1978168872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-99bbf506-f00a-4e50-80f0-3f53881a333f" returned: 0 in 0.592s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:48 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-30023735-a43f-46ac-aa0b-8ad5049edd76 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Lock "cinder-quobyte-99bbf506-f00a-4e50-80f0-3f53881a333f" released by "delete_volume" :: held 1.658s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:37:48 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-30023735-a43f-46ac-aa0b-8ad5049edd76 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Created reservations ['5c30d234-8698-4005-8fd2-4e5faf9611ce', 'f786c14d-ff9a-475e-9301-090e814c863b', '24f5a9f3-95c0-4bda-8371-bf43bf087db4', '62db6223-c027-4ec6-811b-cc1dfb4aa6d3'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:37:49 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-30023735-a43f-46ac-aa0b-8ad5049edd76 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:37:49 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-30023735-a43f-46ac-aa0b-8ad5049edd76 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:37:49 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-30023735-a43f-46ac-aa0b-8ad5049edd76 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:37:49 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-30023735-a43f-46ac-aa0b-8ad5049edd76 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:37:49 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-30023735-a43f-46ac-aa0b-8ad5049edd76 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:37:49 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-30023735-a43f-46ac-aa0b-8ad5049edd76 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:49 devstack sudo[105974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:37:49 devstack sudo[105974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:49 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-b2f0b2b9-08cc-4461-90f1-770b6eebdff9 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Acquiring lock "cinder-889e5b91-2bf0-4f43-9e3a-e55a5c189562-delete_snapshot" by "delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:37:49 devstack sudo[105974]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:49 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-30023735-a43f-46ac-aa0b-8ad5049edd76 tempest-CreateVolumesFromSnapshotTest-1978168872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.574s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:49 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-30023735-a43f-46ac-aa0b-8ad5049edd76 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:37:49 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-b2f0b2b9-08cc-4461-90f1-770b6eebdff9 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Lock "cinder-889e5b91-2bf0-4f43-9e3a-e55a5c189562-delete_snapshot" acquired by "delete_snapshot" :: waited 0.059s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:37:49 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-b2f0b2b9-08cc-4461-90f1-770b6eebdff9 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Acquiring lock "cinder-quobyte-ae09469c-8d27-4806-ac32-eac559656845" by "delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:37:49 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-30023735-a43f-46ac-aa0b-8ad5049edd76 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Deleted volume successfully. Sep 16 20:37:49 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-b2f0b2b9-08cc-4461-90f1-770b6eebdff9 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Lock "cinder-quobyte-ae09469c-8d27-4806-ac32-eac559656845" acquired by "delete_snapshot" :: waited 0.054s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:37:49 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-b2f0b2b9-08cc-4461-90f1-770b6eebdff9 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Acquiring lock "cinder-quobyte-889e5b91-2bf0-4f43-9e3a-e55a5c189562" by "_delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:37:49 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-30023735-a43f-46ac-aa0b-8ad5049edd76 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Lock "cinder-99bbf506-f00a-4e50-80f0-3f53881a333f-delete_volume" released by "delete_volume" :: held 2.708s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:37:49 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-b2f0b2b9-08cc-4461-90f1-770b6eebdff9 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Lock "cinder-quobyte-889e5b91-2bf0-4f43-9e3a-e55a5c189562" acquired by "_delete_snapshot" :: waited 0.042s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:37:49 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-b2f0b2b9-08cc-4461-90f1-770b6eebdff9 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Deleting offline snapshot 889e5b91-2bf0-4f43-9e3a-e55a5c189562 of volume ae09469c-8d27-4806-ac32-eac559656845 {{(pid=86188) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 20:37:49 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-b2f0b2b9-08cc-4461-90f1-770b6eebdff9 tempest-CreateVolumesFromSnapshotTest-1978168872 None] snapshot_file for this snap is: volume-ae09469c-8d27-4806-ac32-eac559656845.889e5b91-2bf0-4f43-9e3a-e55a5c189562 {{(pid=86188) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 20:37:49 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[a90ca133-481b-4668-a422-1f2ce5b97995]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:37:49 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b2f0b2b9-08cc-4461-90f1-770b6eebdff9 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ae09469c-8d27-4806-ac32-eac559656845.889e5b91-2bf0-4f43-9e3a-e55a5c189562 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:50 devstack sudo[105978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ae09469c-8d27-4806-ac32-eac559656845.889e5b91-2bf0-4f43-9e3a-e55a5c189562 Sep 16 20:37:50 devstack sudo[105978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:50 devstack sudo[105978]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:50 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b2f0b2b9-08cc-4461-90f1-770b6eebdff9 tempest-CreateVolumesFromSnapshotTest-1978168872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ae09469c-8d27-4806-ac32-eac559656845.889e5b91-2bf0-4f43-9e3a-e55a5c189562" returned: 0 in 0.867s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:50 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-b2f0b2b9-08cc-4461-90f1-770b6eebdff9 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ae09469c-8d27-4806-ac32-eac559656845(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86188) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 20:37:50 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[654ef816-c0b3-4a49-8bc1-e109fd1984d2]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:37:50 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b2f0b2b9-08cc-4461-90f1-770b6eebdff9 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ae09469c-8d27-4806-ac32-eac559656845 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:51 devstack sudo[105983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ae09469c-8d27-4806-ac32-eac559656845 Sep 16 20:37:51 devstack sudo[105983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:51 devstack sudo[105983]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:51 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b2f0b2b9-08cc-4461-90f1-770b6eebdff9 tempest-CreateVolumesFromSnapshotTest-1978168872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ae09469c-8d27-4806-ac32-eac559656845" returned: 0 in 0.898s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:51 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b2f0b2b9-08cc-4461-90f1-770b6eebdff9 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ae09469c-8d27-4806-ac32-eac559656845.889e5b91-2bf0-4f43-9e3a-e55a5c189562 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:51 devstack sudo[105988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ae09469c-8d27-4806-ac32-eac559656845.889e5b91-2bf0-4f43-9e3a-e55a5c189562 Sep 16 20:37:51 devstack sudo[105988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:52 devstack sudo[105988]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:52 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b2f0b2b9-08cc-4461-90f1-770b6eebdff9 tempest-CreateVolumesFromSnapshotTest-1978168872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ae09469c-8d27-4806-ac32-eac559656845.889e5b91-2bf0-4f43-9e3a-e55a5c189562" returned: 0 in 0.876s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:52 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b2f0b2b9-08cc-4461-90f1-770b6eebdff9 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ae09469c-8d27-4806-ac32-eac559656845.889e5b91-2bf0-4f43-9e3a-e55a5c189562 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:52 devstack sudo[105993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ae09469c-8d27-4806-ac32-eac559656845.889e5b91-2bf0-4f43-9e3a-e55a5c189562 Sep 16 20:37:52 devstack sudo[105993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:53 devstack cinder-volume[86188]: DEBUG oslo_service.periodic_task [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86188) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 20:37:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:37:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:37:53 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:37:53 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:37:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:37:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:53 devstack sudo[105993]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:53 devstack sudo[105996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:37:53 devstack sudo[105996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b2f0b2b9-08cc-4461-90f1-770b6eebdff9 tempest-CreateVolumesFromSnapshotTest-1978168872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ae09469c-8d27-4806-ac32-eac559656845.889e5b91-2bf0-4f43-9e3a-e55a5c189562" returned: 0 in 0.456s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:53 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-b2f0b2b9-08cc-4461-90f1-770b6eebdff9 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Lock "cinder-quobyte-889e5b91-2bf0-4f43-9e3a-e55a5c189562" released by "_delete_snapshot" :: held 3.473s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:37:53 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-b2f0b2b9-08cc-4461-90f1-770b6eebdff9 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Lock "cinder-quobyte-ae09469c-8d27-4806-ac32-eac559656845" released by "delete_snapshot" :: held 3.547s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:37:53 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-b2f0b2b9-08cc-4461-90f1-770b6eebdff9 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Created reservations ['3c01e472-7459-46da-8566-8406d3c8878d', '1a3f5794-dc29-4e16-9698-9750b35d4b77', '0c036644-d853-4158-b368-6be94c285ceb', 'd32bca5d-f185-4c80-abc9-9df220329f49'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:37:53 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-b2f0b2b9-08cc-4461-90f1-770b6eebdff9 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Delete snapshot completed successfully. Sep 16 20:37:53 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-b2f0b2b9-08cc-4461-90f1-770b6eebdff9 tempest-CreateVolumesFromSnapshotTest-1978168872 None] Lock "cinder-889e5b91-2bf0-4f43-9e3a-e55a5c189562-delete_snapshot" released by "delete_snapshot" :: held 3.942s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:37:53 devstack sudo[105996]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.676s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:53 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:37:53 devstack cinder-volume[86188]: DEBUG oslo_service.periodic_task [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Running periodic task VolumeManager._thread_info {{(pid=86188) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 20:37:53 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] thread count: 28 {{(pid=86188) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 16 20:37:53 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] thread info: [<_MainThread(MainThread, started 139858124406912)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86188) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 16 20:37:54 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-2b7eeb01-bedc-477c-bd8f-1a806f08ee4e tempest-CreateVolumesFromSnapshotTest-1978168872 None] Acquiring lock "cinder-ae09469c-8d27-4806-ac32-eac559656845-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:37:54 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-2b7eeb01-bedc-477c-bd8f-1a806f08ee4e tempest-CreateVolumesFromSnapshotTest-1978168872 None] Lock "cinder-ae09469c-8d27-4806-ac32-eac559656845-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:37:54 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-2b7eeb01-bedc-477c-bd8f-1a806f08ee4e tempest-CreateVolumesFromSnapshotTest-1978168872 None] Acquiring lock "cinder-quobyte-ae09469c-8d27-4806-ac32-eac559656845" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:37:54 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-2b7eeb01-bedc-477c-bd8f-1a806f08ee4e tempest-CreateVolumesFromSnapshotTest-1978168872 None] Lock "cinder-quobyte-ae09469c-8d27-4806-ac32-eac559656845" acquired by "delete_volume" :: waited 0.035s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:37:54 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[219d22a7-5283-4f81-82bd-fe87d07c99c6]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:37:54 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-2b7eeb01-bedc-477c-bd8f-1a806f08ee4e tempest-CreateVolumesFromSnapshotTest-1978168872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ae09469c-8d27-4806-ac32-eac559656845 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:54 devstack sudo[105999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ae09469c-8d27-4806-ac32-eac559656845 Sep 16 20:37:54 devstack sudo[105999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:55 devstack sudo[105999]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:55 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-2b7eeb01-bedc-477c-bd8f-1a806f08ee4e tempest-CreateVolumesFromSnapshotTest-1978168872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ae09469c-8d27-4806-ac32-eac559656845" returned: 0 in 0.719s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:55 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-2b7eeb01-bedc-477c-bd8f-1a806f08ee4e tempest-CreateVolumesFromSnapshotTest-1978168872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ae09469c-8d27-4806-ac32-eac559656845 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:55 devstack sudo[105948]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:55 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b638c53a-26a6-414b-b2ae-56736bbb10b6 tempest-VolumeDependencyTests-1304260226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-098c751a-2f07-49fd-9d90-2493c701313e /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-805aa1e3-47ea-44d3-bf7f-54403b433ef8" returned: 0 in 8.731s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:55 devstack cinder-volume[86188]: DEBUG cinder.image.image_utils [None req-b638c53a-26a6-414b-b2ae-56736bbb10b6 tempest-VolumeDependencyTests-1304260226 None] Image conversion details: src /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-098c751a-2f07-49fd-9d90-2493c701313e, size 1024.00 MB, duration 8.73 sec, destination /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-805aa1e3-47ea-44d3-bf7f-54403b433ef8 {{(pid=86188) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 16 20:37:55 devstack cinder-volume[86188]: INFO cinder.image.image_utils [None req-b638c53a-26a6-414b-b2ae-56736bbb10b6 tempest-VolumeDependencyTests-1304260226 None] Converted 1024.00 MB image at 117.24 MB/s Sep 16 20:37:55 devstack cinder-volume[86188]: WARNING cinder.volume.drivers.remotefs [None req-b638c53a-26a6-414b-b2ae-56736bbb10b6 tempest-VolumeDependencyTests-1304260226 None] /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-805aa1e3-47ea-44d3-bf7f-54403b433ef8 is being set with open permissions: ugo+rw Sep 16 20:37:55 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b638c53a-26a6-414b-b2ae-56736bbb10b6 tempest-VolumeDependencyTests-1304260226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-805aa1e3-47ea-44d3-bf7f-54403b433ef8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:55 devstack sudo[106004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ae09469c-8d27-4806-ac32-eac559656845 Sep 16 20:37:55 devstack sudo[106004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:55 devstack sudo[106005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-805aa1e3-47ea-44d3-bf7f-54403b433ef8 Sep 16 20:37:55 devstack sudo[106005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:55 devstack sudo[106004]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:55 devstack sudo[106005]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:55 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-2b7eeb01-bedc-477c-bd8f-1a806f08ee4e tempest-CreateVolumesFromSnapshotTest-1978168872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ae09469c-8d27-4806-ac32-eac559656845" returned: 0 in 0.327s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:55 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b638c53a-26a6-414b-b2ae-56736bbb10b6 tempest-VolumeDependencyTests-1304260226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-805aa1e3-47ea-44d3-bf7f-54403b433ef8" returned: 0 in 0.325s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:55 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-2b7eeb01-bedc-477c-bd8f-1a806f08ee4e tempest-CreateVolumesFromSnapshotTest-1978168872 None] Lock "cinder-quobyte-ae09469c-8d27-4806-ac32-eac559656845" released by "delete_volume" :: held 1.221s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:37:55 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-b638c53a-26a6-414b-b2ae-56736bbb10b6 tempest-VolumeDependencyTests-1304260226 None] Lock "cinder-quobyte-805aa1e3-47ea-44d3-bf7f-54403b433ef8" released by "_copy_volume_from_snapshot" :: held 10.144s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:37:55 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-b638c53a-26a6-414b-b2ae-56736bbb10b6 tempest-VolumeDependencyTests-1304260226 None] Lock "cinder-quobyte-fdaadeed-f2ce-49ba-933c-89b9cf3f493a-805aa1e3-47ea-44d3-bf7f-54403b433ef8" released by "_create_volume_from_snapshot" :: held 10.239s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:37:55 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-b638c53a-26a6-414b-b2ae-56736bbb10b6 tempest-VolumeDependencyTests-1304260226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.257s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:37:55 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-2b7eeb01-bedc-477c-bd8f-1a806f08ee4e tempest-CreateVolumesFromSnapshotTest-1978168872 None] Created reservations ['dff9d8b7-0265-43f0-a880-f52708d7909e', '6d42ac89-1906-4444-9bd0-33dc6678f477', 'f1096cd1-471c-4baf-a45b-07d3ba300316', 'b1cb521c-0188-44f9-af5b-80cb4e9332d2'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:37:55 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-b638c53a-26a6-414b-b2ae-56736bbb10b6 tempest-VolumeDependencyTests-1304260226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6ceb3d0-2ea4-4302-b3a2-29b30713b1d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-805aa1e3-47ea-44d3-bf7f-54403b433ef8', 'volume_size': 1, 'snapshot_id': 'fdaadeed-f2ce-49ba-933c-89b9cf3f493a'}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:55 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-b638c53a-26a6-414b-b2ae-56736bbb10b6 tempest-VolumeDependencyTests-1304260226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0817d1ec-2403-4581-9126-48a543d44039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:37:55 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-b638c53a-26a6-414b-b2ae-56736bbb10b6 tempest-VolumeDependencyTests-1304260226 None] Volume volume-805aa1e3-47ea-44d3-bf7f-54403b433ef8 (805aa1e3-47ea-44d3-bf7f-54403b433ef8): created successfully Sep 16 20:37:55 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-b638c53a-26a6-414b-b2ae-56736bbb10b6 tempest-VolumeDependencyTests-1304260226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0817d1ec-2403-4581-9126-48a543d44039) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:37:55 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-b638c53a-26a6-414b-b2ae-56736bbb10b6 tempest-VolumeDependencyTests-1304260226 None] Flow 'volume_create_manager' (f11bedc8-9beb-4832-bd4f-d0dc6a20ba5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:37:55 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-b638c53a-26a6-414b-b2ae-56736bbb10b6 tempest-VolumeDependencyTests-1304260226 None] Created volume successfully. Sep 16 20:37:55 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-2b7eeb01-bedc-477c-bd8f-1a806f08ee4e tempest-CreateVolumesFromSnapshotTest-1978168872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:37:55 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-2b7eeb01-bedc-477c-bd8f-1a806f08ee4e tempest-CreateVolumesFromSnapshotTest-1978168872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:37:55 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-2b7eeb01-bedc-477c-bd8f-1a806f08ee4e tempest-CreateVolumesFromSnapshotTest-1978168872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:37:55 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-2b7eeb01-bedc-477c-bd8f-1a806f08ee4e tempest-CreateVolumesFromSnapshotTest-1978168872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:37:55 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-2b7eeb01-bedc-477c-bd8f-1a806f08ee4e tempest-CreateVolumesFromSnapshotTest-1978168872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:37:55 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-2b7eeb01-bedc-477c-bd8f-1a806f08ee4e tempest-CreateVolumesFromSnapshotTest-1978168872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:55 devstack sudo[106010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:37:55 devstack sudo[106010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:56 devstack sudo[106010]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:56 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-2b7eeb01-bedc-477c-bd8f-1a806f08ee4e tempest-CreateVolumesFromSnapshotTest-1978168872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.250s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:56 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-2b7eeb01-bedc-477c-bd8f-1a806f08ee4e tempest-CreateVolumesFromSnapshotTest-1978168872 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:37:56 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-2b7eeb01-bedc-477c-bd8f-1a806f08ee4e tempest-CreateVolumesFromSnapshotTest-1978168872 None] Deleted volume successfully. Sep 16 20:37:56 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-2b7eeb01-bedc-477c-bd8f-1a806f08ee4e tempest-CreateVolumesFromSnapshotTest-1978168872 None] Lock "cinder-ae09469c-8d27-4806-ac32-eac559656845-delete_volume" released by "delete_volume" :: held 1.859s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:37:56 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-81cf1720-acf3-4fda-89cd-794c394213be tempest-VolumeDependencyTests-1304260226 None] Acquiring lock "cinder-fdaadeed-f2ce-49ba-933c-89b9cf3f493a-delete_snapshot" by "delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:37:56 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-81cf1720-acf3-4fda-89cd-794c394213be tempest-VolumeDependencyTests-1304260226 None] Lock "cinder-fdaadeed-f2ce-49ba-933c-89b9cf3f493a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:37:56 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-81cf1720-acf3-4fda-89cd-794c394213be tempest-VolumeDependencyTests-1304260226 None] Acquiring lock "cinder-quobyte-098c751a-2f07-49fd-9d90-2493c701313e" by "delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:37:56 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-81cf1720-acf3-4fda-89cd-794c394213be tempest-VolumeDependencyTests-1304260226 None] Lock "cinder-quobyte-098c751a-2f07-49fd-9d90-2493c701313e" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:37:56 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-81cf1720-acf3-4fda-89cd-794c394213be tempest-VolumeDependencyTests-1304260226 None] Acquiring lock "cinder-quobyte-fdaadeed-f2ce-49ba-933c-89b9cf3f493a" by "_delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:37:56 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-81cf1720-acf3-4fda-89cd-794c394213be tempest-VolumeDependencyTests-1304260226 None] Lock "cinder-quobyte-fdaadeed-f2ce-49ba-933c-89b9cf3f493a" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:37:56 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-81cf1720-acf3-4fda-89cd-794c394213be tempest-VolumeDependencyTests-1304260226 None] Deleting offline snapshot fdaadeed-f2ce-49ba-933c-89b9cf3f493a of volume 098c751a-2f07-49fd-9d90-2493c701313e {{(pid=86188) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 20:37:56 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-81cf1720-acf3-4fda-89cd-794c394213be tempest-VolumeDependencyTests-1304260226 None] snapshot_file for this snap is: volume-098c751a-2f07-49fd-9d90-2493c701313e.fdaadeed-f2ce-49ba-933c-89b9cf3f493a {{(pid=86188) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 20:37:56 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[c25c0526-1b71-4c7f-8a61-e2e514af9db1]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:37:56 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-81cf1720-acf3-4fda-89cd-794c394213be tempest-VolumeDependencyTests-1304260226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-098c751a-2f07-49fd-9d90-2493c701313e.fdaadeed-f2ce-49ba-933c-89b9cf3f493a {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:56 devstack sudo[106013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-098c751a-2f07-49fd-9d90-2493c701313e.fdaadeed-f2ce-49ba-933c-89b9cf3f493a Sep 16 20:37:56 devstack sudo[106013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:57 devstack sudo[106013]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:57 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-81cf1720-acf3-4fda-89cd-794c394213be tempest-VolumeDependencyTests-1304260226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-098c751a-2f07-49fd-9d90-2493c701313e.fdaadeed-f2ce-49ba-933c-89b9cf3f493a" returned: 0 in 0.382s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:57 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-81cf1720-acf3-4fda-89cd-794c394213be tempest-VolumeDependencyTests-1304260226 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-098c751a-2f07-49fd-9d90-2493c701313e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86188) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 20:37:57 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[86145a37-39b1-4ab2-a731-9da5755fd062]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:37:57 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-81cf1720-acf3-4fda-89cd-794c394213be tempest-VolumeDependencyTests-1304260226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-098c751a-2f07-49fd-9d90-2493c701313e {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:57 devstack sudo[106021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-098c751a-2f07-49fd-9d90-2493c701313e Sep 16 20:37:57 devstack sudo[106021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:58 devstack sudo[106021]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:58 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-81cf1720-acf3-4fda-89cd-794c394213be tempest-VolumeDependencyTests-1304260226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-098c751a-2f07-49fd-9d90-2493c701313e" returned: 0 in 0.739s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:58 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-81cf1720-acf3-4fda-89cd-794c394213be tempest-VolumeDependencyTests-1304260226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-098c751a-2f07-49fd-9d90-2493c701313e.fdaadeed-f2ce-49ba-933c-89b9cf3f493a {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:58 devstack sudo[106028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-098c751a-2f07-49fd-9d90-2493c701313e.fdaadeed-f2ce-49ba-933c-89b9cf3f493a Sep 16 20:37:58 devstack sudo[106028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:58 devstack sudo[106028]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:58 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-81cf1720-acf3-4fda-89cd-794c394213be tempest-VolumeDependencyTests-1304260226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-098c751a-2f07-49fd-9d90-2493c701313e.fdaadeed-f2ce-49ba-933c-89b9cf3f493a" returned: 0 in 0.526s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:58 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-81cf1720-acf3-4fda-89cd-794c394213be tempest-VolumeDependencyTests-1304260226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-098c751a-2f07-49fd-9d90-2493c701313e.fdaadeed-f2ce-49ba-933c-89b9cf3f493a {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:37:58 devstack sudo[106033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-098c751a-2f07-49fd-9d90-2493c701313e.fdaadeed-f2ce-49ba-933c-89b9cf3f493a Sep 16 20:37:58 devstack sudo[106033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:37:58 devstack sudo[106033]: pam_unix(sudo:session): session closed for user root Sep 16 20:37:58 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-81cf1720-acf3-4fda-89cd-794c394213be tempest-VolumeDependencyTests-1304260226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-098c751a-2f07-49fd-9d90-2493c701313e.fdaadeed-f2ce-49ba-933c-89b9cf3f493a" returned: 0 in 0.321s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:37:58 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-81cf1720-acf3-4fda-89cd-794c394213be tempest-VolumeDependencyTests-1304260226 None] Lock "cinder-quobyte-fdaadeed-f2ce-49ba-933c-89b9cf3f493a" released by "_delete_snapshot" :: held 2.131s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:37:58 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-81cf1720-acf3-4fda-89cd-794c394213be tempest-VolumeDependencyTests-1304260226 None] Lock "cinder-quobyte-098c751a-2f07-49fd-9d90-2493c701313e" released by "delete_snapshot" :: held 2.164s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:37:59 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-81cf1720-acf3-4fda-89cd-794c394213be tempest-VolumeDependencyTests-1304260226 None] Created reservations ['6a4fe5f1-ace8-4174-baf1-528bf979e25f', 'e5cd4b13-b7f8-497a-862b-bed1eb607240', 'ec98040d-3322-47aa-a7e1-8ed1aad51286', '540dfb1c-707b-4a6a-971c-da1edac8db30'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:37:59 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-81cf1720-acf3-4fda-89cd-794c394213be tempest-VolumeDependencyTests-1304260226 None] Delete snapshot completed successfully. Sep 16 20:37:59 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-81cf1720-acf3-4fda-89cd-794c394213be tempest-VolumeDependencyTests-1304260226 None] Lock "cinder-fdaadeed-f2ce-49ba-933c-89b9cf3f493a-delete_snapshot" released by "delete_snapshot" :: held 2.334s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:38:00 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-f724e5ee-564c-45c4-9246-f83a308103e0 tempest-VolumeDependencyTests-1304260226 None] Acquiring lock "cinder-098c751a-2f07-49fd-9d90-2493c701313e-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:38:00 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-f724e5ee-564c-45c4-9246-f83a308103e0 tempest-VolumeDependencyTests-1304260226 None] Lock "cinder-098c751a-2f07-49fd-9d90-2493c701313e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:38:00 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-f724e5ee-564c-45c4-9246-f83a308103e0 tempest-VolumeDependencyTests-1304260226 None] Acquiring lock "cinder-quobyte-098c751a-2f07-49fd-9d90-2493c701313e" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:38:00 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-f724e5ee-564c-45c4-9246-f83a308103e0 tempest-VolumeDependencyTests-1304260226 None] Lock "cinder-quobyte-098c751a-2f07-49fd-9d90-2493c701313e" acquired by "delete_volume" :: waited 0.018s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:38:00 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[c174e749-0c63-4a4c-b401-6e5f543846ed]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:38:00 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f724e5ee-564c-45c4-9246-f83a308103e0 tempest-VolumeDependencyTests-1304260226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-098c751a-2f07-49fd-9d90-2493c701313e {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:00 devstack sudo[106037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-098c751a-2f07-49fd-9d90-2493c701313e Sep 16 20:38:00 devstack sudo[106037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:00 devstack sudo[106037]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:00 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f724e5ee-564c-45c4-9246-f83a308103e0 tempest-VolumeDependencyTests-1304260226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-098c751a-2f07-49fd-9d90-2493c701313e" returned: 0 in 0.414s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:00 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f724e5ee-564c-45c4-9246-f83a308103e0 tempest-VolumeDependencyTests-1304260226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-098c751a-2f07-49fd-9d90-2493c701313e {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:00 devstack sudo[106075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-098c751a-2f07-49fd-9d90-2493c701313e Sep 16 20:38:00 devstack sudo[106075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:00 devstack sudo[106075]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:00 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f724e5ee-564c-45c4-9246-f83a308103e0 tempest-VolumeDependencyTests-1304260226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-098c751a-2f07-49fd-9d90-2493c701313e" returned: 0 in 0.343s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:00 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-f724e5ee-564c-45c4-9246-f83a308103e0 tempest-VolumeDependencyTests-1304260226 None] Lock "cinder-quobyte-098c751a-2f07-49fd-9d90-2493c701313e" released by "delete_volume" :: held 0.844s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:38:01 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-f724e5ee-564c-45c4-9246-f83a308103e0 tempest-VolumeDependencyTests-1304260226 None] Created reservations ['2a14c67c-1378-4ccd-9ffb-340a4f507a5c', '94d7b9af-a0cd-44e7-a869-67dd3e2c458e', '8d4ade8a-f4f0-4517-93e4-512fef1f3814', '8aa5792d-fad7-4d43-840e-6b1aca67110f'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:38:01 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-f724e5ee-564c-45c4-9246-f83a308103e0 tempest-VolumeDependencyTests-1304260226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:38:01 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-f724e5ee-564c-45c4-9246-f83a308103e0 tempest-VolumeDependencyTests-1304260226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:38:01 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-f724e5ee-564c-45c4-9246-f83a308103e0 tempest-VolumeDependencyTests-1304260226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:38:01 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-f724e5ee-564c-45c4-9246-f83a308103e0 tempest-VolumeDependencyTests-1304260226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:38:01 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-f724e5ee-564c-45c4-9246-f83a308103e0 tempest-VolumeDependencyTests-1304260226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:38:01 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f724e5ee-564c-45c4-9246-f83a308103e0 tempest-VolumeDependencyTests-1304260226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:01 devstack sudo[106081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:38:01 devstack sudo[106081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:01 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-95326098-1dde-4467-bbf1-38ac8cf54f25 tempest-VolumeDependencyTests-1304260226 None] Acquiring lock "cinder-805aa1e3-47ea-44d3-bf7f-54403b433ef8-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:38:01 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-95326098-1dde-4467-bbf1-38ac8cf54f25 tempest-VolumeDependencyTests-1304260226 None] Lock "cinder-805aa1e3-47ea-44d3-bf7f-54403b433ef8-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:38:01 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-95326098-1dde-4467-bbf1-38ac8cf54f25 tempest-VolumeDependencyTests-1304260226 None] Acquiring lock "cinder-quobyte-805aa1e3-47ea-44d3-bf7f-54403b433ef8" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:38:01 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-95326098-1dde-4467-bbf1-38ac8cf54f25 tempest-VolumeDependencyTests-1304260226 None] Lock "cinder-quobyte-805aa1e3-47ea-44d3-bf7f-54403b433ef8" acquired by "delete_volume" :: waited 0.027s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:38:01 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[dda5bd9a-8f3a-48e7-8183-91e16cdb91d3]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:38:01 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-95326098-1dde-4467-bbf1-38ac8cf54f25 tempest-VolumeDependencyTests-1304260226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-805aa1e3-47ea-44d3-bf7f-54403b433ef8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:01 devstack sudo[106081]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:01 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f724e5ee-564c-45c4-9246-f83a308103e0 tempest-VolumeDependencyTests-1304260226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.398s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:01 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-f724e5ee-564c-45c4-9246-f83a308103e0 tempest-VolumeDependencyTests-1304260226 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:38:01 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-f724e5ee-564c-45c4-9246-f83a308103e0 tempest-VolumeDependencyTests-1304260226 None] Deleted volume successfully. Sep 16 20:38:01 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-f724e5ee-564c-45c4-9246-f83a308103e0 tempest-VolumeDependencyTests-1304260226 None] Lock "cinder-098c751a-2f07-49fd-9d90-2493c701313e-delete_volume" released by "delete_volume" :: held 1.530s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:38:01 devstack sudo[106084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-805aa1e3-47ea-44d3-bf7f-54403b433ef8 Sep 16 20:38:01 devstack sudo[106084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:02 devstack sudo[106084]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:02 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-95326098-1dde-4467-bbf1-38ac8cf54f25 tempest-VolumeDependencyTests-1304260226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-805aa1e3-47ea-44d3-bf7f-54403b433ef8" returned: 0 in 0.500s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:02 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-95326098-1dde-4467-bbf1-38ac8cf54f25 tempest-VolumeDependencyTests-1304260226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-805aa1e3-47ea-44d3-bf7f-54403b433ef8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:02 devstack sudo[106090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-805aa1e3-47ea-44d3-bf7f-54403b433ef8 Sep 16 20:38:02 devstack sudo[106090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:02 devstack sudo[106090]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:02 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-95326098-1dde-4467-bbf1-38ac8cf54f25 tempest-VolumeDependencyTests-1304260226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-805aa1e3-47ea-44d3-bf7f-54403b433ef8" returned: 0 in 0.331s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:02 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-95326098-1dde-4467-bbf1-38ac8cf54f25 tempest-VolumeDependencyTests-1304260226 None] Lock "cinder-quobyte-805aa1e3-47ea-44d3-bf7f-54403b433ef8" released by "delete_volume" :: held 0.902s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:38:02 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-95326098-1dde-4467-bbf1-38ac8cf54f25 tempest-VolumeDependencyTests-1304260226 None] Created reservations ['f54f6866-3e26-4020-abf7-d1ca75c7aa70', '474ebb6a-8b85-40ae-a7ee-8d8dd0616d2e', '6a275972-360e-4c58-bb6f-23f428339d9b', 'f2ebb520-b134-42c5-99ab-b31b586b6024'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:38:02 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-95326098-1dde-4467-bbf1-38ac8cf54f25 tempest-VolumeDependencyTests-1304260226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:38:02 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-95326098-1dde-4467-bbf1-38ac8cf54f25 tempest-VolumeDependencyTests-1304260226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:38:02 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-95326098-1dde-4467-bbf1-38ac8cf54f25 tempest-VolumeDependencyTests-1304260226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:38:02 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-95326098-1dde-4467-bbf1-38ac8cf54f25 tempest-VolumeDependencyTests-1304260226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:38:02 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-95326098-1dde-4467-bbf1-38ac8cf54f25 tempest-VolumeDependencyTests-1304260226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:38:02 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-95326098-1dde-4467-bbf1-38ac8cf54f25 tempest-VolumeDependencyTests-1304260226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:02 devstack sudo[106093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:38:02 devstack sudo[106093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:02 devstack sudo[106093]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:02 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-95326098-1dde-4467-bbf1-38ac8cf54f25 tempest-VolumeDependencyTests-1304260226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.250s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:02 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-95326098-1dde-4467-bbf1-38ac8cf54f25 tempest-VolumeDependencyTests-1304260226 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:38:02 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-95326098-1dde-4467-bbf1-38ac8cf54f25 tempest-VolumeDependencyTests-1304260226 None] Deleted volume successfully. Sep 16 20:38:02 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-95326098-1dde-4467-bbf1-38ac8cf54f25 tempest-VolumeDependencyTests-1304260226 None] Lock "cinder-805aa1e3-47ea-44d3-bf7f-54403b433ef8-delete_volume" released by "delete_volume" :: held 1.452s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:38:03 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-d992d7f8-bedb-4293-a304-33fea3abf389 tempest-VolumeImageDependencyTests-696686021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:38:03 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-d992d7f8-bedb-4293-a304-33fea3abf389 tempest-VolumeImageDependencyTests-696686021 None] Flow 'volume_create_manager' (ead06084-3ec9-46fe-a1b0-e1e70220fe96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:38:03 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-d992d7f8-bedb-4293-a304-33fea3abf389 tempest-VolumeImageDependencyTests-696686021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33adb683-9f04-4520-9e80-dffba9ece0b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:38:03 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-d992d7f8-bedb-4293-a304-33fea3abf389 tempest-VolumeImageDependencyTests-696686021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33adb683-9f04-4520-9e80-dffba9ece0b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:38:03Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab85a49c-828c-4e7c-b641-1641a7083873,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ab930b8e12d490997da80ca0fb427cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:38:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:38:03Z,use_quota=True,user_id='8be85f413cb64d90a5a04e92f3a2b923',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:38:03 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-d992d7f8-bedb-4293-a304-33fea3abf389 tempest-VolumeImageDependencyTests-696686021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84842dfd-0132-40aa-adf4-c25c780bfd7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:38:03 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-d992d7f8-bedb-4293-a304-33fea3abf389 tempest-VolumeImageDependencyTests-696686021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84842dfd-0132-40aa-adf4-c25c780bfd7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:38:03 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-d992d7f8-bedb-4293-a304-33fea3abf389 tempest-VolumeImageDependencyTests-696686021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8497904-ca61-4c8c-b6be-0a2a05bc89c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:38:03 devstack cinder-volume[86188]: DEBUG cinder.image.glance [None req-d992d7f8-bedb-4293-a304-33fea3abf389 tempest-VolumeImageDependencyTests-696686021 None] Creating Keystone auth plugin from conf {{(pid=86188) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 16 20:38:04 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-d992d7f8-bedb-4293-a304-33fea3abf389 tempest-VolumeImageDependencyTests-696686021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8497904-ca61-4c8c-b6be-0a2a05bc89c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ab85a49c-828c-4e7c-b641-1641a7083873', 'volume_name': 'volume-ab85a49c-828c-4e7c-b641-1641a7083873', 'volume_size': 1, 'image_id': '9f5ed562-d5ed-4881-9929-2357cb61e134', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9f5ed562-d5ed-4881-9929-2357cb61e134', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd8e0c2043d910b78104bb8eaa7a92f21', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2ab930b8e12d490997da80ca0fb427cb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '25d7606b94dad78a3e573112a502d925688987784161c649d8b6e87ef328ae812e02ea28d7822e043aab14677fceee94fd34c4ec516a5bcbc3014531b0ac601f', 'id': '9f5ed562-d5ed-4881-9929-2357cb61e134', 'created_at': datetime.datetime(2026, 9, 16, 18, 38, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 18, 38, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9f5ed562-d5ed-4881-9929-2357cb61e134/file', 'properties': {}}, 'image_service': }' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:38:04 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-d992d7f8-bedb-4293-a304-33fea3abf389 tempest-VolumeImageDependencyTests-696686021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6aca05e-88e3-427b-80d6-10bc0787c4d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:38:04 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-d992d7f8-bedb-4293-a304-33fea3abf389 tempest-VolumeImageDependencyTests-696686021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6aca05e-88e3-427b-80d6-10bc0787c4d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:38:04 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-d992d7f8-bedb-4293-a304-33fea3abf389 tempest-VolumeImageDependencyTests-696686021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a38523a-c233-4ffc-a737-0431d663fc3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:38:04 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-d992d7f8-bedb-4293-a304-33fea3abf389 tempest-VolumeImageDependencyTests-696686021 None] Volume ab85a49c-828c-4e7c-b641-1641a7083873: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ab85a49c-828c-4e7c-b641-1641a7083873', 'volume_size': 1, 'image_id': '9f5ed562-d5ed-4881-9929-2357cb61e134', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9f5ed562-d5ed-4881-9929-2357cb61e134', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd8e0c2043d910b78104bb8eaa7a92f21', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2ab930b8e12d490997da80ca0fb427cb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '25d7606b94dad78a3e573112a502d925688987784161c649d8b6e87ef328ae812e02ea28d7822e043aab14677fceee94fd34c4ec516a5bcbc3014531b0ac601f', 'id': '9f5ed562-d5ed-4881-9929-2357cb61e134', 'created_at': datetime.datetime(2026, 9, 16, 18, 38, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 18, 38, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9f5ed562-d5ed-4881-9929-2357cb61e134/file', 'properties': {}}, 'image_service': } Sep 16 20:38:04 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-d992d7f8-bedb-4293-a304-33fea3abf389 tempest-VolumeImageDependencyTests-696686021 None] Trying to clone ab85a49c-828c-4e7c-b641-1641a7083873 from image 9f5ed562-d5ed-4881-9929-2357cb61e134 at location (None, [{'url': 'file:///opt/stack/data/glance/images/9f5ed562-d5ed-4881-9929-2357cb61e134', 'metadata': {}}]). {{(pid=86188) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 16 20:38:04 devstack cinder-volume[86188]: DEBUG cinder.image.image_utils [None req-d992d7f8-bedb-4293-a304-33fea3abf389 tempest-VolumeImageDependencyTests-696686021 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9f5ed562-d5ed-4881-9929-2357cb61e134_k28o8b5vdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86188) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 16 20:38:04 devstack cinder-volume[86188]: INFO cinder.image.image_utils [None req-d992d7f8-bedb-4293-a304-33fea3abf389 tempest-VolumeImageDependencyTests-696686021 None] Image download 0.00 MB at 0.00 MB/s Sep 16 20:38:04 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4a48d20-5476-450c-9e80-036e4df796bc]: (4, 'raw') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:38:04 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-d992d7f8-bedb-4293-a304-33fea3abf389 tempest-VolumeImageDependencyTests-696686021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9f5ed562-d5ed-4881-9929-2357cb61e134_k28o8b5vdevstack@QuobyteHD {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:04 devstack sudo[106096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9f5ed562-d5ed-4881-9929-2357cb61e134_k28o8b5vdevstack@QuobyteHD Sep 16 20:38:04 devstack sudo[106096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:04 devstack sudo[106096]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:04 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-d992d7f8-bedb-4293-a304-33fea3abf389 tempest-VolumeImageDependencyTests-696686021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9f5ed562-d5ed-4881-9929-2357cb61e134_k28o8b5vdevstack@QuobyteHD" returned: 0 in 0.480s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:04 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-d992d7f8-bedb-4293-a304-33fea3abf389 tempest-VolumeImageDependencyTests-696686021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9f5ed562-d5ed-4881-9929-2357cb61e134_k28o8b5vdevstack@QuobyteHD {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:04 devstack sudo[106101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9f5ed562-d5ed-4881-9929-2357cb61e134_k28o8b5vdevstack@QuobyteHD Sep 16 20:38:04 devstack sudo[106101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:05 devstack sudo[106101]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:05 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-d992d7f8-bedb-4293-a304-33fea3abf389 tempest-VolumeImageDependencyTests-696686021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9f5ed562-d5ed-4881-9929-2357cb61e134_k28o8b5vdevstack@QuobyteHD" returned: 1 in 0.418s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:05 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-d992d7f8-bedb-4293-a304-33fea3abf389 tempest-VolumeImageDependencyTests-696686021 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9f5ed562-d5ed-4881-9929-2357cb61e134_k28o8b5vdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 16 20:38:05 devstack cinder-volume[86188]: DEBUG cinder.image.image_utils [None req-d992d7f8-bedb-4293-a304-33fea3abf389 tempest-VolumeImageDependencyTests-696686021 None] Temporary image 9f5ed562-d5ed-4881-9929-2357cb61e134 is fetched for user 8be85f413cb64d90a5a04e92f3a2b923. {{(pid=86188) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 16 20:38:05 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8bd54e4-d1d1-4e08-9adb-759d26a0a560]: (4, 'raw') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:38:05 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-d992d7f8-bedb-4293-a304-33fea3abf389 tempest-VolumeImageDependencyTests-696686021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9f5ed562-d5ed-4881-9929-2357cb61e134_k28o8b5vdevstack@QuobyteHD {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:05 devstack sudo[106112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9f5ed562-d5ed-4881-9929-2357cb61e134_k28o8b5vdevstack@QuobyteHD Sep 16 20:38:05 devstack sudo[106112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:05 devstack sudo[106112]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:05 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-d992d7f8-bedb-4293-a304-33fea3abf389 tempest-VolumeImageDependencyTests-696686021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9f5ed562-d5ed-4881-9929-2357cb61e134_k28o8b5vdevstack@QuobyteHD" returned: 0 in 0.414s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:05 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-d992d7f8-bedb-4293-a304-33fea3abf389 tempest-VolumeImageDependencyTests-696686021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9f5ed562-d5ed-4881-9929-2357cb61e134_k28o8b5vdevstack@QuobyteHD {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:05 devstack sudo[106116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9f5ed562-d5ed-4881-9929-2357cb61e134_k28o8b5vdevstack@QuobyteHD Sep 16 20:38:05 devstack sudo[106116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:06 devstack sudo[106116]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:06 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-d992d7f8-bedb-4293-a304-33fea3abf389 tempest-VolumeImageDependencyTests-696686021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9f5ed562-d5ed-4881-9929-2357cb61e134_k28o8b5vdevstack@QuobyteHD" returned: 1 in 0.490s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:06 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-d992d7f8-bedb-4293-a304-33fea3abf389 tempest-VolumeImageDependencyTests-696686021 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9f5ed562-d5ed-4881-9929-2357cb61e134_k28o8b5vdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 16 20:38:06 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-d992d7f8-bedb-4293-a304-33fea3abf389 tempest-VolumeImageDependencyTests-696686021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:38:06 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-d992d7f8-bedb-4293-a304-33fea3abf389 tempest-VolumeImageDependencyTests-696686021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:38:06 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-d992d7f8-bedb-4293-a304-33fea3abf389 tempest-VolumeImageDependencyTests-696686021 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:38:03Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab85a49c-828c-4e7c-b641-1641a7083873,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ab930b8e12d490997da80ca0fb427cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:38:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:38:03Z,use_quota=True,user_id='8be85f413cb64d90a5a04e92f3a2b923',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:38:06 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-d992d7f8-bedb-4293-a304-33fea3abf389 tempest-VolumeImageDependencyTests-696686021 None] Creating volume ab85a49c-828c-4e7c-b641-1641a7083873 {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:38:06 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-d992d7f8-bedb-4293-a304-33fea3abf389 tempest-VolumeImageDependencyTests-696686021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:38:06 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-d992d7f8-bedb-4293-a304-33fea3abf389 tempest-VolumeImageDependencyTests-696686021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:38:06 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-d992d7f8-bedb-4293-a304-33fea3abf389 tempest-VolumeImageDependencyTests-696686021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:38:06 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-d992d7f8-bedb-4293-a304-33fea3abf389 tempest-VolumeImageDependencyTests-696686021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:38:06 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-d992d7f8-bedb-4293-a304-33fea3abf389 tempest-VolumeImageDependencyTests-696686021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:38:06 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-d992d7f8-bedb-4293-a304-33fea3abf389 tempest-VolumeImageDependencyTests-696686021 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:38:06 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-d992d7f8-bedb-4293-a304-33fea3abf389 tempest-VolumeImageDependencyTests-696686021 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:38:06 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-d992d7f8-bedb-4293-a304-33fea3abf389 tempest-VolumeImageDependencyTests-696686021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ab85a49c-828c-4e7c-b641-1641a7083873 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:06 devstack sudo[106121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ab85a49c-828c-4e7c-b641-1641a7083873 1073741824 Sep 16 20:38:06 devstack sudo[106121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:06 devstack sudo[106121]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:06 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-d992d7f8-bedb-4293-a304-33fea3abf389 tempest-VolumeImageDependencyTests-696686021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ab85a49c-828c-4e7c-b641-1641a7083873 1073741824" returned: 0 in 0.737s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:06 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-d992d7f8-bedb-4293-a304-33fea3abf389 tempest-VolumeImageDependencyTests-696686021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ab85a49c-828c-4e7c-b641-1641a7083873 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:07 devstack sudo[106127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ab85a49c-828c-4e7c-b641-1641a7083873 Sep 16 20:38:07 devstack sudo[106127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:07 devstack sudo[106127]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:07 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-d992d7f8-bedb-4293-a304-33fea3abf389 tempest-VolumeImageDependencyTests-696686021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ab85a49c-828c-4e7c-b641-1641a7083873" returned: 0 in 0.360s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:07 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-d992d7f8-bedb-4293-a304-33fea3abf389 tempest-VolumeImageDependencyTests-696686021 None] <== create_volume: return (1165ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:38:07 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-d992d7f8-bedb-4293-a304-33fea3abf389 tempest-VolumeImageDependencyTests-696686021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.168s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:38:07 devstack cinder-volume[86188]: DEBUG cinder.volume.volume_utils [None req-d992d7f8-bedb-4293-a304-33fea3abf389 tempest-VolumeImageDependencyTests-696686021 None] Attempting download of 9f5ed562-d5ed-4881-9929-2357cb61e134 ((None, [{'url': 'file:///opt/stack/data/glance/images/9f5ed562-d5ed-4881-9929-2357cb61e134', 'metadata': {}}])) to volume ab85a49c-828c-4e7c-b641-1641a7083873. {{(pid=86188) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 16 20:38:07 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0e0167e-aa93-4fa8-8db9-09342eefe6fa]: (4, 'raw') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:38:07 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-d992d7f8-bedb-4293-a304-33fea3abf389 tempest-VolumeImageDependencyTests-696686021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9f5ed562-d5ed-4881-9929-2357cb61e134_1q06o222 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:07 devstack sudo[106132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9f5ed562-d5ed-4881-9929-2357cb61e134_1q06o222 Sep 16 20:38:07 devstack sudo[106132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:07 devstack sudo[106132]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:08 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-d992d7f8-bedb-4293-a304-33fea3abf389 tempest-VolumeImageDependencyTests-696686021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9f5ed562-d5ed-4881-9929-2357cb61e134_1q06o222" returned: 0 in 0.533s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:08 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-d992d7f8-bedb-4293-a304-33fea3abf389 tempest-VolumeImageDependencyTests-696686021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9f5ed562-d5ed-4881-9929-2357cb61e134_1q06o222 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:08 devstack sudo[106136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9f5ed562-d5ed-4881-9929-2357cb61e134_1q06o222 Sep 16 20:38:08 devstack sudo[106136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:08 devstack sudo[106136]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:08 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-d992d7f8-bedb-4293-a304-33fea3abf389 tempest-VolumeImageDependencyTests-696686021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9f5ed562-d5ed-4881-9929-2357cb61e134_1q06o222" returned: 1 in 0.502s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:08 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-d992d7f8-bedb-4293-a304-33fea3abf389 tempest-VolumeImageDependencyTests-696686021 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9f5ed562-d5ed-4881-9929-2357cb61e134_1q06o222' failed. Not Retrying. {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 16 20:38:08 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f961ff9-61a5-46b5-9413-7a0a69891bfc]: (4, 'raw') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:38:08 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-d992d7f8-bedb-4293-a304-33fea3abf389 tempest-VolumeImageDependencyTests-696686021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9f5ed562-d5ed-4881-9929-2357cb61e134_k28o8b5vdevstack@QuobyteHD {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:08 devstack sudo[106140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9f5ed562-d5ed-4881-9929-2357cb61e134_k28o8b5vdevstack@QuobyteHD Sep 16 20:38:08 devstack sudo[106140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:08 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4c38d6c-a22e-4190-92b4-3fcda5c4e502 tempest-CinderUnicodeTest-936709608 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:38:09 devstack sudo[106140]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:09 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e4c38d6c-a22e-4190-92b4-3fcda5c4e502 tempest-CinderUnicodeTest-936709608 None] Flow 'volume_create_manager' (7a17615a-2c96-44ff-a4a2-5423189be510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:38:09 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e4c38d6c-a22e-4190-92b4-3fcda5c4e502 tempest-CinderUnicodeTest-936709608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c89c170-389a-48eb-8e01-836f3193c4e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:38:09 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-d992d7f8-bedb-4293-a304-33fea3abf389 tempest-VolumeImageDependencyTests-696686021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9f5ed562-d5ed-4881-9929-2357cb61e134_k28o8b5vdevstack@QuobyteHD" returned: 0 in 0.523s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:09 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-d992d7f8-bedb-4293-a304-33fea3abf389 tempest-VolumeImageDependencyTests-696686021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9f5ed562-d5ed-4881-9929-2357cb61e134_k28o8b5vdevstack@QuobyteHD {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:09 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e4c38d6c-a22e-4190-92b4-3fcda5c4e502 tempest-CinderUnicodeTest-936709608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c89c170-389a-48eb-8e01-836f3193c4e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:38:08Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=608046a2-f284-47bf-a442-b8a3f621b943,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='294945a99c8346cc9aa0d768fc0a4c2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:38:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:38:09Z,use_quota=True,user_id='f638fe6bd3a34507ba194ab48ce5708d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:38:09 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e4c38d6c-a22e-4190-92b4-3fcda5c4e502 tempest-CinderUnicodeTest-936709608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b58d6166-f7b8-4cef-8784-54ff7e0a8cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:38:09 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e4c38d6c-a22e-4190-92b4-3fcda5c4e502 tempest-CinderUnicodeTest-936709608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b58d6166-f7b8-4cef-8784-54ff7e0a8cf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:38:09 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e4c38d6c-a22e-4190-92b4-3fcda5c4e502 tempest-CinderUnicodeTest-936709608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c26406d4-3c80-48c9-a098-b5000cf2b3bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:38:09 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e4c38d6c-a22e-4190-92b4-3fcda5c4e502 tempest-CinderUnicodeTest-936709608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c26406d4-3c80-48c9-a098-b5000cf2b3bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '608046a2-f284-47bf-a442-b8a3f621b943', 'volume_name': 'volume-608046a2-f284-47bf-a442-b8a3f621b943', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:38:09 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e4c38d6c-a22e-4190-92b4-3fcda5c4e502 tempest-CinderUnicodeTest-936709608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02c949f5-f5a4-4acf-b2d1-73ab0e9dd9cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:38:09 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e4c38d6c-a22e-4190-92b4-3fcda5c4e502 tempest-CinderUnicodeTest-936709608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02c949f5-f5a4-4acf-b2d1-73ab0e9dd9cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:38:09 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e4c38d6c-a22e-4190-92b4-3fcda5c4e502 tempest-CinderUnicodeTest-936709608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e18d7ca1-a32a-4d11-9c70-e8bde74a882b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:38:09 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-e4c38d6c-a22e-4190-92b4-3fcda5c4e502 tempest-CinderUnicodeTest-936709608 None] Volume 608046a2-f284-47bf-a442-b8a3f621b943: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-608046a2-f284-47bf-a442-b8a3f621b943', 'volume_size': 1} Sep 16 20:38:09 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-e4c38d6c-a22e-4190-92b4-3fcda5c4e502 tempest-CinderUnicodeTest-936709608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:38:09 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-e4c38d6c-a22e-4190-92b4-3fcda5c4e502 tempest-CinderUnicodeTest-936709608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:38:09 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-e4c38d6c-a22e-4190-92b4-3fcda5c4e502 tempest-CinderUnicodeTest-936709608 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:38:08Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=608046a2-f284-47bf-a442-b8a3f621b943,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='294945a99c8346cc9aa0d768fc0a4c2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:38:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:38:09Z,use_quota=True,user_id='f638fe6bd3a34507ba194ab48ce5708d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:38:09 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-e4c38d6c-a22e-4190-92b4-3fcda5c4e502 tempest-CinderUnicodeTest-936709608 None] Creating volume 608046a2-f284-47bf-a442-b8a3f621b943 {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:38:09 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-e4c38d6c-a22e-4190-92b4-3fcda5c4e502 tempest-CinderUnicodeTest-936709608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:38:09 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-e4c38d6c-a22e-4190-92b4-3fcda5c4e502 tempest-CinderUnicodeTest-936709608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:38:09 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-e4c38d6c-a22e-4190-92b4-3fcda5c4e502 tempest-CinderUnicodeTest-936709608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:38:09 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-e4c38d6c-a22e-4190-92b4-3fcda5c4e502 tempest-CinderUnicodeTest-936709608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:38:09 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-e4c38d6c-a22e-4190-92b4-3fcda5c4e502 tempest-CinderUnicodeTest-936709608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:38:09 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-e4c38d6c-a22e-4190-92b4-3fcda5c4e502 tempest-CinderUnicodeTest-936709608 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:38:09 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-e4c38d6c-a22e-4190-92b4-3fcda5c4e502 tempest-CinderUnicodeTest-936709608 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:38:09 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e4c38d6c-a22e-4190-92b4-3fcda5c4e502 tempest-CinderUnicodeTest-936709608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-608046a2-f284-47bf-a442-b8a3f621b943 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:09 devstack sudo[106145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-608046a2-f284-47bf-a442-b8a3f621b943 1073741824 Sep 16 20:38:09 devstack sudo[106145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:09 devstack sudo[106144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9f5ed562-d5ed-4881-9929-2357cb61e134_k28o8b5vdevstack@QuobyteHD Sep 16 20:38:09 devstack sudo[106144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:09 devstack sudo[106144]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:09 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-d992d7f8-bedb-4293-a304-33fea3abf389 tempest-VolumeImageDependencyTests-696686021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9f5ed562-d5ed-4881-9929-2357cb61e134_k28o8b5vdevstack@QuobyteHD" returned: 1 in 0.403s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:09 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-d992d7f8-bedb-4293-a304-33fea3abf389 tempest-VolumeImageDependencyTests-696686021 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9f5ed562-d5ed-4881-9929-2357cb61e134_k28o8b5vdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 16 20:38:09 devstack cinder-volume[86188]: DEBUG cinder.image.image_utils [None req-d992d7f8-bedb-4293-a304-33fea3abf389 tempest-VolumeImageDependencyTests-696686021 None] 9f5ed562-d5ed-4881-9929-2357cb61e134 was raw, converting to qcow2 {{(pid=86188) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 16 20:38:09 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-d992d7f8-bedb-4293-a304-33fea3abf389 tempest-VolumeImageDependencyTests-696686021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_9f5ed562-d5ed-4881-9929-2357cb61e134_k28o8b5vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ab85a49c-828c-4e7c-b641-1641a7083873 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:09 devstack sudo[106155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_9f5ed562-d5ed-4881-9929-2357cb61e134_k28o8b5vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ab85a49c-828c-4e7c-b641-1641a7083873 Sep 16 20:38:09 devstack sudo[106155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:09 devstack sudo[106145]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:09 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e4c38d6c-a22e-4190-92b4-3fcda5c4e502 tempest-CinderUnicodeTest-936709608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-608046a2-f284-47bf-a442-b8a3f621b943 1073741824" returned: 0 in 0.555s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:09 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e4c38d6c-a22e-4190-92b4-3fcda5c4e502 tempest-CinderUnicodeTest-936709608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-608046a2-f284-47bf-a442-b8a3f621b943 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:09 devstack sudo[106160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-608046a2-f284-47bf-a442-b8a3f621b943 Sep 16 20:38:09 devstack sudo[106160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:10 devstack sudo[106160]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:10 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e4c38d6c-a22e-4190-92b4-3fcda5c4e502 tempest-CinderUnicodeTest-936709608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-608046a2-f284-47bf-a442-b8a3f621b943" returned: 0 in 0.369s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:10 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-e4c38d6c-a22e-4190-92b4-3fcda5c4e502 tempest-CinderUnicodeTest-936709608 None] <== create_volume: return (995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:38:10 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-e4c38d6c-a22e-4190-92b4-3fcda5c4e502 tempest-CinderUnicodeTest-936709608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.998s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:38:10 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e4c38d6c-a22e-4190-92b4-3fcda5c4e502 tempest-CinderUnicodeTest-936709608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e18d7ca1-a32a-4d11-9c70-e8bde74a882b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-608046a2-f284-47bf-a442-b8a3f621b943', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:38:10 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e4c38d6c-a22e-4190-92b4-3fcda5c4e502 tempest-CinderUnicodeTest-936709608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a99b10d8-afb9-4f17-9940-daf40f18a19d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:38:10 devstack sudo[106155]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:10 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-d992d7f8-bedb-4293-a304-33fea3abf389 tempest-VolumeImageDependencyTests-696686021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_9f5ed562-d5ed-4881-9929-2357cb61e134_k28o8b5vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ab85a49c-828c-4e7c-b641-1641a7083873" returned: 0 in 0.696s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:10 devstack cinder-volume[86188]: DEBUG cinder.image.image_utils [None req-d992d7f8-bedb-4293-a304-33fea3abf389 tempest-VolumeImageDependencyTests-696686021 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9f5ed562-d5ed-4881-9929-2357cb61e134_k28o8b5vdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ab85a49c-828c-4e7c-b641-1641a7083873 {{(pid=86188) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 16 20:38:10 devstack cinder-volume[86188]: INFO cinder.image.image_utils [None req-d992d7f8-bedb-4293-a304-33fea3abf389 tempest-VolumeImageDependencyTests-696686021 None] Converted 0.00 MB image at 0.00 MB/s Sep 16 20:38:10 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-d992d7f8-bedb-4293-a304-33fea3abf389 tempest-VolumeImageDependencyTests-696686021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ab85a49c-828c-4e7c-b641-1641a7083873 1G {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:10 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-e4c38d6c-a22e-4190-92b4-3fcda5c4e502 tempest-CinderUnicodeTest-936709608 None] Volume volume-608046a2-f284-47bf-a442-b8a3f621b943 (608046a2-f284-47bf-a442-b8a3f621b943): created successfully Sep 16 20:38:10 devstack sudo[106164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ab85a49c-828c-4e7c-b641-1641a7083873 1G Sep 16 20:38:10 devstack sudo[106164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:10 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e4c38d6c-a22e-4190-92b4-3fcda5c4e502 tempest-CinderUnicodeTest-936709608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a99b10d8-afb9-4f17-9940-daf40f18a19d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:38:10 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e4c38d6c-a22e-4190-92b4-3fcda5c4e502 tempest-CinderUnicodeTest-936709608 None] Flow 'volume_create_manager' (7a17615a-2c96-44ff-a4a2-5423189be510) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:38:10 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-e4c38d6c-a22e-4190-92b4-3fcda5c4e502 tempest-CinderUnicodeTest-936709608 None] Created volume successfully. Sep 16 20:38:10 devstack sudo[106164]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:10 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-d992d7f8-bedb-4293-a304-33fea3abf389 tempest-VolumeImageDependencyTests-696686021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ab85a49c-828c-4e7c-b641-1641a7083873 1G" returned: 0 in 0.423s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:10 devstack cinder-volume[86188]: DEBUG cinder.volume.volume_utils [None req-d992d7f8-bedb-4293-a304-33fea3abf389 tempest-VolumeImageDependencyTests-696686021 None] Downloaded image 9f5ed562-d5ed-4881-9929-2357cb61e134 ((None, [{'url': 'file:///opt/stack/data/glance/images/9f5ed562-d5ed-4881-9929-2357cb61e134', 'metadata': {}}])) to volume ab85a49c-828c-4e7c-b641-1641a7083873 successfully. {{(pid=86188) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 16 20:38:10 devstack cinder-volume[86188]: DEBUG cinder.image.image_utils [None req-d992d7f8-bedb-4293-a304-33fea3abf389 tempest-VolumeImageDependencyTests-696686021 None] Temporary image 9f5ed562-d5ed-4881-9929-2357cb61e134 for user 8be85f413cb64d90a5a04e92f3a2b923 is deleted. {{(pid=86188) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 16 20:38:10 devstack cinder-volume[86188]: DEBUG cinder.volume.volume_utils [None req-d992d7f8-bedb-4293-a304-33fea3abf389 tempest-VolumeImageDependencyTests-696686021 None] Marking volume ab85a49c-828c-4e7c-b641-1641a7083873 as bootable. {{(pid=86188) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 16 20:38:10 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-d992d7f8-bedb-4293-a304-33fea3abf389 tempest-VolumeImageDependencyTests-696686021 None] Copying metadata from image 9f5ed562-d5ed-4881-9929-2357cb61e134 to ab85a49c-828c-4e7c-b641-1641a7083873. {{(pid=86188) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 16 20:38:10 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-d992d7f8-bedb-4293-a304-33fea3abf389 tempest-VolumeImageDependencyTests-696686021 None] Creating volume glance metadata for volume ab85a49c-828c-4e7c-b641-1641a7083873 backed by image 9f5ed562-d5ed-4881-9929-2357cb61e134 with: {'image_id': '9f5ed562-d5ed-4881-9929-2357cb61e134', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'd8e0c2043d910b78104bb8eaa7a92f21', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86188) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 16 20:38:10 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-d992d7f8-bedb-4293-a304-33fea3abf389 tempest-VolumeImageDependencyTests-696686021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a38523a-c233-4ffc-a737-0431d663fc3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab85a49c-828c-4e7c-b641-1641a7083873', 'volume_size': 1, 'image_id': '9f5ed562-d5ed-4881-9929-2357cb61e134', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9f5ed562-d5ed-4881-9929-2357cb61e134', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd8e0c2043d910b78104bb8eaa7a92f21', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2ab930b8e12d490997da80ca0fb427cb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '25d7606b94dad78a3e573112a502d925688987784161c649d8b6e87ef328ae812e02ea28d7822e043aab14677fceee94fd34c4ec516a5bcbc3014531b0ac601f', 'id': '9f5ed562-d5ed-4881-9929-2357cb61e134', 'created_at': datetime.datetime(2026, 9, 16, 18, 38, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 18, 38, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9f5ed562-d5ed-4881-9929-2357cb61e134/file', 'properties': {}}, 'image_service': }' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:38:10 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-d992d7f8-bedb-4293-a304-33fea3abf389 tempest-VolumeImageDependencyTests-696686021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (929ec2f3-73e3-4576-a369-3562124edb0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:38:10 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-d992d7f8-bedb-4293-a304-33fea3abf389 tempest-VolumeImageDependencyTests-696686021 None] Volume volume-ab85a49c-828c-4e7c-b641-1641a7083873 (ab85a49c-828c-4e7c-b641-1641a7083873): created successfully Sep 16 20:38:10 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-d992d7f8-bedb-4293-a304-33fea3abf389 tempest-VolumeImageDependencyTests-696686021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (929ec2f3-73e3-4576-a369-3562124edb0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:38:10 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-d992d7f8-bedb-4293-a304-33fea3abf389 tempest-VolumeImageDependencyTests-696686021 None] Flow 'volume_create_manager' (ead06084-3ec9-46fe-a1b0-e1e70220fe96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:38:10 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-d992d7f8-bedb-4293-a304-33fea3abf389 tempest-VolumeImageDependencyTests-696686021 None] Created volume successfully. Sep 16 20:38:11 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-d78edb56-ba3b-4dfc-9b9b-46cfb13aaa08 tempest-VolumeImageDependencyTests-696686021 None] Acquiring lock "cinder-ab85a49c-828c-4e7c-b641-1641a7083873-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:38:11 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-d78edb56-ba3b-4dfc-9b9b-46cfb13aaa08 tempest-VolumeImageDependencyTests-696686021 None] Lock "cinder-ab85a49c-828c-4e7c-b641-1641a7083873-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:38:11 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-d78edb56-ba3b-4dfc-9b9b-46cfb13aaa08 tempest-VolumeImageDependencyTests-696686021 None] Acquiring lock "cinder-quobyte-ab85a49c-828c-4e7c-b641-1641a7083873" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:38:11 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-d78edb56-ba3b-4dfc-9b9b-46cfb13aaa08 tempest-VolumeImageDependencyTests-696686021 None] Lock "cinder-quobyte-ab85a49c-828c-4e7c-b641-1641a7083873" acquired by "delete_volume" :: waited 0.025s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:38:11 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[49ab85ba-381f-4be8-aa94-671fede41acd]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:38:11 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-d78edb56-ba3b-4dfc-9b9b-46cfb13aaa08 tempest-VolumeImageDependencyTests-696686021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ab85a49c-828c-4e7c-b641-1641a7083873 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:11 devstack sudo[106169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ab85a49c-828c-4e7c-b641-1641a7083873 Sep 16 20:38:11 devstack sudo[106169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:11 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-54359c7e-d107-461b-8a57-d0b7659461b5 tempest-CinderUnicodeTest-936709608 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:38:11 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-54359c7e-d107-461b-8a57-d0b7659461b5 tempest-CinderUnicodeTest-936709608 None] Flow 'volume_create_manager' (fb5dfce1-d3ec-4a0f-a5f4-a5730a4bef6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:38:11 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-54359c7e-d107-461b-8a57-d0b7659461b5 tempest-CinderUnicodeTest-936709608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da327458-5834-40fc-96e8-1ea5d07ea08f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:38:11 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-54359c7e-d107-461b-8a57-d0b7659461b5 tempest-CinderUnicodeTest-936709608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da327458-5834-40fc-96e8-1ea5d07ea08f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:38:11Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-380170469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55b804b9-385f-4a90-a838-71a5fc1d3ed4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='294945a99c8346cc9aa0d768fc0a4c2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:38:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:38:12Z,use_quota=True,user_id='f638fe6bd3a34507ba194ab48ce5708d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:38:11 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-54359c7e-d107-461b-8a57-d0b7659461b5 tempest-CinderUnicodeTest-936709608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3baebeb-e306-406d-8492-306fa3eca5dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:38:11 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-54359c7e-d107-461b-8a57-d0b7659461b5 tempest-CinderUnicodeTest-936709608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3baebeb-e306-406d-8492-306fa3eca5dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:38:11 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-54359c7e-d107-461b-8a57-d0b7659461b5 tempest-CinderUnicodeTest-936709608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e64aefb-fe5c-46bb-a2c3-9dd7b13e0dce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:38:11 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-54359c7e-d107-461b-8a57-d0b7659461b5 tempest-CinderUnicodeTest-936709608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e64aefb-fe5c-46bb-a2c3-9dd7b13e0dce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55b804b9-385f-4a90-a838-71a5fc1d3ed4', 'volume_name': 'volume-55b804b9-385f-4a90-a838-71a5fc1d3ed4', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:38:11 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-54359c7e-d107-461b-8a57-d0b7659461b5 tempest-CinderUnicodeTest-936709608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff30fd2e-e5b9-4dec-844b-d1196ccd7b05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:38:11 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-54359c7e-d107-461b-8a57-d0b7659461b5 tempest-CinderUnicodeTest-936709608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff30fd2e-e5b9-4dec-844b-d1196ccd7b05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:38:11 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-54359c7e-d107-461b-8a57-d0b7659461b5 tempest-CinderUnicodeTest-936709608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65b97305-2239-4da2-bf63-d150a75c8285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:38:11 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-54359c7e-d107-461b-8a57-d0b7659461b5 tempest-CinderUnicodeTest-936709608 None] Volume 55b804b9-385f-4a90-a838-71a5fc1d3ed4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55b804b9-385f-4a90-a838-71a5fc1d3ed4', 'volume_size': 1} Sep 16 20:38:11 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-54359c7e-d107-461b-8a57-d0b7659461b5 tempest-CinderUnicodeTest-936709608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:38:11 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-54359c7e-d107-461b-8a57-d0b7659461b5 tempest-CinderUnicodeTest-936709608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:38:11 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-54359c7e-d107-461b-8a57-d0b7659461b5 tempest-CinderUnicodeTest-936709608 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:38:11Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-380170469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55b804b9-385f-4a90-a838-71a5fc1d3ed4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='294945a99c8346cc9aa0d768fc0a4c2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:38:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:38:12Z,use_quota=True,user_id='f638fe6bd3a34507ba194ab48ce5708d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:38:11 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-54359c7e-d107-461b-8a57-d0b7659461b5 tempest-CinderUnicodeTest-936709608 None] Creating volume 55b804b9-385f-4a90-a838-71a5fc1d3ed4 {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:38:11 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-54359c7e-d107-461b-8a57-d0b7659461b5 tempest-CinderUnicodeTest-936709608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:38:11 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-54359c7e-d107-461b-8a57-d0b7659461b5 tempest-CinderUnicodeTest-936709608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:38:11 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-54359c7e-d107-461b-8a57-d0b7659461b5 tempest-CinderUnicodeTest-936709608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:38:11 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-54359c7e-d107-461b-8a57-d0b7659461b5 tempest-CinderUnicodeTest-936709608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:38:11 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-54359c7e-d107-461b-8a57-d0b7659461b5 tempest-CinderUnicodeTest-936709608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:38:11 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-54359c7e-d107-461b-8a57-d0b7659461b5 tempest-CinderUnicodeTest-936709608 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:38:11 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-54359c7e-d107-461b-8a57-d0b7659461b5 tempest-CinderUnicodeTest-936709608 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:38:11 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-54359c7e-d107-461b-8a57-d0b7659461b5 tempest-CinderUnicodeTest-936709608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-55b804b9-385f-4a90-a838-71a5fc1d3ed4 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:11 devstack sudo[106171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-55b804b9-385f-4a90-a838-71a5fc1d3ed4 1073741824 Sep 16 20:38:11 devstack sudo[106171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:12 devstack sudo[106169]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:12 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-d78edb56-ba3b-4dfc-9b9b-46cfb13aaa08 tempest-VolumeImageDependencyTests-696686021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ab85a49c-828c-4e7c-b641-1641a7083873" returned: 0 in 0.551s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:12 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-d78edb56-ba3b-4dfc-9b9b-46cfb13aaa08 tempest-VolumeImageDependencyTests-696686021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ab85a49c-828c-4e7c-b641-1641a7083873 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:12 devstack sudo[106177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ab85a49c-828c-4e7c-b641-1641a7083873 Sep 16 20:38:12 devstack sudo[106177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:12 devstack sudo[106171]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:12 devstack sudo[106177]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:12 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-54359c7e-d107-461b-8a57-d0b7659461b5 tempest-CinderUnicodeTest-936709608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-55b804b9-385f-4a90-a838-71a5fc1d3ed4 1073741824" returned: 0 in 0.613s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:12 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-d78edb56-ba3b-4dfc-9b9b-46cfb13aaa08 tempest-VolumeImageDependencyTests-696686021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ab85a49c-828c-4e7c-b641-1641a7083873" returned: 0 in 0.421s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:12 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-d78edb56-ba3b-4dfc-9b9b-46cfb13aaa08 tempest-VolumeImageDependencyTests-696686021 None] Lock "cinder-quobyte-ab85a49c-828c-4e7c-b641-1641a7083873" released by "delete_volume" :: held 1.088s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:38:12 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-54359c7e-d107-461b-8a57-d0b7659461b5 tempest-CinderUnicodeTest-936709608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-55b804b9-385f-4a90-a838-71a5fc1d3ed4 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:12 devstack sudo[106184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-55b804b9-385f-4a90-a838-71a5fc1d3ed4 Sep 16 20:38:12 devstack sudo[106184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:12 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-d78edb56-ba3b-4dfc-9b9b-46cfb13aaa08 tempest-VolumeImageDependencyTests-696686021 None] Created reservations ['99910f68-963f-4257-aab0-154873606221', '5577d126-ac2d-4dd9-9968-b0857afe78df', '884736ae-3af2-44cf-9730-4d712e6620a7', 'f7b019c4-5093-426d-a0d6-a9d670d03034'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:38:12 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-d78edb56-ba3b-4dfc-9b9b-46cfb13aaa08 tempest-VolumeImageDependencyTests-696686021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:38:12 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-d78edb56-ba3b-4dfc-9b9b-46cfb13aaa08 tempest-VolumeImageDependencyTests-696686021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:38:12 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-d78edb56-ba3b-4dfc-9b9b-46cfb13aaa08 tempest-VolumeImageDependencyTests-696686021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:38:12 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-d78edb56-ba3b-4dfc-9b9b-46cfb13aaa08 tempest-VolumeImageDependencyTests-696686021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:38:12 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-d78edb56-ba3b-4dfc-9b9b-46cfb13aaa08 tempest-VolumeImageDependencyTests-696686021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:38:12 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-d78edb56-ba3b-4dfc-9b9b-46cfb13aaa08 tempest-VolumeImageDependencyTests-696686021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:12 devstack sudo[106186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:38:12 devstack sudo[106186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:12 devstack sudo[106184]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:12 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-54359c7e-d107-461b-8a57-d0b7659461b5 tempest-CinderUnicodeTest-936709608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-55b804b9-385f-4a90-a838-71a5fc1d3ed4" returned: 0 in 0.325s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:12 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-54359c7e-d107-461b-8a57-d0b7659461b5 tempest-CinderUnicodeTest-936709608 None] <== create_volume: return (1028ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:38:12 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-54359c7e-d107-461b-8a57-d0b7659461b5 tempest-CinderUnicodeTest-936709608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.032s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:38:12 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-54359c7e-d107-461b-8a57-d0b7659461b5 tempest-CinderUnicodeTest-936709608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65b97305-2239-4da2-bf63-d150a75c8285) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55b804b9-385f-4a90-a838-71a5fc1d3ed4', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:38:12 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-54359c7e-d107-461b-8a57-d0b7659461b5 tempest-CinderUnicodeTest-936709608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b743540a-1941-4f55-a94d-28f95ad527e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:38:12 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-54359c7e-d107-461b-8a57-d0b7659461b5 tempest-CinderUnicodeTest-936709608 None] Volume volume-55b804b9-385f-4a90-a838-71a5fc1d3ed4 (55b804b9-385f-4a90-a838-71a5fc1d3ed4): created successfully Sep 16 20:38:12 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-54359c7e-d107-461b-8a57-d0b7659461b5 tempest-CinderUnicodeTest-936709608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b743540a-1941-4f55-a94d-28f95ad527e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:38:12 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-54359c7e-d107-461b-8a57-d0b7659461b5 tempest-CinderUnicodeTest-936709608 None] Flow 'volume_create_manager' (fb5dfce1-d3ec-4a0f-a5f4-a5730a4bef6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:38:12 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-54359c7e-d107-461b-8a57-d0b7659461b5 tempest-CinderUnicodeTest-936709608 None] Created volume successfully. Sep 16 20:38:13 devstack sudo[106186]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:13 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-d78edb56-ba3b-4dfc-9b9b-46cfb13aaa08 tempest-VolumeImageDependencyTests-696686021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.289s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:13 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-d78edb56-ba3b-4dfc-9b9b-46cfb13aaa08 tempest-VolumeImageDependencyTests-696686021 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:38:13 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-d78edb56-ba3b-4dfc-9b9b-46cfb13aaa08 tempest-VolumeImageDependencyTests-696686021 None] Deleted volume successfully. Sep 16 20:38:13 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-d78edb56-ba3b-4dfc-9b9b-46cfb13aaa08 tempest-VolumeImageDependencyTests-696686021 None] Lock "cinder-ab85a49c-828c-4e7c-b641-1641a7083873-delete_volume" released by "delete_volume" :: held 1.720s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:38:14 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a620e27c-9430-465d-b6a1-d478d1045da6 tempest-CinderUnicodeTest-936709608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:38:14 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a620e27c-9430-465d-b6a1-d478d1045da6 tempest-CinderUnicodeTest-936709608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:38:14 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-a620e27c-9430-465d-b6a1-d478d1045da6 tempest-CinderUnicodeTest-936709608 None] Creating offline snapshot 81984d19-5c9b-4351-96ed-2d525d516215 of volume 55b804b9-385f-4a90-a838-71a5fc1d3ed4 {{(pid=86188) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 20:38:14 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ee79591-ab34-434b-933e-d6b45df127e4]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:38:14 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a620e27c-9430-465d-b6a1-d478d1045da6 tempest-CinderUnicodeTest-936709608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-55b804b9-385f-4a90-a838-71a5fc1d3ed4 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:14 devstack sudo[106190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-55b804b9-385f-4a90-a838-71a5fc1d3ed4 Sep 16 20:38:14 devstack sudo[106190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:14 devstack sudo[106190]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:14 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a620e27c-9430-465d-b6a1-d478d1045da6 tempest-CinderUnicodeTest-936709608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-55b804b9-385f-4a90-a838-71a5fc1d3ed4" returned: 0 in 0.491s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:14 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a620e27c-9430-465d-b6a1-d478d1045da6 tempest-CinderUnicodeTest-936709608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-55b804b9-385f-4a90-a838-71a5fc1d3ed4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-55b804b9-385f-4a90-a838-71a5fc1d3ed4.81984d19-5c9b-4351-96ed-2d525d516215 1G {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:14 devstack sudo[106195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-55b804b9-385f-4a90-a838-71a5fc1d3ed4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-55b804b9-385f-4a90-a838-71a5fc1d3ed4.81984d19-5c9b-4351-96ed-2d525d516215 1G Sep 16 20:38:14 devstack sudo[106195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:15 devstack sudo[106195]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:15 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a620e27c-9430-465d-b6a1-d478d1045da6 tempest-CinderUnicodeTest-936709608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-55b804b9-385f-4a90-a838-71a5fc1d3ed4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-55b804b9-385f-4a90-a838-71a5fc1d3ed4.81984d19-5c9b-4351-96ed-2d525d516215 1G" returned: 0 in 0.511s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:15 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a620e27c-9430-465d-b6a1-d478d1045da6 tempest-CinderUnicodeTest-936709608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55b804b9-385f-4a90-a838-71a5fc1d3ed4 -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-55b804b9-385f-4a90-a838-71a5fc1d3ed4.81984d19-5c9b-4351-96ed-2d525d516215 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:15 devstack sudo[106201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55b804b9-385f-4a90-a838-71a5fc1d3ed4 -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-55b804b9-385f-4a90-a838-71a5fc1d3ed4.81984d19-5c9b-4351-96ed-2d525d516215 Sep 16 20:38:15 devstack sudo[106201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:15 devstack sudo[106201]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:15 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a620e27c-9430-465d-b6a1-d478d1045da6 tempest-CinderUnicodeTest-936709608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55b804b9-385f-4a90-a838-71a5fc1d3ed4 -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-55b804b9-385f-4a90-a838-71a5fc1d3ed4.81984d19-5c9b-4351-96ed-2d525d516215" returned: 0 in 0.323s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:15 devstack cinder-volume[86188]: WARNING cinder.volume.drivers.remotefs [None req-a620e27c-9430-465d-b6a1-d478d1045da6 tempest-CinderUnicodeTest-936709608 None] /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-55b804b9-385f-4a90-a838-71a5fc1d3ed4.81984d19-5c9b-4351-96ed-2d525d516215 is being set with open permissions: ugo+rw Sep 16 20:38:15 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a620e27c-9430-465d-b6a1-d478d1045da6 tempest-CinderUnicodeTest-936709608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-55b804b9-385f-4a90-a838-71a5fc1d3ed4.81984d19-5c9b-4351-96ed-2d525d516215 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:15 devstack sudo[106207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-55b804b9-385f-4a90-a838-71a5fc1d3ed4.81984d19-5c9b-4351-96ed-2d525d516215 Sep 16 20:38:15 devstack sudo[106207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:15 devstack sudo[106207]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:15 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a620e27c-9430-465d-b6a1-d478d1045da6 tempest-CinderUnicodeTest-936709608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-55b804b9-385f-4a90-a838-71a5fc1d3ed4.81984d19-5c9b-4351-96ed-2d525d516215" returned: 0 in 0.352s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:16 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a620e27c-9430-465d-b6a1-d478d1045da6 tempest-CinderUnicodeTest-936709608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-55b804b9-385f-4a90-a838-71a5fc1d3ed4.info {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:16 devstack sudo[106210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-55b804b9-385f-4a90-a838-71a5fc1d3ed4.info Sep 16 20:38:16 devstack sudo[106210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:16 devstack sudo[106210]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:16 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a620e27c-9430-465d-b6a1-d478d1045da6 tempest-CinderUnicodeTest-936709608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-55b804b9-385f-4a90-a838-71a5fc1d3ed4.info" returned: 0 in 0.345s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:16 devstack cinder-volume[86188]: WARNING cinder.volume.drivers.remotefs [None req-a620e27c-9430-465d-b6a1-d478d1045da6 tempest-CinderUnicodeTest-936709608 None] /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-55b804b9-385f-4a90-a838-71a5fc1d3ed4.info is being set with open permissions: ugo+rw Sep 16 20:38:16 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a620e27c-9430-465d-b6a1-d478d1045da6 tempest-CinderUnicodeTest-936709608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-55b804b9-385f-4a90-a838-71a5fc1d3ed4.info {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:16 devstack sudo[106213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-55b804b9-385f-4a90-a838-71a5fc1d3ed4.info Sep 16 20:38:16 devstack sudo[106213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:16 devstack sudo[106213]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:16 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a620e27c-9430-465d-b6a1-d478d1045da6 tempest-CinderUnicodeTest-936709608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-55b804b9-385f-4a90-a838-71a5fc1d3ed4.info" returned: 0 in 0.419s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:16 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a620e27c-9430-465d-b6a1-d478d1045da6 tempest-CinderUnicodeTest-936709608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.597s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:38:16 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-a620e27c-9430-465d-b6a1-d478d1045da6 tempest-CinderUnicodeTest-936709608 None] Create snapshot completed successfully Sep 16 20:38:17 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-64385cd4-eb6b-4e20-b8d7-1a7fa884c485 tempest-CinderUnicodeTest-936709608 None] Acquiring lock "cinder-81984d19-5c9b-4351-96ed-2d525d516215-delete_snapshot" by "delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:38:17 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-64385cd4-eb6b-4e20-b8d7-1a7fa884c485 tempest-CinderUnicodeTest-936709608 None] Lock "cinder-81984d19-5c9b-4351-96ed-2d525d516215-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:38:17 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-64385cd4-eb6b-4e20-b8d7-1a7fa884c485 tempest-CinderUnicodeTest-936709608 None] Acquiring lock "cinder-quobyte-55b804b9-385f-4a90-a838-71a5fc1d3ed4" by "delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:38:17 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-64385cd4-eb6b-4e20-b8d7-1a7fa884c485 tempest-CinderUnicodeTest-936709608 None] Lock "cinder-quobyte-55b804b9-385f-4a90-a838-71a5fc1d3ed4" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:38:17 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-64385cd4-eb6b-4e20-b8d7-1a7fa884c485 tempest-CinderUnicodeTest-936709608 None] Acquiring lock "cinder-quobyte-81984d19-5c9b-4351-96ed-2d525d516215" by "_delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:38:17 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-64385cd4-eb6b-4e20-b8d7-1a7fa884c485 tempest-CinderUnicodeTest-936709608 None] Lock "cinder-quobyte-81984d19-5c9b-4351-96ed-2d525d516215" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:38:17 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-64385cd4-eb6b-4e20-b8d7-1a7fa884c485 tempest-CinderUnicodeTest-936709608 None] Deleting offline snapshot 81984d19-5c9b-4351-96ed-2d525d516215 of volume 55b804b9-385f-4a90-a838-71a5fc1d3ed4 {{(pid=86188) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 20:38:17 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-64385cd4-eb6b-4e20-b8d7-1a7fa884c485 tempest-CinderUnicodeTest-936709608 None] snapshot_file for this snap is: volume-55b804b9-385f-4a90-a838-71a5fc1d3ed4.81984d19-5c9b-4351-96ed-2d525d516215 {{(pid=86188) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 20:38:17 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[db84fdcf-e7fc-42ed-9813-c0c51d209f9f]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:38:17 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-64385cd4-eb6b-4e20-b8d7-1a7fa884c485 tempest-CinderUnicodeTest-936709608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-55b804b9-385f-4a90-a838-71a5fc1d3ed4.81984d19-5c9b-4351-96ed-2d525d516215 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:17 devstack sudo[106216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-55b804b9-385f-4a90-a838-71a5fc1d3ed4.81984d19-5c9b-4351-96ed-2d525d516215 Sep 16 20:38:17 devstack sudo[106216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:18 devstack sudo[106216]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:18 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-64385cd4-eb6b-4e20-b8d7-1a7fa884c485 tempest-CinderUnicodeTest-936709608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-55b804b9-385f-4a90-a838-71a5fc1d3ed4.81984d19-5c9b-4351-96ed-2d525d516215" returned: 0 in 0.497s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:18 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-64385cd4-eb6b-4e20-b8d7-1a7fa884c485 tempest-CinderUnicodeTest-936709608 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-55b804b9-385f-4a90-a838-71a5fc1d3ed4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86188) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 20:38:18 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fae2c9d-b094-471f-b150-075e68af5d62]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:38:18 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-64385cd4-eb6b-4e20-b8d7-1a7fa884c485 tempest-CinderUnicodeTest-936709608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-55b804b9-385f-4a90-a838-71a5fc1d3ed4 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:18 devstack sudo[106221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-55b804b9-385f-4a90-a838-71a5fc1d3ed4 Sep 16 20:38:18 devstack sudo[106221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:18 devstack sudo[106221]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:18 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-64385cd4-eb6b-4e20-b8d7-1a7fa884c485 tempest-CinderUnicodeTest-936709608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-55b804b9-385f-4a90-a838-71a5fc1d3ed4" returned: 0 in 0.499s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:18 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-64385cd4-eb6b-4e20-b8d7-1a7fa884c485 tempest-CinderUnicodeTest-936709608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-55b804b9-385f-4a90-a838-71a5fc1d3ed4.81984d19-5c9b-4351-96ed-2d525d516215 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:18 devstack sudo[106228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-55b804b9-385f-4a90-a838-71a5fc1d3ed4.81984d19-5c9b-4351-96ed-2d525d516215 Sep 16 20:38:18 devstack sudo[106228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:19 devstack sudo[106228]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:19 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-64385cd4-eb6b-4e20-b8d7-1a7fa884c485 tempest-CinderUnicodeTest-936709608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-55b804b9-385f-4a90-a838-71a5fc1d3ed4.81984d19-5c9b-4351-96ed-2d525d516215" returned: 0 in 0.505s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:19 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-64385cd4-eb6b-4e20-b8d7-1a7fa884c485 tempest-CinderUnicodeTest-936709608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-55b804b9-385f-4a90-a838-71a5fc1d3ed4.81984d19-5c9b-4351-96ed-2d525d516215 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:19 devstack sudo[106233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-55b804b9-385f-4a90-a838-71a5fc1d3ed4.81984d19-5c9b-4351-96ed-2d525d516215 Sep 16 20:38:19 devstack sudo[106233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:19 devstack sudo[106233]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:19 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-64385cd4-eb6b-4e20-b8d7-1a7fa884c485 tempest-CinderUnicodeTest-936709608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-55b804b9-385f-4a90-a838-71a5fc1d3ed4.81984d19-5c9b-4351-96ed-2d525d516215" returned: 0 in 0.293s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:19 devstack cinder-volume[86188]: DEBUG dbcounter [-] [86188] Writing DB stats cinder:SELECT=193,cinder:UPDATE=241,cinder:INSERT=76,cinder:DELETE=21 {{(pid=86188) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 20:38:19 devstack cinder-volume[86188]: DEBUG dbcounter [-] [86188] Writing DB stats cinder:UPDATE=270,cinder:SELECT=180,cinder:DELETE=26,cinder:INSERT=61 {{(pid=86188) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 20:38:19 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-64385cd4-eb6b-4e20-b8d7-1a7fa884c485 tempest-CinderUnicodeTest-936709608 None] Lock "cinder-quobyte-81984d19-5c9b-4351-96ed-2d525d516215" released by "_delete_snapshot" :: held 1.984s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:38:19 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-64385cd4-eb6b-4e20-b8d7-1a7fa884c485 tempest-CinderUnicodeTest-936709608 None] Lock "cinder-quobyte-55b804b9-385f-4a90-a838-71a5fc1d3ed4" released by "delete_snapshot" :: held 2.020s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:38:19 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-64385cd4-eb6b-4e20-b8d7-1a7fa884c485 tempest-CinderUnicodeTest-936709608 None] Created reservations ['8a169f84-470d-4e12-823c-d3aa78107088', '994451fd-5086-45b2-89a9-19a1feb93457', 'f5927da9-c5c9-4819-919a-41afaea65dcc', '0bb9269c-b6a0-4e68-8503-22493ac01075'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:38:19 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-64385cd4-eb6b-4e20-b8d7-1a7fa884c485 tempest-CinderUnicodeTest-936709608 None] Delete snapshot completed successfully. Sep 16 20:38:19 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-64385cd4-eb6b-4e20-b8d7-1a7fa884c485 tempest-CinderUnicodeTest-936709608 None] Lock "cinder-81984d19-5c9b-4351-96ed-2d525d516215-delete_snapshot" released by "delete_snapshot" :: held 2.274s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:38:20 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-53e605dc-5c62-4033-9c5c-3a9bf68c7e60 tempest-CinderUnicodeTest-936709608 None] Acquiring lock "cinder-55b804b9-385f-4a90-a838-71a5fc1d3ed4-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:38:20 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-53e605dc-5c62-4033-9c5c-3a9bf68c7e60 tempest-CinderUnicodeTest-936709608 None] Lock "cinder-55b804b9-385f-4a90-a838-71a5fc1d3ed4-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:38:20 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-53e605dc-5c62-4033-9c5c-3a9bf68c7e60 tempest-CinderUnicodeTest-936709608 None] Acquiring lock "cinder-quobyte-55b804b9-385f-4a90-a838-71a5fc1d3ed4" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:38:20 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-53e605dc-5c62-4033-9c5c-3a9bf68c7e60 tempest-CinderUnicodeTest-936709608 None] Lock "cinder-quobyte-55b804b9-385f-4a90-a838-71a5fc1d3ed4" acquired by "delete_volume" :: waited 0.030s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:38:20 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[257023d8-a73c-4f93-96cd-264320b091c6]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:38:20 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-53e605dc-5c62-4033-9c5c-3a9bf68c7e60 tempest-CinderUnicodeTest-936709608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-55b804b9-385f-4a90-a838-71a5fc1d3ed4 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:21 devstack sudo[106238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-55b804b9-385f-4a90-a838-71a5fc1d3ed4 Sep 16 20:38:21 devstack sudo[106238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:21 devstack sudo[106238]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:21 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-53e605dc-5c62-4033-9c5c-3a9bf68c7e60 tempest-CinderUnicodeTest-936709608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-55b804b9-385f-4a90-a838-71a5fc1d3ed4" returned: 0 in 0.536s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:21 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-53e605dc-5c62-4033-9c5c-3a9bf68c7e60 tempest-CinderUnicodeTest-936709608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-55b804b9-385f-4a90-a838-71a5fc1d3ed4 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:21 devstack sudo[106243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-55b804b9-385f-4a90-a838-71a5fc1d3ed4 Sep 16 20:38:21 devstack sudo[106243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:21 devstack sudo[106243]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:21 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-53e605dc-5c62-4033-9c5c-3a9bf68c7e60 tempest-CinderUnicodeTest-936709608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-55b804b9-385f-4a90-a838-71a5fc1d3ed4" returned: 0 in 0.316s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:21 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-53e605dc-5c62-4033-9c5c-3a9bf68c7e60 tempest-CinderUnicodeTest-936709608 None] Lock "cinder-quobyte-55b804b9-385f-4a90-a838-71a5fc1d3ed4" released by "delete_volume" :: held 0.953s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:38:21 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-53e605dc-5c62-4033-9c5c-3a9bf68c7e60 tempest-CinderUnicodeTest-936709608 None] Created reservations ['7508756c-9a5c-419f-8551-e3f334844524', '024f25f1-9083-4b6b-a317-36bf91de29af', 'a8c240fd-9b93-4b09-a359-ee902735e08c', 'eabbc116-eeaf-46c3-87e7-b47b7ea8bf3b'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:38:22 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-53e605dc-5c62-4033-9c5c-3a9bf68c7e60 tempest-CinderUnicodeTest-936709608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:38:22 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-53e605dc-5c62-4033-9c5c-3a9bf68c7e60 tempest-CinderUnicodeTest-936709608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:38:22 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-53e605dc-5c62-4033-9c5c-3a9bf68c7e60 tempest-CinderUnicodeTest-936709608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:38:22 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-53e605dc-5c62-4033-9c5c-3a9bf68c7e60 tempest-CinderUnicodeTest-936709608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:38:22 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-53e605dc-5c62-4033-9c5c-3a9bf68c7e60 tempest-CinderUnicodeTest-936709608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:38:22 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-53e605dc-5c62-4033-9c5c-3a9bf68c7e60 tempest-CinderUnicodeTest-936709608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:22 devstack sudo[106246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:38:22 devstack sudo[106246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:22 devstack sudo[106246]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:22 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-53e605dc-5c62-4033-9c5c-3a9bf68c7e60 tempest-CinderUnicodeTest-936709608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.392s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:22 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-53e605dc-5c62-4033-9c5c-3a9bf68c7e60 tempest-CinderUnicodeTest-936709608 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:38:22 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-53e605dc-5c62-4033-9c5c-3a9bf68c7e60 tempest-CinderUnicodeTest-936709608 None] Deleted volume successfully. Sep 16 20:38:22 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed5dc443-a2ba-40de-b320-14ed62f8c2cb tempest-ProjectReaderTests-35295440 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:38:22 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ed5dc443-a2ba-40de-b320-14ed62f8c2cb tempest-ProjectReaderTests-35295440 None] Flow 'volume_create_manager' (1ad8f7a5-bd60-47d8-afdf-8b15a13861df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:38:22 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ed5dc443-a2ba-40de-b320-14ed62f8c2cb tempest-ProjectReaderTests-35295440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d7bdd23-13f7-4e4d-af7b-9d5f03e524d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:38:22 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ed5dc443-a2ba-40de-b320-14ed62f8c2cb tempest-ProjectReaderTests-35295440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d7bdd23-13f7-4e4d-af7b-9d5f03e524d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:38:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1006850717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc81dfde-3afa-4fd1-9520-ad04c9072aec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6e1e98f9bbd477bb086fd338852e55f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:38:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:38:22Z,use_quota=True,user_id='64639a1085d446729ef1b66978c264bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:38:22 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ed5dc443-a2ba-40de-b320-14ed62f8c2cb tempest-ProjectReaderTests-35295440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88650323-0be0-414f-9464-9465ba01e01c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:38:22 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ed5dc443-a2ba-40de-b320-14ed62f8c2cb tempest-ProjectReaderTests-35295440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88650323-0be0-414f-9464-9465ba01e01c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:38:22 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ed5dc443-a2ba-40de-b320-14ed62f8c2cb tempest-ProjectReaderTests-35295440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98d29930-3833-4eae-94d1-7ace8a59788e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:38:22 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ed5dc443-a2ba-40de-b320-14ed62f8c2cb tempest-ProjectReaderTests-35295440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98d29930-3833-4eae-94d1-7ace8a59788e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc81dfde-3afa-4fd1-9520-ad04c9072aec', 'volume_name': 'volume-cc81dfde-3afa-4fd1-9520-ad04c9072aec', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:38:22 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ed5dc443-a2ba-40de-b320-14ed62f8c2cb tempest-ProjectReaderTests-35295440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a38f8be4-a8a6-4b3f-b1dc-9b161cefe8d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:38:22 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ed5dc443-a2ba-40de-b320-14ed62f8c2cb tempest-ProjectReaderTests-35295440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a38f8be4-a8a6-4b3f-b1dc-9b161cefe8d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:38:22 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ed5dc443-a2ba-40de-b320-14ed62f8c2cb tempest-ProjectReaderTests-35295440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb675b84-88a6-4d56-9afb-f68ca2e1c6d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:38:22 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-ed5dc443-a2ba-40de-b320-14ed62f8c2cb tempest-ProjectReaderTests-35295440 None] Volume cc81dfde-3afa-4fd1-9520-ad04c9072aec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc81dfde-3afa-4fd1-9520-ad04c9072aec', 'volume_size': 1} Sep 16 20:38:22 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-ed5dc443-a2ba-40de-b320-14ed62f8c2cb tempest-ProjectReaderTests-35295440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:38:22 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-ed5dc443-a2ba-40de-b320-14ed62f8c2cb tempest-ProjectReaderTests-35295440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:38:22 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-ed5dc443-a2ba-40de-b320-14ed62f8c2cb tempest-ProjectReaderTests-35295440 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:38:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1006850717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc81dfde-3afa-4fd1-9520-ad04c9072aec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6e1e98f9bbd477bb086fd338852e55f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:38:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:38:22Z,use_quota=True,user_id='64639a1085d446729ef1b66978c264bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:38:22 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-ed5dc443-a2ba-40de-b320-14ed62f8c2cb tempest-ProjectReaderTests-35295440 None] Creating volume cc81dfde-3afa-4fd1-9520-ad04c9072aec {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:38:22 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-ed5dc443-a2ba-40de-b320-14ed62f8c2cb tempest-ProjectReaderTests-35295440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:38:22 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-ed5dc443-a2ba-40de-b320-14ed62f8c2cb tempest-ProjectReaderTests-35295440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:38:22 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-ed5dc443-a2ba-40de-b320-14ed62f8c2cb tempest-ProjectReaderTests-35295440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:38:22 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-ed5dc443-a2ba-40de-b320-14ed62f8c2cb tempest-ProjectReaderTests-35295440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:38:22 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-ed5dc443-a2ba-40de-b320-14ed62f8c2cb tempest-ProjectReaderTests-35295440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:38:22 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-ed5dc443-a2ba-40de-b320-14ed62f8c2cb tempest-ProjectReaderTests-35295440 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:38:22 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-ed5dc443-a2ba-40de-b320-14ed62f8c2cb tempest-ProjectReaderTests-35295440 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:38:22 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ed5dc443-a2ba-40de-b320-14ed62f8c2cb tempest-ProjectReaderTests-35295440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-cc81dfde-3afa-4fd1-9520-ad04c9072aec 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:22 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-53e605dc-5c62-4033-9c5c-3a9bf68c7e60 tempest-CinderUnicodeTest-936709608 None] Lock "cinder-55b804b9-385f-4a90-a838-71a5fc1d3ed4-delete_volume" released by "delete_volume" :: held 1.814s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:38:22 devstack sudo[106249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-cc81dfde-3afa-4fd1-9520-ad04c9072aec 1073741824 Sep 16 20:38:22 devstack sudo[106249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:23 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-f261be90-0cd4-49cc-9198-7d98d951a70c tempest-CinderUnicodeTest-936709608 None] Acquiring lock "cinder-608046a2-f284-47bf-a442-b8a3f621b943-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:38:23 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-f261be90-0cd4-49cc-9198-7d98d951a70c tempest-CinderUnicodeTest-936709608 None] Lock "cinder-608046a2-f284-47bf-a442-b8a3f621b943-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:38:23 devstack sudo[106249]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:23 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ed5dc443-a2ba-40de-b320-14ed62f8c2cb tempest-ProjectReaderTests-35295440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-cc81dfde-3afa-4fd1-9520-ad04c9072aec 1073741824" returned: 0 in 0.658s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:23 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-f261be90-0cd4-49cc-9198-7d98d951a70c tempest-CinderUnicodeTest-936709608 None] Acquiring lock "cinder-quobyte-608046a2-f284-47bf-a442-b8a3f621b943" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:38:23 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-f261be90-0cd4-49cc-9198-7d98d951a70c tempest-CinderUnicodeTest-936709608 None] Lock "cinder-quobyte-608046a2-f284-47bf-a442-b8a3f621b943" acquired by "delete_volume" :: waited 0.025s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:38:23 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ed5dc443-a2ba-40de-b320-14ed62f8c2cb tempest-ProjectReaderTests-35295440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-cc81dfde-3afa-4fd1-9520-ad04c9072aec {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:23 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a1c6bbf-f7ba-4c22-af3f-f78222647800]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:38:23 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f261be90-0cd4-49cc-9198-7d98d951a70c tempest-CinderUnicodeTest-936709608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-608046a2-f284-47bf-a442-b8a3f621b943 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:23 devstack sudo[106255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-cc81dfde-3afa-4fd1-9520-ad04c9072aec Sep 16 20:38:23 devstack sudo[106255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:23 devstack sudo[106257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-608046a2-f284-47bf-a442-b8a3f621b943 Sep 16 20:38:23 devstack sudo[106257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:23 devstack sudo[106255]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:23 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ed5dc443-a2ba-40de-b320-14ed62f8c2cb tempest-ProjectReaderTests-35295440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-cc81dfde-3afa-4fd1-9520-ad04c9072aec" returned: 0 in 0.336s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:23 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-ed5dc443-a2ba-40de-b320-14ed62f8c2cb tempest-ProjectReaderTests-35295440 None] <== create_volume: return (1086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:38:23 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-ed5dc443-a2ba-40de-b320-14ed62f8c2cb tempest-ProjectReaderTests-35295440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.089s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:38:23 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ed5dc443-a2ba-40de-b320-14ed62f8c2cb tempest-ProjectReaderTests-35295440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb675b84-88a6-4d56-9afb-f68ca2e1c6d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc81dfde-3afa-4fd1-9520-ad04c9072aec', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:38:23 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ed5dc443-a2ba-40de-b320-14ed62f8c2cb tempest-ProjectReaderTests-35295440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (782b5b8c-eab4-4f85-8bb4-91adefba3965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:38:23 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-ed5dc443-a2ba-40de-b320-14ed62f8c2cb tempest-ProjectReaderTests-35295440 None] Volume volume-cc81dfde-3afa-4fd1-9520-ad04c9072aec (cc81dfde-3afa-4fd1-9520-ad04c9072aec): created successfully Sep 16 20:38:23 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ed5dc443-a2ba-40de-b320-14ed62f8c2cb tempest-ProjectReaderTests-35295440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (782b5b8c-eab4-4f85-8bb4-91adefba3965) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:38:23 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-ed5dc443-a2ba-40de-b320-14ed62f8c2cb tempest-ProjectReaderTests-35295440 None] Flow 'volume_create_manager' (1ad8f7a5-bd60-47d8-afdf-8b15a13861df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:38:23 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-ed5dc443-a2ba-40de-b320-14ed62f8c2cb tempest-ProjectReaderTests-35295440 None] Created volume successfully. Sep 16 20:38:23 devstack sudo[106257]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:23 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f261be90-0cd4-49cc-9198-7d98d951a70c tempest-CinderUnicodeTest-936709608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-608046a2-f284-47bf-a442-b8a3f621b943" returned: 0 in 0.456s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:23 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f261be90-0cd4-49cc-9198-7d98d951a70c tempest-CinderUnicodeTest-936709608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-608046a2-f284-47bf-a442-b8a3f621b943 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:23 devstack sudo[106263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-608046a2-f284-47bf-a442-b8a3f621b943 Sep 16 20:38:23 devstack sudo[106263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:24 devstack sudo[106263]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:24 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f261be90-0cd4-49cc-9198-7d98d951a70c tempest-CinderUnicodeTest-936709608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-608046a2-f284-47bf-a442-b8a3f621b943" returned: 0 in 0.257s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:24 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-f261be90-0cd4-49cc-9198-7d98d951a70c tempest-CinderUnicodeTest-936709608 None] Lock "cinder-quobyte-608046a2-f284-47bf-a442-b8a3f621b943" released by "delete_volume" :: held 0.820s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:38:24 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-f261be90-0cd4-49cc-9198-7d98d951a70c tempest-CinderUnicodeTest-936709608 None] Created reservations ['f84c9a8e-b6c6-472f-aae8-f2a41776e829', 'a7b26ad4-3914-4564-b7f6-7157467b62bd', '71595163-69d9-4e10-9033-4aceca1ae4da', '335ac74d-cb5e-4ae2-adff-d846361be942'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:38:24 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-f261be90-0cd4-49cc-9198-7d98d951a70c tempest-CinderUnicodeTest-936709608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:38:24 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-f261be90-0cd4-49cc-9198-7d98d951a70c tempest-CinderUnicodeTest-936709608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:38:24 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-f261be90-0cd4-49cc-9198-7d98d951a70c tempest-CinderUnicodeTest-936709608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:38:24 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-f261be90-0cd4-49cc-9198-7d98d951a70c tempest-CinderUnicodeTest-936709608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:38:24 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-f261be90-0cd4-49cc-9198-7d98d951a70c tempest-CinderUnicodeTest-936709608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:38:24 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f261be90-0cd4-49cc-9198-7d98d951a70c tempest-CinderUnicodeTest-936709608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:24 devstack sudo[106266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:38:24 devstack sudo[106266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:24 devstack sudo[106266]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:24 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f261be90-0cd4-49cc-9198-7d98d951a70c tempest-CinderUnicodeTest-936709608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.329s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:24 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-f261be90-0cd4-49cc-9198-7d98d951a70c tempest-CinderUnicodeTest-936709608 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:38:24 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-f261be90-0cd4-49cc-9198-7d98d951a70c tempest-CinderUnicodeTest-936709608 None] Deleted volume successfully. Sep 16 20:38:24 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-f261be90-0cd4-49cc-9198-7d98d951a70c tempest-CinderUnicodeTest-936709608 None] Lock "cinder-608046a2-f284-47bf-a442-b8a3f621b943-delete_volume" released by "delete_volume" :: held 1.455s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:38:25 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-5d383b2e-7a9f-4cf5-9eae-ac2c35b3e79d tempest-ProjectReaderTests-35295440 None] Acquiring lock "cinder-cc81dfde-3afa-4fd1-9520-ad04c9072aec-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:38:25 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-5d383b2e-7a9f-4cf5-9eae-ac2c35b3e79d tempest-ProjectReaderTests-35295440 None] Lock "cinder-cc81dfde-3afa-4fd1-9520-ad04c9072aec-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:38:25 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-5d383b2e-7a9f-4cf5-9eae-ac2c35b3e79d tempest-ProjectReaderTests-35295440 None] Acquiring lock "cinder-quobyte-cc81dfde-3afa-4fd1-9520-ad04c9072aec" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:38:25 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-5d383b2e-7a9f-4cf5-9eae-ac2c35b3e79d tempest-ProjectReaderTests-35295440 None] Lock "cinder-quobyte-cc81dfde-3afa-4fd1-9520-ad04c9072aec" acquired by "delete_volume" :: waited 0.015s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:38:25 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[10dcd873-80ed-4453-bab8-d3288ba2d100]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:38:25 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-5d383b2e-7a9f-4cf5-9eae-ac2c35b3e79d tempest-ProjectReaderTests-35295440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-cc81dfde-3afa-4fd1-9520-ad04c9072aec {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:25 devstack sudo[106269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-cc81dfde-3afa-4fd1-9520-ad04c9072aec Sep 16 20:38:25 devstack sudo[106269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:25 devstack sudo[106269]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:25 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-5d383b2e-7a9f-4cf5-9eae-ac2c35b3e79d tempest-ProjectReaderTests-35295440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-cc81dfde-3afa-4fd1-9520-ad04c9072aec" returned: 0 in 0.527s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:25 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-5d383b2e-7a9f-4cf5-9eae-ac2c35b3e79d tempest-ProjectReaderTests-35295440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-cc81dfde-3afa-4fd1-9520-ad04c9072aec {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:25 devstack sudo[106276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-cc81dfde-3afa-4fd1-9520-ad04c9072aec Sep 16 20:38:25 devstack sudo[106276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:25 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4bfcce9-cee2-4411-816f-1e97e2d637bc tempest-ProjectMemberTests-730908627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:38:25 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-b4bfcce9-cee2-4411-816f-1e97e2d637bc tempest-ProjectMemberTests-730908627 None] Flow 'volume_create_manager' (d0f23cd1-4835-48ba-aff2-4a837c93b47c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:38:25 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-b4bfcce9-cee2-4411-816f-1e97e2d637bc tempest-ProjectMemberTests-730908627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aeacdff7-9da8-42d8-85e8-e1a786b3fd00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:38:25 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-b4bfcce9-cee2-4411-816f-1e97e2d637bc tempest-ProjectMemberTests-730908627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aeacdff7-9da8-42d8-85e8-e1a786b3fd00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:38:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-396805418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3c6ec07-3fba-4161-ac43-15dcb3b831c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d632f989377844f6b93c3b9bf838981d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:38:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:38:26Z,use_quota=True,user_id='5db8cf25fcc448629ab58c8006482185',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:38:25 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-b4bfcce9-cee2-4411-816f-1e97e2d637bc tempest-ProjectMemberTests-730908627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (740c59c4-affa-4b00-9c16-5cf4b941efbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:38:25 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-b4bfcce9-cee2-4411-816f-1e97e2d637bc tempest-ProjectMemberTests-730908627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (740c59c4-affa-4b00-9c16-5cf4b941efbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:38:25 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-b4bfcce9-cee2-4411-816f-1e97e2d637bc tempest-ProjectMemberTests-730908627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c489e15-b581-473a-86f2-96a2ad6bd422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:38:25 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-b4bfcce9-cee2-4411-816f-1e97e2d637bc tempest-ProjectMemberTests-730908627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c489e15-b581-473a-86f2-96a2ad6bd422) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3c6ec07-3fba-4161-ac43-15dcb3b831c0', 'volume_name': 'volume-e3c6ec07-3fba-4161-ac43-15dcb3b831c0', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:38:25 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-b4bfcce9-cee2-4411-816f-1e97e2d637bc tempest-ProjectMemberTests-730908627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c4c6428-667d-4a99-9e28-f9081a4df0da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:38:25 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-b4bfcce9-cee2-4411-816f-1e97e2d637bc tempest-ProjectMemberTests-730908627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c4c6428-667d-4a99-9e28-f9081a4df0da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:38:25 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-b4bfcce9-cee2-4411-816f-1e97e2d637bc tempest-ProjectMemberTests-730908627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (421b4a4a-7a6b-4a0d-b06b-546a891b6e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:38:25 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-b4bfcce9-cee2-4411-816f-1e97e2d637bc tempest-ProjectMemberTests-730908627 None] Volume e3c6ec07-3fba-4161-ac43-15dcb3b831c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3c6ec07-3fba-4161-ac43-15dcb3b831c0', 'volume_size': 1} Sep 16 20:38:25 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-b4bfcce9-cee2-4411-816f-1e97e2d637bc tempest-ProjectMemberTests-730908627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:38:25 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-b4bfcce9-cee2-4411-816f-1e97e2d637bc tempest-ProjectMemberTests-730908627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:38:25 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-b4bfcce9-cee2-4411-816f-1e97e2d637bc tempest-ProjectMemberTests-730908627 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:38:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-396805418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3c6ec07-3fba-4161-ac43-15dcb3b831c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d632f989377844f6b93c3b9bf838981d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:38:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:38:26Z,use_quota=True,user_id='5db8cf25fcc448629ab58c8006482185',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:38:25 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-b4bfcce9-cee2-4411-816f-1e97e2d637bc tempest-ProjectMemberTests-730908627 None] Creating volume e3c6ec07-3fba-4161-ac43-15dcb3b831c0 {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:38:25 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-b4bfcce9-cee2-4411-816f-1e97e2d637bc tempest-ProjectMemberTests-730908627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:38:25 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-b4bfcce9-cee2-4411-816f-1e97e2d637bc tempest-ProjectMemberTests-730908627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:38:25 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-b4bfcce9-cee2-4411-816f-1e97e2d637bc tempest-ProjectMemberTests-730908627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:38:25 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-b4bfcce9-cee2-4411-816f-1e97e2d637bc tempest-ProjectMemberTests-730908627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:38:25 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-b4bfcce9-cee2-4411-816f-1e97e2d637bc tempest-ProjectMemberTests-730908627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:38:26 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-b4bfcce9-cee2-4411-816f-1e97e2d637bc tempest-ProjectMemberTests-730908627 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:38:26 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-b4bfcce9-cee2-4411-816f-1e97e2d637bc tempest-ProjectMemberTests-730908627 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:38:26 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b4bfcce9-cee2-4411-816f-1e97e2d637bc tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e3c6ec07-3fba-4161-ac43-15dcb3b831c0 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:26 devstack sudo[106279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e3c6ec07-3fba-4161-ac43-15dcb3b831c0 1073741824 Sep 16 20:38:26 devstack sudo[106279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:26 devstack sudo[106276]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:26 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-5d383b2e-7a9f-4cf5-9eae-ac2c35b3e79d tempest-ProjectReaderTests-35295440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-cc81dfde-3afa-4fd1-9520-ad04c9072aec" returned: 0 in 0.363s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:26 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-5d383b2e-7a9f-4cf5-9eae-ac2c35b3e79d tempest-ProjectReaderTests-35295440 None] Lock "cinder-quobyte-cc81dfde-3afa-4fd1-9520-ad04c9072aec" released by "delete_volume" :: held 0.952s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:38:26 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-5d383b2e-7a9f-4cf5-9eae-ac2c35b3e79d tempest-ProjectReaderTests-35295440 None] Created reservations ['b50e8acc-07cc-4fcb-88d6-6f3c6a289537', 'd5f404a9-2a0d-409b-9727-82b1cf39c176', 'b83f9367-dfa4-46a4-9b71-c68b3a4e71bd', '63d5d86f-dad8-49b6-a212-882b9891c915'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:38:26 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-5d383b2e-7a9f-4cf5-9eae-ac2c35b3e79d tempest-ProjectReaderTests-35295440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:38:26 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-5d383b2e-7a9f-4cf5-9eae-ac2c35b3e79d tempest-ProjectReaderTests-35295440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:38:26 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-5d383b2e-7a9f-4cf5-9eae-ac2c35b3e79d tempest-ProjectReaderTests-35295440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:38:26 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-5d383b2e-7a9f-4cf5-9eae-ac2c35b3e79d tempest-ProjectReaderTests-35295440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:38:26 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-5d383b2e-7a9f-4cf5-9eae-ac2c35b3e79d tempest-ProjectReaderTests-35295440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:38:26 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-5d383b2e-7a9f-4cf5-9eae-ac2c35b3e79d tempest-ProjectReaderTests-35295440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:26 devstack sudo[106283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:38:26 devstack sudo[106283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:26 devstack sudo[106283]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:26 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-5d383b2e-7a9f-4cf5-9eae-ac2c35b3e79d tempest-ProjectReaderTests-35295440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.277s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:26 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-5d383b2e-7a9f-4cf5-9eae-ac2c35b3e79d tempest-ProjectReaderTests-35295440 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:38:26 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-5d383b2e-7a9f-4cf5-9eae-ac2c35b3e79d tempest-ProjectReaderTests-35295440 None] Deleted volume successfully. Sep 16 20:38:26 devstack sudo[106279]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:26 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b4bfcce9-cee2-4411-816f-1e97e2d637bc tempest-ProjectMemberTests-730908627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e3c6ec07-3fba-4161-ac43-15dcb3b831c0 1073741824" returned: 0 in 0.601s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:26 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-5d383b2e-7a9f-4cf5-9eae-ac2c35b3e79d tempest-ProjectReaderTests-35295440 None] Lock "cinder-cc81dfde-3afa-4fd1-9520-ad04c9072aec-delete_volume" released by "delete_volume" :: held 1.567s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:38:26 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b4bfcce9-cee2-4411-816f-1e97e2d637bc tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e3c6ec07-3fba-4161-ac43-15dcb3b831c0 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:26 devstack sudo[106288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e3c6ec07-3fba-4161-ac43-15dcb3b831c0 Sep 16 20:38:26 devstack sudo[106288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:26 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e0f2cd4-b1eb-4929-a87c-30960a0f5763 tempest-SnapshotDependencyTests-1531567735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:38:26 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-3e0f2cd4-b1eb-4929-a87c-30960a0f5763 tempest-SnapshotDependencyTests-1531567735 None] Flow 'volume_create_manager' (5c004953-8652-4636-965f-ebd2004c954a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:38:26 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-3e0f2cd4-b1eb-4929-a87c-30960a0f5763 tempest-SnapshotDependencyTests-1531567735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a79a61c9-dcf6-4b22-baa4-facae35d00f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:38:26 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-3e0f2cd4-b1eb-4929-a87c-30960a0f5763 tempest-SnapshotDependencyTests-1531567735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a79a61c9-dcf6-4b22-baa4-facae35d00f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:38:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-512895547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9aac7519-231e-4085-ae3c-9be2c4b8ce99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e35d31926dc458897d07aecbddd24b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:38:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:38:27Z,use_quota=True,user_id='0c2b0795628242df85abc05c86314982',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:38:26 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-3e0f2cd4-b1eb-4929-a87c-30960a0f5763 tempest-SnapshotDependencyTests-1531567735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43a124d8-8239-4cf9-bdb7-a67e14cc8f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:38:26 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-3e0f2cd4-b1eb-4929-a87c-30960a0f5763 tempest-SnapshotDependencyTests-1531567735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43a124d8-8239-4cf9-bdb7-a67e14cc8f48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:38:26 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-3e0f2cd4-b1eb-4929-a87c-30960a0f5763 tempest-SnapshotDependencyTests-1531567735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f918e410-a3e9-4d22-ad0f-0e540942d496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:38:26 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-3e0f2cd4-b1eb-4929-a87c-30960a0f5763 tempest-SnapshotDependencyTests-1531567735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f918e410-a3e9-4d22-ad0f-0e540942d496) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9aac7519-231e-4085-ae3c-9be2c4b8ce99', 'volume_name': 'volume-9aac7519-231e-4085-ae3c-9be2c4b8ce99', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:38:26 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-3e0f2cd4-b1eb-4929-a87c-30960a0f5763 tempest-SnapshotDependencyTests-1531567735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5909677a-c4b9-4e17-adb0-429e9280332c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:38:26 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-3e0f2cd4-b1eb-4929-a87c-30960a0f5763 tempest-SnapshotDependencyTests-1531567735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5909677a-c4b9-4e17-adb0-429e9280332c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:38:26 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-3e0f2cd4-b1eb-4929-a87c-30960a0f5763 tempest-SnapshotDependencyTests-1531567735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5da52b18-f7f0-4ea8-b839-29088293fd96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:38:26 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-3e0f2cd4-b1eb-4929-a87c-30960a0f5763 tempest-SnapshotDependencyTests-1531567735 None] Volume 9aac7519-231e-4085-ae3c-9be2c4b8ce99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9aac7519-231e-4085-ae3c-9be2c4b8ce99', 'volume_size': 1} Sep 16 20:38:26 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-3e0f2cd4-b1eb-4929-a87c-30960a0f5763 tempest-SnapshotDependencyTests-1531567735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:38:26 devstack sudo[106288]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:26 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b4bfcce9-cee2-4411-816f-1e97e2d637bc tempest-ProjectMemberTests-730908627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e3c6ec07-3fba-4161-ac43-15dcb3b831c0" returned: 0 in 0.274s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:26 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-b4bfcce9-cee2-4411-816f-1e97e2d637bc tempest-ProjectMemberTests-730908627 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:38:26 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-b4bfcce9-cee2-4411-816f-1e97e2d637bc tempest-ProjectMemberTests-730908627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.930s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:38:26 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-3e0f2cd4-b1eb-4929-a87c-30960a0f5763 tempest-SnapshotDependencyTests-1531567735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.064s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:38:26 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-3e0f2cd4-b1eb-4929-a87c-30960a0f5763 tempest-SnapshotDependencyTests-1531567735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:38:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-512895547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9aac7519-231e-4085-ae3c-9be2c4b8ce99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e35d31926dc458897d07aecbddd24b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:38:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:38:27Z,use_quota=True,user_id='0c2b0795628242df85abc05c86314982',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:38:26 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-3e0f2cd4-b1eb-4929-a87c-30960a0f5763 tempest-SnapshotDependencyTests-1531567735 None] Creating volume 9aac7519-231e-4085-ae3c-9be2c4b8ce99 {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:38:26 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-3e0f2cd4-b1eb-4929-a87c-30960a0f5763 tempest-SnapshotDependencyTests-1531567735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:38:26 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-3e0f2cd4-b1eb-4929-a87c-30960a0f5763 tempest-SnapshotDependencyTests-1531567735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:38:26 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-3e0f2cd4-b1eb-4929-a87c-30960a0f5763 tempest-SnapshotDependencyTests-1531567735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:38:26 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-3e0f2cd4-b1eb-4929-a87c-30960a0f5763 tempest-SnapshotDependencyTests-1531567735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:38:26 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-3e0f2cd4-b1eb-4929-a87c-30960a0f5763 tempest-SnapshotDependencyTests-1531567735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:38:26 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-3e0f2cd4-b1eb-4929-a87c-30960a0f5763 tempest-SnapshotDependencyTests-1531567735 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:38:26 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-3e0f2cd4-b1eb-4929-a87c-30960a0f5763 tempest-SnapshotDependencyTests-1531567735 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:38:26 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-3e0f2cd4-b1eb-4929-a87c-30960a0f5763 tempest-SnapshotDependencyTests-1531567735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9aac7519-231e-4085-ae3c-9be2c4b8ce99 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:26 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-b4bfcce9-cee2-4411-816f-1e97e2d637bc tempest-ProjectMemberTests-730908627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (421b4a4a-7a6b-4a0d-b06b-546a891b6e2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3c6ec07-3fba-4161-ac43-15dcb3b831c0', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:38:26 devstack sudo[106291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9aac7519-231e-4085-ae3c-9be2c4b8ce99 1073741824 Sep 16 20:38:26 devstack sudo[106291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:26 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-b4bfcce9-cee2-4411-816f-1e97e2d637bc tempest-ProjectMemberTests-730908627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (776b7cd5-3b78-41f6-933d-a833ec01f432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:38:26 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-b4bfcce9-cee2-4411-816f-1e97e2d637bc tempest-ProjectMemberTests-730908627 None] Volume volume-e3c6ec07-3fba-4161-ac43-15dcb3b831c0 (e3c6ec07-3fba-4161-ac43-15dcb3b831c0): created successfully Sep 16 20:38:27 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-b4bfcce9-cee2-4411-816f-1e97e2d637bc tempest-ProjectMemberTests-730908627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (776b7cd5-3b78-41f6-933d-a833ec01f432) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:38:27 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-b4bfcce9-cee2-4411-816f-1e97e2d637bc tempest-ProjectMemberTests-730908627 None] Flow 'volume_create_manager' (d0f23cd1-4835-48ba-aff2-4a837c93b47c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:38:27 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-b4bfcce9-cee2-4411-816f-1e97e2d637bc tempest-ProjectMemberTests-730908627 None] Created volume successfully. Sep 16 20:38:27 devstack sudo[106291]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:27 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-3e0f2cd4-b1eb-4929-a87c-30960a0f5763 tempest-SnapshotDependencyTests-1531567735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9aac7519-231e-4085-ae3c-9be2c4b8ce99 1073741824" returned: 0 in 0.484s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:27 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-3e0f2cd4-b1eb-4929-a87c-30960a0f5763 tempest-SnapshotDependencyTests-1531567735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9aac7519-231e-4085-ae3c-9be2c4b8ce99 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:27 devstack sudo[106297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9aac7519-231e-4085-ae3c-9be2c4b8ce99 Sep 16 20:38:27 devstack sudo[106297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:27 devstack sudo[106297]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:27 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-3e0f2cd4-b1eb-4929-a87c-30960a0f5763 tempest-SnapshotDependencyTests-1531567735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9aac7519-231e-4085-ae3c-9be2c4b8ce99" returned: 0 in 0.294s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:27 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-3e0f2cd4-b1eb-4929-a87c-30960a0f5763 tempest-SnapshotDependencyTests-1531567735 None] <== create_volume: return (817ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:38:27 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-3e0f2cd4-b1eb-4929-a87c-30960a0f5763 tempest-SnapshotDependencyTests-1531567735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.819s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:38:27 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-3e0f2cd4-b1eb-4929-a87c-30960a0f5763 tempest-SnapshotDependencyTests-1531567735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5da52b18-f7f0-4ea8-b839-29088293fd96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9aac7519-231e-4085-ae3c-9be2c4b8ce99', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:38:27 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-3e0f2cd4-b1eb-4929-a87c-30960a0f5763 tempest-SnapshotDependencyTests-1531567735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89276e3a-acd3-4ed9-a00e-832dfde865eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:38:27 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-3e0f2cd4-b1eb-4929-a87c-30960a0f5763 tempest-SnapshotDependencyTests-1531567735 None] Volume volume-9aac7519-231e-4085-ae3c-9be2c4b8ce99 (9aac7519-231e-4085-ae3c-9be2c4b8ce99): created successfully Sep 16 20:38:27 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-3e0f2cd4-b1eb-4929-a87c-30960a0f5763 tempest-SnapshotDependencyTests-1531567735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89276e3a-acd3-4ed9-a00e-832dfde865eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:38:27 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-3e0f2cd4-b1eb-4929-a87c-30960a0f5763 tempest-SnapshotDependencyTests-1531567735 None] Flow 'volume_create_manager' (5c004953-8652-4636-965f-ebd2004c954a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:38:27 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-3e0f2cd4-b1eb-4929-a87c-30960a0f5763 tempest-SnapshotDependencyTests-1531567735 None] Created volume successfully. Sep 16 20:38:27 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd94bcd8-606e-4dc4-bbf6-6c20f7ffa2d0 tempest-ProjectReaderTests-35295440 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:38:27 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-dd94bcd8-606e-4dc4-bbf6-6c20f7ffa2d0 tempest-ProjectReaderTests-35295440 None] Flow 'volume_create_manager' (75095463-66bd-485d-91eb-fcc72fd79726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:38:27 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-dd94bcd8-606e-4dc4-bbf6-6c20f7ffa2d0 tempest-ProjectReaderTests-35295440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66aa8be2-b1a9-4e84-831d-0cad56a4bce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:38:27 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-dd94bcd8-606e-4dc4-bbf6-6c20f7ffa2d0 tempest-ProjectReaderTests-35295440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66aa8be2-b1a9-4e84-831d-0cad56a4bce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:38:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1193494760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebbf1d46-4fc8-4ad2-a6c0-d126687c8c09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6e1e98f9bbd477bb086fd338852e55f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:38:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:38:28Z,use_quota=True,user_id='64639a1085d446729ef1b66978c264bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:38:27 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-dd94bcd8-606e-4dc4-bbf6-6c20f7ffa2d0 tempest-ProjectReaderTests-35295440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3af8dc73-a081-4ac9-9792-5732b8374a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:38:27 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-dd94bcd8-606e-4dc4-bbf6-6c20f7ffa2d0 tempest-ProjectReaderTests-35295440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3af8dc73-a081-4ac9-9792-5732b8374a37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:38:27 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-dd94bcd8-606e-4dc4-bbf6-6c20f7ffa2d0 tempest-ProjectReaderTests-35295440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfcc7fcd-7b34-4b02-9839-f92fcc72df52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:38:27 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-dd94bcd8-606e-4dc4-bbf6-6c20f7ffa2d0 tempest-ProjectReaderTests-35295440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfcc7fcd-7b34-4b02-9839-f92fcc72df52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebbf1d46-4fc8-4ad2-a6c0-d126687c8c09', 'volume_name': 'volume-ebbf1d46-4fc8-4ad2-a6c0-d126687c8c09', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:38:27 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-dd94bcd8-606e-4dc4-bbf6-6c20f7ffa2d0 tempest-ProjectReaderTests-35295440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62b182ac-9a78-4863-9e32-01a41043434e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:38:27 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-dd94bcd8-606e-4dc4-bbf6-6c20f7ffa2d0 tempest-ProjectReaderTests-35295440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62b182ac-9a78-4863-9e32-01a41043434e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:38:27 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-dd94bcd8-606e-4dc4-bbf6-6c20f7ffa2d0 tempest-ProjectReaderTests-35295440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e67cc1b7-eac2-4b03-97d7-ca288be7d776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:38:27 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-dd94bcd8-606e-4dc4-bbf6-6c20f7ffa2d0 tempest-ProjectReaderTests-35295440 None] Volume ebbf1d46-4fc8-4ad2-a6c0-d126687c8c09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebbf1d46-4fc8-4ad2-a6c0-d126687c8c09', 'volume_size': 1} Sep 16 20:38:27 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-dd94bcd8-606e-4dc4-bbf6-6c20f7ffa2d0 tempest-ProjectReaderTests-35295440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:38:27 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-dd94bcd8-606e-4dc4-bbf6-6c20f7ffa2d0 tempest-ProjectReaderTests-35295440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:38:27 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-dd94bcd8-606e-4dc4-bbf6-6c20f7ffa2d0 tempest-ProjectReaderTests-35295440 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:38:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1193494760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebbf1d46-4fc8-4ad2-a6c0-d126687c8c09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6e1e98f9bbd477bb086fd338852e55f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:38:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:38:28Z,use_quota=True,user_id='64639a1085d446729ef1b66978c264bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:38:27 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-dd94bcd8-606e-4dc4-bbf6-6c20f7ffa2d0 tempest-ProjectReaderTests-35295440 None] Creating volume ebbf1d46-4fc8-4ad2-a6c0-d126687c8c09 {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:38:27 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-dd94bcd8-606e-4dc4-bbf6-6c20f7ffa2d0 tempest-ProjectReaderTests-35295440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:38:27 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-dd94bcd8-606e-4dc4-bbf6-6c20f7ffa2d0 tempest-ProjectReaderTests-35295440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:38:27 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-dd94bcd8-606e-4dc4-bbf6-6c20f7ffa2d0 tempest-ProjectReaderTests-35295440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:38:27 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-dd94bcd8-606e-4dc4-bbf6-6c20f7ffa2d0 tempest-ProjectReaderTests-35295440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:38:27 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-dd94bcd8-606e-4dc4-bbf6-6c20f7ffa2d0 tempest-ProjectReaderTests-35295440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:38:27 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-dd94bcd8-606e-4dc4-bbf6-6c20f7ffa2d0 tempest-ProjectReaderTests-35295440 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:38:27 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-dd94bcd8-606e-4dc4-bbf6-6c20f7ffa2d0 tempest-ProjectReaderTests-35295440 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:38:27 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-dd94bcd8-606e-4dc4-bbf6-6c20f7ffa2d0 tempest-ProjectReaderTests-35295440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ebbf1d46-4fc8-4ad2-a6c0-d126687c8c09 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:27 devstack sudo[106300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ebbf1d46-4fc8-4ad2-a6c0-d126687c8c09 1073741824 Sep 16 20:38:28 devstack sudo[106300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:28 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-fb2cdec1-5e08-4dc7-bc07-8c264051082d tempest-ProjectMemberTests-730908627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:38:28 devstack sudo[106300]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:28 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-dd94bcd8-606e-4dc4-bbf6-6c20f7ffa2d0 tempest-ProjectReaderTests-35295440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ebbf1d46-4fc8-4ad2-a6c0-d126687c8c09 1073741824" returned: 0 in 0.521s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:28 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-dd94bcd8-606e-4dc4-bbf6-6c20f7ffa2d0 tempest-ProjectReaderTests-35295440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ebbf1d46-4fc8-4ad2-a6c0-d126687c8c09 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:28 devstack sudo[106306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ebbf1d46-4fc8-4ad2-a6c0-d126687c8c09 Sep 16 20:38:28 devstack sudo[106306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:28 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-122a2232-dc02-45c1-8828-eb4aeb3d06d2 tempest-ProjectAdminTests-831247674 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.861484527588, 'free_capacity_gb': 1775.861484527588, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86188) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 16 20:38:28 devstack sudo[106306]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:28 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-dd94bcd8-606e-4dc4-bbf6-6c20f7ffa2d0 tempest-ProjectReaderTests-35295440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ebbf1d46-4fc8-4ad2-a6c0-d126687c8c09" returned: 0 in 0.271s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:28 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-dd94bcd8-606e-4dc4-bbf6-6c20f7ffa2d0 tempest-ProjectReaderTests-35295440 None] <== create_volume: return (830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:38:28 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-dd94bcd8-606e-4dc4-bbf6-6c20f7ffa2d0 tempest-ProjectReaderTests-35295440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.832s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:38:28 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-fb2cdec1-5e08-4dc7-bc07-8c264051082d tempest-ProjectMemberTests-730908627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.366s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:38:28 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-dd94bcd8-606e-4dc4-bbf6-6c20f7ffa2d0 tempest-ProjectReaderTests-35295440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e67cc1b7-eac2-4b03-97d7-ca288be7d776) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebbf1d46-4fc8-4ad2-a6c0-d126687c8c09', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:38:28 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-dd94bcd8-606e-4dc4-bbf6-6c20f7ffa2d0 tempest-ProjectReaderTests-35295440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aeea3955-3617-4219-8236-fbbc5fe78efa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:38:28 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-fb2cdec1-5e08-4dc7-bc07-8c264051082d tempest-ProjectMemberTests-730908627 None] Creating offline snapshot fb1ff94a-b65b-41ea-8d7c-b1082fb1d920 of volume e3c6ec07-3fba-4161-ac43-15dcb3b831c0 {{(pid=86188) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 20:38:28 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-dd94bcd8-606e-4dc4-bbf6-6c20f7ffa2d0 tempest-ProjectReaderTests-35295440 None] Volume volume-ebbf1d46-4fc8-4ad2-a6c0-d126687c8c09 (ebbf1d46-4fc8-4ad2-a6c0-d126687c8c09): created successfully Sep 16 20:38:28 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-dd94bcd8-606e-4dc4-bbf6-6c20f7ffa2d0 tempest-ProjectReaderTests-35295440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aeea3955-3617-4219-8236-fbbc5fe78efa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:38:28 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-dd94bcd8-606e-4dc4-bbf6-6c20f7ffa2d0 tempest-ProjectReaderTests-35295440 None] Flow 'volume_create_manager' (75095463-66bd-485d-91eb-fcc72fd79726) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:38:28 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a06d07d-4e32-46fb-a2bf-8d60b745ca05]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:38:28 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-fb2cdec1-5e08-4dc7-bc07-8c264051082d tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e3c6ec07-3fba-4161-ac43-15dcb3b831c0 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:28 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-dd94bcd8-606e-4dc4-bbf6-6c20f7ffa2d0 tempest-ProjectReaderTests-35295440 None] Created volume successfully. Sep 16 20:38:28 devstack sudo[106309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e3c6ec07-3fba-4161-ac43-15dcb3b831c0 Sep 16 20:38:28 devstack sudo[106309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:29 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-136468bb-8ae4-4be8-b250-42652f6f7f03 tempest-SnapshotDependencyTests-1531567735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:38:29 devstack sudo[106309]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:29 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-fb2cdec1-5e08-4dc7-bc07-8c264051082d tempest-ProjectMemberTests-730908627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e3c6ec07-3fba-4161-ac43-15dcb3b831c0" returned: 0 in 0.397s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:29 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-fb2cdec1-5e08-4dc7-bc07-8c264051082d tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e3c6ec07-3fba-4161-ac43-15dcb3b831c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e3c6ec07-3fba-4161-ac43-15dcb3b831c0.fb1ff94a-b65b-41ea-8d7c-b1082fb1d920 1G {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:29 devstack sudo[106314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e3c6ec07-3fba-4161-ac43-15dcb3b831c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e3c6ec07-3fba-4161-ac43-15dcb3b831c0.fb1ff94a-b65b-41ea-8d7c-b1082fb1d920 1G Sep 16 20:38:29 devstack sudo[106314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:29 devstack sudo[106314]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:29 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-fb2cdec1-5e08-4dc7-bc07-8c264051082d tempest-ProjectMemberTests-730908627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e3c6ec07-3fba-4161-ac43-15dcb3b831c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e3c6ec07-3fba-4161-ac43-15dcb3b831c0.fb1ff94a-b65b-41ea-8d7c-b1082fb1d920 1G" returned: 0 in 0.412s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:29 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-fb2cdec1-5e08-4dc7-bc07-8c264051082d tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3c6ec07-3fba-4161-ac43-15dcb3b831c0 -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e3c6ec07-3fba-4161-ac43-15dcb3b831c0.fb1ff94a-b65b-41ea-8d7c-b1082fb1d920 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:29 devstack sudo[106320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3c6ec07-3fba-4161-ac43-15dcb3b831c0 -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e3c6ec07-3fba-4161-ac43-15dcb3b831c0.fb1ff94a-b65b-41ea-8d7c-b1082fb1d920 Sep 16 20:38:29 devstack sudo[106320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:29 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-a2c3aa69-f912-4fbe-a70c-fa3bb0d48e6e tempest-ProjectReaderTests-35295440 None] Acquiring lock "cinder-ebbf1d46-4fc8-4ad2-a6c0-d126687c8c09-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:38:29 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-a2c3aa69-f912-4fbe-a70c-fa3bb0d48e6e tempest-ProjectReaderTests-35295440 None] Lock "cinder-ebbf1d46-4fc8-4ad2-a6c0-d126687c8c09-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:38:30 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-a2c3aa69-f912-4fbe-a70c-fa3bb0d48e6e tempest-ProjectReaderTests-35295440 None] Acquiring lock "cinder-quobyte-ebbf1d46-4fc8-4ad2-a6c0-d126687c8c09" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:38:30 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-a2c3aa69-f912-4fbe-a70c-fa3bb0d48e6e tempest-ProjectReaderTests-35295440 None] Lock "cinder-quobyte-ebbf1d46-4fc8-4ad2-a6c0-d126687c8c09" acquired by "delete_volume" :: waited 0.014s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:38:30 devstack sudo[106320]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:30 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-fb2cdec1-5e08-4dc7-bc07-8c264051082d tempest-ProjectMemberTests-730908627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3c6ec07-3fba-4161-ac43-15dcb3b831c0 -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e3c6ec07-3fba-4161-ac43-15dcb3b831c0.fb1ff94a-b65b-41ea-8d7c-b1082fb1d920" returned: 0 in 0.387s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:30 devstack cinder-volume[86188]: WARNING cinder.volume.drivers.remotefs [None req-fb2cdec1-5e08-4dc7-bc07-8c264051082d tempest-ProjectMemberTests-730908627 None] /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e3c6ec07-3fba-4161-ac43-15dcb3b831c0.fb1ff94a-b65b-41ea-8d7c-b1082fb1d920 is being set with open permissions: ugo+rw Sep 16 20:38:30 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-fb2cdec1-5e08-4dc7-bc07-8c264051082d tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e3c6ec07-3fba-4161-ac43-15dcb3b831c0.fb1ff94a-b65b-41ea-8d7c-b1082fb1d920 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:30 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3586ffd-bbb6-43ba-90b9-c4635e59cd9a]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:38:30 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a2c3aa69-f912-4fbe-a70c-fa3bb0d48e6e tempest-ProjectReaderTests-35295440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ebbf1d46-4fc8-4ad2-a6c0-d126687c8c09 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:30 devstack sudo[106326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e3c6ec07-3fba-4161-ac43-15dcb3b831c0.fb1ff94a-b65b-41ea-8d7c-b1082fb1d920 Sep 16 20:38:30 devstack sudo[106326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:30 devstack sudo[106327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ebbf1d46-4fc8-4ad2-a6c0-d126687c8c09 Sep 16 20:38:30 devstack sudo[106327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:30 devstack sudo[106326]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:30 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-fb2cdec1-5e08-4dc7-bc07-8c264051082d tempest-ProjectMemberTests-730908627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e3c6ec07-3fba-4161-ac43-15dcb3b831c0.fb1ff94a-b65b-41ea-8d7c-b1082fb1d920" returned: 0 in 0.266s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:30 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-fb2cdec1-5e08-4dc7-bc07-8c264051082d tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e3c6ec07-3fba-4161-ac43-15dcb3b831c0.info {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:30 devstack sudo[106332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e3c6ec07-3fba-4161-ac43-15dcb3b831c0.info Sep 16 20:38:30 devstack sudo[106332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:30 devstack sudo[106327]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:30 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a2c3aa69-f912-4fbe-a70c-fa3bb0d48e6e tempest-ProjectReaderTests-35295440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ebbf1d46-4fc8-4ad2-a6c0-d126687c8c09" returned: 0 in 0.431s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:30 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a2c3aa69-f912-4fbe-a70c-fa3bb0d48e6e tempest-ProjectReaderTests-35295440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ebbf1d46-4fc8-4ad2-a6c0-d126687c8c09 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:30 devstack sudo[106337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ebbf1d46-4fc8-4ad2-a6c0-d126687c8c09 Sep 16 20:38:30 devstack sudo[106337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:30 devstack sudo[106332]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:30 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-fb2cdec1-5e08-4dc7-bc07-8c264051082d tempest-ProjectMemberTests-730908627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e3c6ec07-3fba-4161-ac43-15dcb3b831c0.info" returned: 0 in 0.284s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:30 devstack cinder-volume[86188]: WARNING cinder.volume.drivers.remotefs [None req-fb2cdec1-5e08-4dc7-bc07-8c264051082d tempest-ProjectMemberTests-730908627 None] /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e3c6ec07-3fba-4161-ac43-15dcb3b831c0.info is being set with open permissions: ugo+rw Sep 16 20:38:30 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-fb2cdec1-5e08-4dc7-bc07-8c264051082d tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e3c6ec07-3fba-4161-ac43-15dcb3b831c0.info {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:30 devstack sudo[106340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e3c6ec07-3fba-4161-ac43-15dcb3b831c0.info Sep 16 20:38:30 devstack sudo[106340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:30 devstack sudo[106337]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:30 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a2c3aa69-f912-4fbe-a70c-fa3bb0d48e6e tempest-ProjectReaderTests-35295440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ebbf1d46-4fc8-4ad2-a6c0-d126687c8c09" returned: 0 in 0.281s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:30 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-a2c3aa69-f912-4fbe-a70c-fa3bb0d48e6e tempest-ProjectReaderTests-35295440 None] Lock "cinder-quobyte-ebbf1d46-4fc8-4ad2-a6c0-d126687c8c09" released by "delete_volume" :: held 0.776s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:38:30 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-a2c3aa69-f912-4fbe-a70c-fa3bb0d48e6e tempest-ProjectReaderTests-35295440 None] Created reservations ['a029d0b5-bc12-41d0-8b43-44e5f8ca4ed1', '72246b73-95df-4979-ad2f-3da61e3dd9a6', '7f944dd9-62a0-431b-a236-8ba57b1791c6', 'db91d859-69fa-4442-87c1-d3fd6a43ca63'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:38:30 devstack sudo[106340]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:30 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-fb2cdec1-5e08-4dc7-bc07-8c264051082d tempest-ProjectMemberTests-730908627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e3c6ec07-3fba-4161-ac43-15dcb3b831c0.info" returned: 0 in 0.272s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:30 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-fb2cdec1-5e08-4dc7-bc07-8c264051082d tempest-ProjectMemberTests-730908627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.165s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:38:30 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-136468bb-8ae4-4be8-b250-42652f6f7f03 tempest-SnapshotDependencyTests-1531567735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.846s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:38:30 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-136468bb-8ae4-4be8-b250-42652f6f7f03 tempest-SnapshotDependencyTests-1531567735 None] Creating offline snapshot 36f35f86-869a-4975-880b-37ce986184d2 of volume 9aac7519-231e-4085-ae3c-9be2c4b8ce99 {{(pid=86188) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 20:38:30 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a2c3aa69-f912-4fbe-a70c-fa3bb0d48e6e tempest-ProjectReaderTests-35295440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:38:30 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a2c3aa69-f912-4fbe-a70c-fa3bb0d48e6e tempest-ProjectReaderTests-35295440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:38:30 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-a2c3aa69-f912-4fbe-a70c-fa3bb0d48e6e tempest-ProjectReaderTests-35295440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:38:30 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-a2c3aa69-f912-4fbe-a70c-fa3bb0d48e6e tempest-ProjectReaderTests-35295440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:38:30 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a2c3aa69-f912-4fbe-a70c-fa3bb0d48e6e tempest-ProjectReaderTests-35295440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:38:30 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a2c3aa69-f912-4fbe-a70c-fa3bb0d48e6e tempest-ProjectReaderTests-35295440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:31 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d5d60c2-85a7-4a3b-bf28-975b10b8d503]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:38:31 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-136468bb-8ae4-4be8-b250-42652f6f7f03 tempest-SnapshotDependencyTests-1531567735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9aac7519-231e-4085-ae3c-9be2c4b8ce99 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:31 devstack sudo[106344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:38:31 devstack sudo[106344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:31 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-fb2cdec1-5e08-4dc7-bc07-8c264051082d tempest-ProjectMemberTests-730908627 None] Create snapshot completed successfully Sep 16 20:38:31 devstack sudo[106345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9aac7519-231e-4085-ae3c-9be2c4b8ce99 Sep 16 20:38:31 devstack sudo[106345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:31 devstack sudo[106344]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:31 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a2c3aa69-f912-4fbe-a70c-fa3bb0d48e6e tempest-ProjectReaderTests-35295440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.336s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:31 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-a2c3aa69-f912-4fbe-a70c-fa3bb0d48e6e tempest-ProjectReaderTests-35295440 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:38:31 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-a2c3aa69-f912-4fbe-a70c-fa3bb0d48e6e tempest-ProjectReaderTests-35295440 None] Deleted volume successfully. Sep 16 20:38:31 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-a2c3aa69-f912-4fbe-a70c-fa3bb0d48e6e tempest-ProjectReaderTests-35295440 None] Lock "cinder-ebbf1d46-4fc8-4ad2-a6c0-d126687c8c09-delete_volume" released by "delete_volume" :: held 1.401s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:38:31 devstack sudo[106345]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:31 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-136468bb-8ae4-4be8-b250-42652f6f7f03 tempest-SnapshotDependencyTests-1531567735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9aac7519-231e-4085-ae3c-9be2c4b8ce99" returned: 0 in 0.490s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:31 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-136468bb-8ae4-4be8-b250-42652f6f7f03 tempest-SnapshotDependencyTests-1531567735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9aac7519-231e-4085-ae3c-9be2c4b8ce99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9aac7519-231e-4085-ae3c-9be2c4b8ce99.36f35f86-869a-4975-880b-37ce986184d2 1G {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:31 devstack sudo[106353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9aac7519-231e-4085-ae3c-9be2c4b8ce99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9aac7519-231e-4085-ae3c-9be2c4b8ce99.36f35f86-869a-4975-880b-37ce986184d2 1G Sep 16 20:38:31 devstack sudo[106353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:31 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-822675ab-1661-439c-98ee-927ad58bff42 tempest-ProjectMemberTests-730908627 None] Acquiring lock "cinder-fb1ff94a-b65b-41ea-8d7c-b1082fb1d920-delete_snapshot" by "delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:38:31 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-822675ab-1661-439c-98ee-927ad58bff42 tempest-ProjectMemberTests-730908627 None] Lock "cinder-fb1ff94a-b65b-41ea-8d7c-b1082fb1d920-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:38:31 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-822675ab-1661-439c-98ee-927ad58bff42 tempest-ProjectMemberTests-730908627 None] Acquiring lock "cinder-quobyte-e3c6ec07-3fba-4161-ac43-15dcb3b831c0" by "delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:38:31 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-822675ab-1661-439c-98ee-927ad58bff42 tempest-ProjectMemberTests-730908627 None] Lock "cinder-quobyte-e3c6ec07-3fba-4161-ac43-15dcb3b831c0" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:38:31 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-822675ab-1661-439c-98ee-927ad58bff42 tempest-ProjectMemberTests-730908627 None] Acquiring lock "cinder-quobyte-fb1ff94a-b65b-41ea-8d7c-b1082fb1d920" by "_delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:38:31 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-822675ab-1661-439c-98ee-927ad58bff42 tempest-ProjectMemberTests-730908627 None] Lock "cinder-quobyte-fb1ff94a-b65b-41ea-8d7c-b1082fb1d920" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:38:31 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-822675ab-1661-439c-98ee-927ad58bff42 tempest-ProjectMemberTests-730908627 None] Deleting offline snapshot fb1ff94a-b65b-41ea-8d7c-b1082fb1d920 of volume e3c6ec07-3fba-4161-ac43-15dcb3b831c0 {{(pid=86188) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 20:38:31 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-822675ab-1661-439c-98ee-927ad58bff42 tempest-ProjectMemberTests-730908627 None] snapshot_file for this snap is: volume-e3c6ec07-3fba-4161-ac43-15dcb3b831c0.fb1ff94a-b65b-41ea-8d7c-b1082fb1d920 {{(pid=86188) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 20:38:31 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[40626d5d-8be4-4f6d-838a-87f3dcf4fa01]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:38:31 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-822675ab-1661-439c-98ee-927ad58bff42 tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e3c6ec07-3fba-4161-ac43-15dcb3b831c0.fb1ff94a-b65b-41ea-8d7c-b1082fb1d920 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:31 devstack sudo[106355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e3c6ec07-3fba-4161-ac43-15dcb3b831c0.fb1ff94a-b65b-41ea-8d7c-b1082fb1d920 Sep 16 20:38:31 devstack sudo[106355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:32 devstack sudo[106353]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:32 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-136468bb-8ae4-4be8-b250-42652f6f7f03 tempest-SnapshotDependencyTests-1531567735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9aac7519-231e-4085-ae3c-9be2c4b8ce99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9aac7519-231e-4085-ae3c-9be2c4b8ce99.36f35f86-869a-4975-880b-37ce986184d2 1G" returned: 0 in 0.548s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:32 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-136468bb-8ae4-4be8-b250-42652f6f7f03 tempest-SnapshotDependencyTests-1531567735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9aac7519-231e-4085-ae3c-9be2c4b8ce99 -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9aac7519-231e-4085-ae3c-9be2c4b8ce99.36f35f86-869a-4975-880b-37ce986184d2 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:32 devstack sudo[106361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9aac7519-231e-4085-ae3c-9be2c4b8ce99 -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9aac7519-231e-4085-ae3c-9be2c4b8ce99.36f35f86-869a-4975-880b-37ce986184d2 Sep 16 20:38:32 devstack sudo[106361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:32 devstack sudo[106355]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:32 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-822675ab-1661-439c-98ee-927ad58bff42 tempest-ProjectMemberTests-730908627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e3c6ec07-3fba-4161-ac43-15dcb3b831c0.fb1ff94a-b65b-41ea-8d7c-b1082fb1d920" returned: 0 in 0.464s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:32 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-822675ab-1661-439c-98ee-927ad58bff42 tempest-ProjectMemberTests-730908627 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e3c6ec07-3fba-4161-ac43-15dcb3b831c0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86188) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 20:38:32 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[9097cb4c-82ce-42ce-ad5a-36e7c756564a]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:38:32 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-822675ab-1661-439c-98ee-927ad58bff42 tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e3c6ec07-3fba-4161-ac43-15dcb3b831c0 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:32 devstack sudo[106367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e3c6ec07-3fba-4161-ac43-15dcb3b831c0 Sep 16 20:38:32 devstack sudo[106367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:32 devstack sudo[106361]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:32 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-136468bb-8ae4-4be8-b250-42652f6f7f03 tempest-SnapshotDependencyTests-1531567735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9aac7519-231e-4085-ae3c-9be2c4b8ce99 -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9aac7519-231e-4085-ae3c-9be2c4b8ce99.36f35f86-869a-4975-880b-37ce986184d2" returned: 0 in 0.417s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:32 devstack cinder-volume[86188]: WARNING cinder.volume.drivers.remotefs [None req-136468bb-8ae4-4be8-b250-42652f6f7f03 tempest-SnapshotDependencyTests-1531567735 None] /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9aac7519-231e-4085-ae3c-9be2c4b8ce99.36f35f86-869a-4975-880b-37ce986184d2 is being set with open permissions: ugo+rw Sep 16 20:38:32 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-136468bb-8ae4-4be8-b250-42652f6f7f03 tempest-SnapshotDependencyTests-1531567735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9aac7519-231e-4085-ae3c-9be2c4b8ce99.36f35f86-869a-4975-880b-37ce986184d2 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:32 devstack sudo[106372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9aac7519-231e-4085-ae3c-9be2c4b8ce99.36f35f86-869a-4975-880b-37ce986184d2 Sep 16 20:38:32 devstack sudo[106372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:32 devstack sudo[106367]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:32 devstack sudo[106372]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:32 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-822675ab-1661-439c-98ee-927ad58bff42 tempest-ProjectMemberTests-730908627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e3c6ec07-3fba-4161-ac43-15dcb3b831c0" returned: 0 in 0.529s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:32 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-822675ab-1661-439c-98ee-927ad58bff42 tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e3c6ec07-3fba-4161-ac43-15dcb3b831c0.fb1ff94a-b65b-41ea-8d7c-b1082fb1d920 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:32 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-136468bb-8ae4-4be8-b250-42652f6f7f03 tempest-SnapshotDependencyTests-1531567735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9aac7519-231e-4085-ae3c-9be2c4b8ce99.36f35f86-869a-4975-880b-37ce986184d2" returned: 0 in 0.319s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:32 devstack sudo[106378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e3c6ec07-3fba-4161-ac43-15dcb3b831c0.fb1ff94a-b65b-41ea-8d7c-b1082fb1d920 Sep 16 20:38:32 devstack sudo[106378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:32 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-136468bb-8ae4-4be8-b250-42652f6f7f03 tempest-SnapshotDependencyTests-1531567735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9aac7519-231e-4085-ae3c-9be2c4b8ce99.info {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:32 devstack sudo[106380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9aac7519-231e-4085-ae3c-9be2c4b8ce99.info Sep 16 20:38:32 devstack sudo[106380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:33 devstack sudo[106380]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:33 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-136468bb-8ae4-4be8-b250-42652f6f7f03 tempest-SnapshotDependencyTests-1531567735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9aac7519-231e-4085-ae3c-9be2c4b8ce99.info" returned: 0 in 0.304s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:33 devstack cinder-volume[86188]: WARNING cinder.volume.drivers.remotefs [None req-136468bb-8ae4-4be8-b250-42652f6f7f03 tempest-SnapshotDependencyTests-1531567735 None] /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9aac7519-231e-4085-ae3c-9be2c4b8ce99.info is being set with open permissions: ugo+rw Sep 16 20:38:33 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-136468bb-8ae4-4be8-b250-42652f6f7f03 tempest-SnapshotDependencyTests-1531567735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9aac7519-231e-4085-ae3c-9be2c4b8ce99.info {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:33 devstack sudo[106387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9aac7519-231e-4085-ae3c-9be2c4b8ce99.info Sep 16 20:38:33 devstack sudo[106387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:33 devstack sudo[106378]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:33 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-822675ab-1661-439c-98ee-927ad58bff42 tempest-ProjectMemberTests-730908627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e3c6ec07-3fba-4161-ac43-15dcb3b831c0.fb1ff94a-b65b-41ea-8d7c-b1082fb1d920" returned: 0 in 0.533s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:33 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-822675ab-1661-439c-98ee-927ad58bff42 tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e3c6ec07-3fba-4161-ac43-15dcb3b831c0.fb1ff94a-b65b-41ea-8d7c-b1082fb1d920 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:33 devstack sudo[106389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e3c6ec07-3fba-4161-ac43-15dcb3b831c0.fb1ff94a-b65b-41ea-8d7c-b1082fb1d920 Sep 16 20:38:33 devstack sudo[106389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:33 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-f53017ff-ca9f-4110-969d-9aef1e1c96f8 tempest-ProjectReaderTests-2105386862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:38:33 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f53017ff-ca9f-4110-969d-9aef1e1c96f8 tempest-ProjectReaderTests-2105386862 None] Flow 'volume_create_manager' (60ef1a51-f511-4059-a556-f2cc68d93e14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:38:33 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f53017ff-ca9f-4110-969d-9aef1e1c96f8 tempest-ProjectReaderTests-2105386862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f18781e-f782-4e55-bfe3-4cc3cce752de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:38:33 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f53017ff-ca9f-4110-969d-9aef1e1c96f8 tempest-ProjectReaderTests-2105386862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f18781e-f782-4e55-bfe3-4cc3cce752de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:38:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1452356123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c6e77a8-2bb7-452d-8971-04a61b30b3ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a1b5c8e359a4d699325f3e4049d8c93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:38:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:38:33Z,use_quota=True,user_id='af893a5c2de74fa596654573d674555d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:38:33 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f53017ff-ca9f-4110-969d-9aef1e1c96f8 tempest-ProjectReaderTests-2105386862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80c1432c-cdbb-48df-937a-c8eddd5a0bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:38:33 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f53017ff-ca9f-4110-969d-9aef1e1c96f8 tempest-ProjectReaderTests-2105386862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80c1432c-cdbb-48df-937a-c8eddd5a0bc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:38:33 devstack sudo[106387]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:33 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f53017ff-ca9f-4110-969d-9aef1e1c96f8 tempest-ProjectReaderTests-2105386862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1fab0bd-3117-4da1-ba65-9fc5c701738f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:38:33 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f53017ff-ca9f-4110-969d-9aef1e1c96f8 tempest-ProjectReaderTests-2105386862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1fab0bd-3117-4da1-ba65-9fc5c701738f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c6e77a8-2bb7-452d-8971-04a61b30b3ed', 'volume_name': 'volume-0c6e77a8-2bb7-452d-8971-04a61b30b3ed', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:38:33 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f53017ff-ca9f-4110-969d-9aef1e1c96f8 tempest-ProjectReaderTests-2105386862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89f9ed86-e5ce-40ae-b3d7-f650582d80e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:38:33 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f53017ff-ca9f-4110-969d-9aef1e1c96f8 tempest-ProjectReaderTests-2105386862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89f9ed86-e5ce-40ae-b3d7-f650582d80e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:38:33 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f53017ff-ca9f-4110-969d-9aef1e1c96f8 tempest-ProjectReaderTests-2105386862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d47f896c-1a7a-4a2b-ab39-445e1efbdb68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:38:33 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-f53017ff-ca9f-4110-969d-9aef1e1c96f8 tempest-ProjectReaderTests-2105386862 None] Volume 0c6e77a8-2bb7-452d-8971-04a61b30b3ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c6e77a8-2bb7-452d-8971-04a61b30b3ed', 'volume_size': 1} Sep 16 20:38:33 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-f53017ff-ca9f-4110-969d-9aef1e1c96f8 tempest-ProjectReaderTests-2105386862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:38:33 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-136468bb-8ae4-4be8-b250-42652f6f7f03 tempest-SnapshotDependencyTests-1531567735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9aac7519-231e-4085-ae3c-9be2c4b8ce99.info" returned: 0 in 0.345s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:33 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-136468bb-8ae4-4be8-b250-42652f6f7f03 tempest-SnapshotDependencyTests-1531567735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.568s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:38:33 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-f53017ff-ca9f-4110-969d-9aef1e1c96f8 tempest-ProjectReaderTests-2105386862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.021s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:38:33 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-f53017ff-ca9f-4110-969d-9aef1e1c96f8 tempest-ProjectReaderTests-2105386862 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:38:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1452356123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c6e77a8-2bb7-452d-8971-04a61b30b3ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a1b5c8e359a4d699325f3e4049d8c93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:38:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:38:33Z,use_quota=True,user_id='af893a5c2de74fa596654573d674555d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:38:33 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-f53017ff-ca9f-4110-969d-9aef1e1c96f8 tempest-ProjectReaderTests-2105386862 None] Creating volume 0c6e77a8-2bb7-452d-8971-04a61b30b3ed {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:38:33 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-f53017ff-ca9f-4110-969d-9aef1e1c96f8 tempest-ProjectReaderTests-2105386862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:38:33 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-f53017ff-ca9f-4110-969d-9aef1e1c96f8 tempest-ProjectReaderTests-2105386862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:38:33 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-f53017ff-ca9f-4110-969d-9aef1e1c96f8 tempest-ProjectReaderTests-2105386862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:38:33 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-f53017ff-ca9f-4110-969d-9aef1e1c96f8 tempest-ProjectReaderTests-2105386862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:38:33 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-f53017ff-ca9f-4110-969d-9aef1e1c96f8 tempest-ProjectReaderTests-2105386862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:38:33 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-f53017ff-ca9f-4110-969d-9aef1e1c96f8 tempest-ProjectReaderTests-2105386862 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:38:33 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-f53017ff-ca9f-4110-969d-9aef1e1c96f8 tempest-ProjectReaderTests-2105386862 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:38:33 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f53017ff-ca9f-4110-969d-9aef1e1c96f8 tempest-ProjectReaderTests-2105386862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-0c6e77a8-2bb7-452d-8971-04a61b30b3ed 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:33 devstack sudo[106392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-0c6e77a8-2bb7-452d-8971-04a61b30b3ed 1073741824 Sep 16 20:38:33 devstack sudo[106392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:33 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-136468bb-8ae4-4be8-b250-42652f6f7f03 tempest-SnapshotDependencyTests-1531567735 None] Create snapshot completed successfully Sep 16 20:38:33 devstack sudo[106389]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:33 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-822675ab-1661-439c-98ee-927ad58bff42 tempest-ProjectMemberTests-730908627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e3c6ec07-3fba-4161-ac43-15dcb3b831c0.fb1ff94a-b65b-41ea-8d7c-b1082fb1d920" returned: 0 in 0.338s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:33 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-822675ab-1661-439c-98ee-927ad58bff42 tempest-ProjectMemberTests-730908627 None] Lock "cinder-quobyte-fb1ff94a-b65b-41ea-8d7c-b1082fb1d920" released by "_delete_snapshot" :: held 2.044s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:38:33 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-822675ab-1661-439c-98ee-927ad58bff42 tempest-ProjectMemberTests-730908627 None] Lock "cinder-quobyte-e3c6ec07-3fba-4161-ac43-15dcb3b831c0" released by "delete_snapshot" :: held 2.069s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:38:33 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-822675ab-1661-439c-98ee-927ad58bff42 tempest-ProjectMemberTests-730908627 None] Created reservations ['cc7dff31-e132-4019-aea5-8ce66d700343', '35269680-705c-4485-8e4e-663d8d51eb40', '6cdf607a-c961-42c9-9777-89932e12983c', '1c3e13c8-bb31-4a33-a7c2-035a6bbd964f'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:38:33 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-822675ab-1661-439c-98ee-927ad58bff42 tempest-ProjectMemberTests-730908627 None] Delete snapshot completed successfully. Sep 16 20:38:33 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-822675ab-1661-439c-98ee-927ad58bff42 tempest-ProjectMemberTests-730908627 None] Lock "cinder-fb1ff94a-b65b-41ea-8d7c-b1082fb1d920-delete_snapshot" released by "delete_snapshot" :: held 2.263s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:38:34 devstack sudo[106392]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:34 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f53017ff-ca9f-4110-969d-9aef1e1c96f8 tempest-ProjectReaderTests-2105386862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-0c6e77a8-2bb7-452d-8971-04a61b30b3ed 1073741824" returned: 0 in 0.540s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:34 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f53017ff-ca9f-4110-969d-9aef1e1c96f8 tempest-ProjectReaderTests-2105386862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-0c6e77a8-2bb7-452d-8971-04a61b30b3ed {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:34 devstack sudo[106399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-0c6e77a8-2bb7-452d-8971-04a61b30b3ed Sep 16 20:38:34 devstack sudo[106399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:34 devstack sudo[106399]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:34 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f53017ff-ca9f-4110-969d-9aef1e1c96f8 tempest-ProjectReaderTests-2105386862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-0c6e77a8-2bb7-452d-8971-04a61b30b3ed" returned: 0 in 0.270s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:34 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-f53017ff-ca9f-4110-969d-9aef1e1c96f8 tempest-ProjectReaderTests-2105386862 None] <== create_volume: return (849ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:38:34 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-f53017ff-ca9f-4110-969d-9aef1e1c96f8 tempest-ProjectReaderTests-2105386862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.852s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:38:34 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f53017ff-ca9f-4110-969d-9aef1e1c96f8 tempest-ProjectReaderTests-2105386862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d47f896c-1a7a-4a2b-ab39-445e1efbdb68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c6e77a8-2bb7-452d-8971-04a61b30b3ed', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:38:34 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f53017ff-ca9f-4110-969d-9aef1e1c96f8 tempest-ProjectReaderTests-2105386862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e248074-3b3f-4967-949c-463e92e213f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:38:34 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-f53017ff-ca9f-4110-969d-9aef1e1c96f8 tempest-ProjectReaderTests-2105386862 None] Volume volume-0c6e77a8-2bb7-452d-8971-04a61b30b3ed (0c6e77a8-2bb7-452d-8971-04a61b30b3ed): created successfully Sep 16 20:38:34 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f53017ff-ca9f-4110-969d-9aef1e1c96f8 tempest-ProjectReaderTests-2105386862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e248074-3b3f-4967-949c-463e92e213f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:38:34 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f53017ff-ca9f-4110-969d-9aef1e1c96f8 tempest-ProjectReaderTests-2105386862 None] Flow 'volume_create_manager' (60ef1a51-f511-4059-a556-f2cc68d93e14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:38:34 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-f53017ff-ca9f-4110-969d-9aef1e1c96f8 tempest-ProjectReaderTests-2105386862 None] Created volume successfully. Sep 16 20:38:34 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-a3a1c202-d78f-488b-be5c-5945113d9314 tempest-ProjectMemberTests-730908627 None] Acquiring lock "cinder-e3c6ec07-3fba-4161-ac43-15dcb3b831c0-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:38:34 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-a3a1c202-d78f-488b-be5c-5945113d9314 tempest-ProjectMemberTests-730908627 None] Lock "cinder-e3c6ec07-3fba-4161-ac43-15dcb3b831c0-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:38:34 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-a3a1c202-d78f-488b-be5c-5945113d9314 tempest-ProjectMemberTests-730908627 None] Acquiring lock "cinder-quobyte-e3c6ec07-3fba-4161-ac43-15dcb3b831c0" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:38:34 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-a3a1c202-d78f-488b-be5c-5945113d9314 tempest-ProjectMemberTests-730908627 None] Lock "cinder-quobyte-e3c6ec07-3fba-4161-ac43-15dcb3b831c0" acquired by "delete_volume" :: waited 0.015s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:38:35 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[941bfc05-41c6-48fd-8882-58ba27c06dcc]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:38:35 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a3a1c202-d78f-488b-be5c-5945113d9314 tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e3c6ec07-3fba-4161-ac43-15dcb3b831c0 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:35 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b692b72-5e2d-4cc7-93ae-aaf8e86758b2 tempest-SnapshotDependencyTests-1531567735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:38:35 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-5b692b72-5e2d-4cc7-93ae-aaf8e86758b2 tempest-SnapshotDependencyTests-1531567735 None] Flow 'volume_create_manager' (67788d0e-e328-473f-9fbc-146ed3872f79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:38:35 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-5b692b72-5e2d-4cc7-93ae-aaf8e86758b2 tempest-SnapshotDependencyTests-1531567735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43b0b3d5-e5e7-4687-bb44-f9bc4c6a9d47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:38:35 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-5b692b72-5e2d-4cc7-93ae-aaf8e86758b2 tempest-SnapshotDependencyTests-1531567735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43b0b3d5-e5e7-4687-bb44-f9bc4c6a9d47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:38:35Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15f07f55-281d-433b-a25c-9537ab625863,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e35d31926dc458897d07aecbddd24b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:38:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=36f35f86-869a-4975-880b-37ce986184d2,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:38:35Z,use_quota=True,user_id='0c2b0795628242df85abc05c86314982',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:38:35 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-5b692b72-5e2d-4cc7-93ae-aaf8e86758b2 tempest-SnapshotDependencyTests-1531567735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a688f82-1e4a-42b4-9366-4826519dc2ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:38:35 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-5b692b72-5e2d-4cc7-93ae-aaf8e86758b2 tempest-SnapshotDependencyTests-1531567735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a688f82-1e4a-42b4-9366-4826519dc2ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:38:35 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-5b692b72-5e2d-4cc7-93ae-aaf8e86758b2 tempest-SnapshotDependencyTests-1531567735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38a23f66-00d7-4758-8e1f-e8dce1a4bc02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:38:35 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-5b692b72-5e2d-4cc7-93ae-aaf8e86758b2 tempest-SnapshotDependencyTests-1531567735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38a23f66-00d7-4758-8e1f-e8dce1a4bc02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '15f07f55-281d-433b-a25c-9537ab625863', 'volume_name': 'volume-15f07f55-281d-433b-a25c-9537ab625863', 'volume_size': 1, 'snapshot_id': '36f35f86-869a-4975-880b-37ce986184d2'}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:38:35 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-5b692b72-5e2d-4cc7-93ae-aaf8e86758b2 tempest-SnapshotDependencyTests-1531567735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78db5ce5-5a74-4b48-bc15-da9239325c78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:38:35 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-5b692b72-5e2d-4cc7-93ae-aaf8e86758b2 tempest-SnapshotDependencyTests-1531567735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78db5ce5-5a74-4b48-bc15-da9239325c78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:38:35 devstack sudo[106402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e3c6ec07-3fba-4161-ac43-15dcb3b831c0 Sep 16 20:38:35 devstack sudo[106402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:35 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-5b692b72-5e2d-4cc7-93ae-aaf8e86758b2 tempest-SnapshotDependencyTests-1531567735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16e9f442-23ff-4957-9bde-01c4762fe376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:38:35 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-5b692b72-5e2d-4cc7-93ae-aaf8e86758b2 tempest-SnapshotDependencyTests-1531567735 None] Volume 15f07f55-281d-433b-a25c-9537ab625863: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-15f07f55-281d-433b-a25c-9537ab625863', 'volume_size': 1, 'snapshot_id': '36f35f86-869a-4975-880b-37ce986184d2'} Sep 16 20:38:35 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-5b692b72-5e2d-4cc7-93ae-aaf8e86758b2 tempest-SnapshotDependencyTests-1531567735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:38:35 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-5b692b72-5e2d-4cc7-93ae-aaf8e86758b2 tempest-SnapshotDependencyTests-1531567735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:38:35 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-5b692b72-5e2d-4cc7-93ae-aaf8e86758b2 tempest-SnapshotDependencyTests-1531567735 None] Acquiring lock "cinder-quobyte-36f35f86-869a-4975-880b-37ce986184d2-15f07f55-281d-433b-a25c-9537ab625863" by "_create_volume_from_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:38:35 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-5b692b72-5e2d-4cc7-93ae-aaf8e86758b2 tempest-SnapshotDependencyTests-1531567735 None] Lock "cinder-quobyte-36f35f86-869a-4975-880b-37ce986184d2-15f07f55-281d-433b-a25c-9537ab625863" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:38:35 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-5b692b72-5e2d-4cc7-93ae-aaf8e86758b2 tempest-SnapshotDependencyTests-1531567735 None] Creating volume 15f07f55-281d-433b-a25c-9537ab625863 from snapshot 36f35f86-869a-4975-880b-37ce986184d2 {{(pid=86188) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 16 20:38:35 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-5b692b72-5e2d-4cc7-93ae-aaf8e86758b2 tempest-SnapshotDependencyTests-1531567735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:38:35 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-5b692b72-5e2d-4cc7-93ae-aaf8e86758b2 tempest-SnapshotDependencyTests-1531567735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:38:35 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-5b692b72-5e2d-4cc7-93ae-aaf8e86758b2 tempest-SnapshotDependencyTests-1531567735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:38:35 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-5b692b72-5e2d-4cc7-93ae-aaf8e86758b2 tempest-SnapshotDependencyTests-1531567735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:38:35 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-5b692b72-5e2d-4cc7-93ae-aaf8e86758b2 tempest-SnapshotDependencyTests-1531567735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:38:35 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-5b692b72-5e2d-4cc7-93ae-aaf8e86758b2 tempest-SnapshotDependencyTests-1531567735 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:38:35 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-5b692b72-5e2d-4cc7-93ae-aaf8e86758b2 tempest-SnapshotDependencyTests-1531567735 None] Acquiring lock "cinder-quobyte-15f07f55-281d-433b-a25c-9537ab625863" by "_copy_volume_from_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:38:35 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-5b692b72-5e2d-4cc7-93ae-aaf8e86758b2 tempest-SnapshotDependencyTests-1531567735 None] Lock "cinder-quobyte-15f07f55-281d-433b-a25c-9537ab625863" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:38:35 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-5b692b72-5e2d-4cc7-93ae-aaf8e86758b2 tempest-SnapshotDependencyTests-1531567735 None] snapshot: 36f35f86-869a-4975-880b-37ce986184d2, volume: 15f07f55-281d-433b-a25c-9537ab625863, {{(pid=86188) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 16 20:38:35 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-5b692b72-5e2d-4cc7-93ae-aaf8e86758b2 tempest-SnapshotDependencyTests-1531567735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:38:35 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-5b692b72-5e2d-4cc7-93ae-aaf8e86758b2 tempest-SnapshotDependencyTests-1531567735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:38:35 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-5b692b72-5e2d-4cc7-93ae-aaf8e86758b2 tempest-SnapshotDependencyTests-1531567735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:38:35 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-5b692b72-5e2d-4cc7-93ae-aaf8e86758b2 tempest-SnapshotDependencyTests-1531567735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:38:35 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-5b692b72-5e2d-4cc7-93ae-aaf8e86758b2 tempest-SnapshotDependencyTests-1531567735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:38:35 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc2c81fe-e0bd-4447-8038-df1196404f9a]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:38:35 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-5b692b72-5e2d-4cc7-93ae-aaf8e86758b2 tempest-SnapshotDependencyTests-1531567735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9aac7519-231e-4085-ae3c-9be2c4b8ce99.36f35f86-869a-4975-880b-37ce986184d2 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:35 devstack sudo[106404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9aac7519-231e-4085-ae3c-9be2c4b8ce99.36f35f86-869a-4975-880b-37ce986184d2 Sep 16 20:38:35 devstack sudo[106404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:35 devstack sudo[106402]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:35 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a3a1c202-d78f-488b-be5c-5945113d9314 tempest-ProjectMemberTests-730908627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e3c6ec07-3fba-4161-ac43-15dcb3b831c0" returned: 0 in 0.465s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:35 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a3a1c202-d78f-488b-be5c-5945113d9314 tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e3c6ec07-3fba-4161-ac43-15dcb3b831c0 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:35 devstack sudo[106409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e3c6ec07-3fba-4161-ac43-15dcb3b831c0 Sep 16 20:38:35 devstack sudo[106409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:35 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cb13504-0425-4c95-ab7f-b3fb47353810 tempest-ProjectReaderTests-510915641 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:38:35 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-7cb13504-0425-4c95-ab7f-b3fb47353810 tempest-ProjectReaderTests-510915641 None] Flow 'volume_create_manager' (f310adea-c3fd-48aa-8047-72f27ce8d945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:38:35 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-7cb13504-0425-4c95-ab7f-b3fb47353810 tempest-ProjectReaderTests-510915641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b440d3f-3723-41ae-b3a1-48196512b0ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:38:35 devstack sudo[106404]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:35 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-5b692b72-5e2d-4cc7-93ae-aaf8e86758b2 tempest-SnapshotDependencyTests-1531567735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9aac7519-231e-4085-ae3c-9be2c4b8ce99.36f35f86-869a-4975-880b-37ce986184d2" returned: 0 in 0.488s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:35 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-5b692b72-5e2d-4cc7-93ae-aaf8e86758b2 tempest-SnapshotDependencyTests-1531567735 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9aac7519-231e-4085-ae3c-9be2c4b8ce99(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86188) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 20:38:35 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-7cb13504-0425-4c95-ab7f-b3fb47353810 tempest-ProjectReaderTests-510915641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b440d3f-3723-41ae-b3a1-48196512b0ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:38:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1621176228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=252af13c-c41b-444b-b282-3b47c70a1938,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ace9fe7829b4403c94750df5f95439e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:38:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:38:36Z,use_quota=True,user_id='4ac8de8833be4dbfa41217152fa8344d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:38:35 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-7cb13504-0425-4c95-ab7f-b3fb47353810 tempest-ProjectReaderTests-510915641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (879310bb-5675-40e6-aa4d-384a06f03357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:38:35 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-7cb13504-0425-4c95-ab7f-b3fb47353810 tempest-ProjectReaderTests-510915641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (879310bb-5675-40e6-aa4d-384a06f03357) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:38:35 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-7cb13504-0425-4c95-ab7f-b3fb47353810 tempest-ProjectReaderTests-510915641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8504ef0-5458-41cc-95fa-34e2e2286850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:38:35 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-7cb13504-0425-4c95-ab7f-b3fb47353810 tempest-ProjectReaderTests-510915641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8504ef0-5458-41cc-95fa-34e2e2286850) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '252af13c-c41b-444b-b282-3b47c70a1938', 'volume_name': 'volume-252af13c-c41b-444b-b282-3b47c70a1938', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:38:35 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-7cb13504-0425-4c95-ab7f-b3fb47353810 tempest-ProjectReaderTests-510915641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a08505eb-75bd-470b-9d75-9d01b44784a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:38:35 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-7cb13504-0425-4c95-ab7f-b3fb47353810 tempest-ProjectReaderTests-510915641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a08505eb-75bd-470b-9d75-9d01b44784a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:38:35 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-7cb13504-0425-4c95-ab7f-b3fb47353810 tempest-ProjectReaderTests-510915641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f093816d-0b43-40bb-8acb-4830d7596a8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:38:35 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-7cb13504-0425-4c95-ab7f-b3fb47353810 tempest-ProjectReaderTests-510915641 None] Volume 252af13c-c41b-444b-b282-3b47c70a1938: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-252af13c-c41b-444b-b282-3b47c70a1938', 'volume_size': 1} Sep 16 20:38:35 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-7cb13504-0425-4c95-ab7f-b3fb47353810 tempest-ProjectReaderTests-510915641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:38:35 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[4275c04b-db94-4f79-89e1-d4e9751476d8]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:38:35 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-5b692b72-5e2d-4cc7-93ae-aaf8e86758b2 tempest-SnapshotDependencyTests-1531567735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9aac7519-231e-4085-ae3c-9be2c4b8ce99 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:35 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-9402ea75-ddeb-41d9-a83e-fee7e3d3a8ba tempest-ProjectReaderTests-2105386862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:38:35 devstack sudo[106409]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:35 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a3a1c202-d78f-488b-be5c-5945113d9314 tempest-ProjectMemberTests-730908627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-e3c6ec07-3fba-4161-ac43-15dcb3b831c0" returned: 0 in 0.360s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:35 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-a3a1c202-d78f-488b-be5c-5945113d9314 tempest-ProjectMemberTests-730908627 None] Lock "cinder-quobyte-e3c6ec07-3fba-4161-ac43-15dcb3b831c0" released by "delete_volume" :: held 0.902s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:38:35 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-a3a1c202-d78f-488b-be5c-5945113d9314 tempest-ProjectMemberTests-730908627 None] Created reservations ['c8d2717c-82fa-4021-8f71-a9a6eaede0d9', '2cfcdb7d-19bd-4f10-b5cc-6e0a429372e1', 'fc39ece8-218a-43ff-9385-6b0dc643b387', '814d258d-0d1a-4afa-9988-7c3b3c8de470'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:38:35 devstack sudo[106416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9aac7519-231e-4085-ae3c-9be2c4b8ce99 Sep 16 20:38:35 devstack sudo[106416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:35 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a3a1c202-d78f-488b-be5c-5945113d9314 tempest-ProjectMemberTests-730908627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:38:35 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a3a1c202-d78f-488b-be5c-5945113d9314 tempest-ProjectMemberTests-730908627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:38:35 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-a3a1c202-d78f-488b-be5c-5945113d9314 tempest-ProjectMemberTests-730908627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:38:35 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-a3a1c202-d78f-488b-be5c-5945113d9314 tempest-ProjectMemberTests-730908627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:38:35 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a3a1c202-d78f-488b-be5c-5945113d9314 tempest-ProjectMemberTests-730908627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:38:35 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a3a1c202-d78f-488b-be5c-5945113d9314 tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:36 devstack sudo[106418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:38:36 devstack sudo[106418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:36 devstack sudo[106416]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:36 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-5b692b72-5e2d-4cc7-93ae-aaf8e86758b2 tempest-SnapshotDependencyTests-1531567735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9aac7519-231e-4085-ae3c-9be2c4b8ce99" returned: 0 in 0.394s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:36 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-5b692b72-5e2d-4cc7-93ae-aaf8e86758b2 tempest-SnapshotDependencyTests-1531567735 None] will copy from snapshot at /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9aac7519-231e-4085-ae3c-9be2c4b8ce99 {{(pid=86188) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 16 20:38:36 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-5b692b72-5e2d-4cc7-93ae-aaf8e86758b2 tempest-SnapshotDependencyTests-1531567735 None] Creating direct copy from snapshot {{(pid=86188) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 16 20:38:36 devstack cinder-volume[86188]: DEBUG cinder.utils [None req-5b692b72-5e2d-4cc7-93ae-aaf8e86758b2 tempest-SnapshotDependencyTests-1531567735 None] Path /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-15f07f55-281d-433b-a25c-9537ab625863 not found in is_blk_device check {{(pid=86188) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 16 20:38:36 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-5b692b72-5e2d-4cc7-93ae-aaf8e86758b2 tempest-SnapshotDependencyTests-1531567735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9aac7519-231e-4085-ae3c-9be2c4b8ce99 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-15f07f55-281d-433b-a25c-9537ab625863 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:36 devstack sudo[106423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9aac7519-231e-4085-ae3c-9be2c4b8ce99 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-15f07f55-281d-433b-a25c-9537ab625863 Sep 16 20:38:36 devstack sudo[106423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:36 devstack sudo[106418]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:36 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a3a1c202-d78f-488b-be5c-5945113d9314 tempest-ProjectMemberTests-730908627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.268s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:36 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-a3a1c202-d78f-488b-be5c-5945113d9314 tempest-ProjectMemberTests-730908627 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:38:36 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-a3a1c202-d78f-488b-be5c-5945113d9314 tempest-ProjectMemberTests-730908627 None] Deleted volume successfully. Sep 16 20:38:36 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-a3a1c202-d78f-488b-be5c-5945113d9314 tempest-ProjectMemberTests-730908627 None] Lock "cinder-e3c6ec07-3fba-4161-ac43-15dcb3b831c0-delete_volume" released by "delete_volume" :: held 1.408s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:38:36 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd4954ab-5586-4cf4-93e9-c080fff38b68 tempest-ProjectMemberTests-730908627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:38:36 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-bd4954ab-5586-4cf4-93e9-c080fff38b68 tempest-ProjectMemberTests-730908627 None] Flow 'volume_create_manager' (4750de96-0c8e-4132-91db-bc4d64818b08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:38:36 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-bd4954ab-5586-4cf4-93e9-c080fff38b68 tempest-ProjectMemberTests-730908627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e142e90c-5040-45d2-b33d-fb83c3de8985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:38:36 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-bd4954ab-5586-4cf4-93e9-c080fff38b68 tempest-ProjectMemberTests-730908627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e142e90c-5040-45d2-b33d-fb83c3de8985) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:38:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-174524634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27ae9b1f-92ba-4125-b30c-45d099a1226f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d632f989377844f6b93c3b9bf838981d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:38:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:38:37Z,use_quota=True,user_id='5db8cf25fcc448629ab58c8006482185',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:38:36 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-bd4954ab-5586-4cf4-93e9-c080fff38b68 tempest-ProjectMemberTests-730908627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03207644-27a9-4410-8e58-272d0c4d6830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:38:36 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-bd4954ab-5586-4cf4-93e9-c080fff38b68 tempest-ProjectMemberTests-730908627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03207644-27a9-4410-8e58-272d0c4d6830) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:38:36 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-bd4954ab-5586-4cf4-93e9-c080fff38b68 tempest-ProjectMemberTests-730908627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (524d96a5-2128-4ac7-a822-838152f22048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:38:36 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-bd4954ab-5586-4cf4-93e9-c080fff38b68 tempest-ProjectMemberTests-730908627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (524d96a5-2128-4ac7-a822-838152f22048) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27ae9b1f-92ba-4125-b30c-45d099a1226f', 'volume_name': 'volume-27ae9b1f-92ba-4125-b30c-45d099a1226f', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:38:36 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-bd4954ab-5586-4cf4-93e9-c080fff38b68 tempest-ProjectMemberTests-730908627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1675347-f7ba-4e6d-8503-79a3f4c1d06c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:38:36 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-bd4954ab-5586-4cf4-93e9-c080fff38b68 tempest-ProjectMemberTests-730908627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1675347-f7ba-4e6d-8503-79a3f4c1d06c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:38:36 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-bd4954ab-5586-4cf4-93e9-c080fff38b68 tempest-ProjectMemberTests-730908627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a727e1a-e914-496f-9d6c-507860939424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:38:36 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-bd4954ab-5586-4cf4-93e9-c080fff38b68 tempest-ProjectMemberTests-730908627 None] Volume 27ae9b1f-92ba-4125-b30c-45d099a1226f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27ae9b1f-92ba-4125-b30c-45d099a1226f', 'volume_size': 1} Sep 16 20:38:36 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-bd4954ab-5586-4cf4-93e9-c080fff38b68 tempest-ProjectMemberTests-730908627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:38:42 devstack sudo[106423]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:42 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-5b692b72-5e2d-4cc7-93ae-aaf8e86758b2 tempest-SnapshotDependencyTests-1531567735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9aac7519-231e-4085-ae3c-9be2c4b8ce99 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-15f07f55-281d-433b-a25c-9537ab625863" returned: 0 in 5.971s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:42 devstack cinder-volume[86188]: DEBUG cinder.image.image_utils [None req-5b692b72-5e2d-4cc7-93ae-aaf8e86758b2 tempest-SnapshotDependencyTests-1531567735 None] Image conversion details: src /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9aac7519-231e-4085-ae3c-9be2c4b8ce99, size 1024.00 MB, duration 5.97 sec, destination /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-15f07f55-281d-433b-a25c-9537ab625863 {{(pid=86188) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 16 20:38:42 devstack cinder-volume[86188]: INFO cinder.image.image_utils [None req-5b692b72-5e2d-4cc7-93ae-aaf8e86758b2 tempest-SnapshotDependencyTests-1531567735 None] Converted 1024.00 MB image at 171.45 MB/s Sep 16 20:38:42 devstack cinder-volume[86188]: WARNING cinder.volume.drivers.remotefs [None req-5b692b72-5e2d-4cc7-93ae-aaf8e86758b2 tempest-SnapshotDependencyTests-1531567735 None] /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-15f07f55-281d-433b-a25c-9537ab625863 is being set with open permissions: ugo+rw Sep 16 20:38:42 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-5b692b72-5e2d-4cc7-93ae-aaf8e86758b2 tempest-SnapshotDependencyTests-1531567735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-15f07f55-281d-433b-a25c-9537ab625863 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:42 devstack sudo[106438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-15f07f55-281d-433b-a25c-9537ab625863 Sep 16 20:38:42 devstack sudo[106438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:42 devstack sudo[106438]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:42 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-5b692b72-5e2d-4cc7-93ae-aaf8e86758b2 tempest-SnapshotDependencyTests-1531567735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-15f07f55-281d-433b-a25c-9537ab625863" returned: 0 in 0.237s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:42 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-5b692b72-5e2d-4cc7-93ae-aaf8e86758b2 tempest-SnapshotDependencyTests-1531567735 None] Lock "cinder-quobyte-15f07f55-281d-433b-a25c-9537ab625863" released by "_copy_volume_from_snapshot" :: held 7.227s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:38:42 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-5b692b72-5e2d-4cc7-93ae-aaf8e86758b2 tempest-SnapshotDependencyTests-1531567735 None] Lock "cinder-quobyte-36f35f86-869a-4975-880b-37ce986184d2-15f07f55-281d-433b-a25c-9537ab625863" released by "_create_volume_from_snapshot" :: held 7.290s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:38:42 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-5b692b72-5e2d-4cc7-93ae-aaf8e86758b2 tempest-SnapshotDependencyTests-1531567735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.307s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:38:42 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-7cb13504-0425-4c95-ab7f-b3fb47353810 tempest-ProjectReaderTests-510915641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.662s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:38:42 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-7cb13504-0425-4c95-ab7f-b3fb47353810 tempest-ProjectReaderTests-510915641 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:38:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1621176228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=252af13c-c41b-444b-b282-3b47c70a1938,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ace9fe7829b4403c94750df5f95439e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:38:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:38:36Z,use_quota=True,user_id='4ac8de8833be4dbfa41217152fa8344d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:38:42 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-7cb13504-0425-4c95-ab7f-b3fb47353810 tempest-ProjectReaderTests-510915641 None] Creating volume 252af13c-c41b-444b-b282-3b47c70a1938 {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:38:42 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-7cb13504-0425-4c95-ab7f-b3fb47353810 tempest-ProjectReaderTests-510915641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:38:42 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-7cb13504-0425-4c95-ab7f-b3fb47353810 tempest-ProjectReaderTests-510915641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:38:42 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-7cb13504-0425-4c95-ab7f-b3fb47353810 tempest-ProjectReaderTests-510915641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:38:42 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-7cb13504-0425-4c95-ab7f-b3fb47353810 tempest-ProjectReaderTests-510915641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:38:42 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-7cb13504-0425-4c95-ab7f-b3fb47353810 tempest-ProjectReaderTests-510915641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:38:42 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-7cb13504-0425-4c95-ab7f-b3fb47353810 tempest-ProjectReaderTests-510915641 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:38:42 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-7cb13504-0425-4c95-ab7f-b3fb47353810 tempest-ProjectReaderTests-510915641 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:38:42 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-7cb13504-0425-4c95-ab7f-b3fb47353810 tempest-ProjectReaderTests-510915641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-252af13c-c41b-444b-b282-3b47c70a1938 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:42 devstack sudo[106441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-252af13c-c41b-444b-b282-3b47c70a1938 1073741824 Sep 16 20:38:42 devstack sudo[106441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:42 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-5b692b72-5e2d-4cc7-93ae-aaf8e86758b2 tempest-SnapshotDependencyTests-1531567735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16e9f442-23ff-4957-9bde-01c4762fe376) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15f07f55-281d-433b-a25c-9537ab625863', 'volume_size': 1, 'snapshot_id': '36f35f86-869a-4975-880b-37ce986184d2'}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:38:42 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-5b692b72-5e2d-4cc7-93ae-aaf8e86758b2 tempest-SnapshotDependencyTests-1531567735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c531ba1-92ea-456b-9a88-c76d851f0cf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:38:42 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-5b692b72-5e2d-4cc7-93ae-aaf8e86758b2 tempest-SnapshotDependencyTests-1531567735 None] Volume volume-15f07f55-281d-433b-a25c-9537ab625863 (15f07f55-281d-433b-a25c-9537ab625863): created successfully Sep 16 20:38:42 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-5b692b72-5e2d-4cc7-93ae-aaf8e86758b2 tempest-SnapshotDependencyTests-1531567735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c531ba1-92ea-456b-9a88-c76d851f0cf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:38:42 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-5b692b72-5e2d-4cc7-93ae-aaf8e86758b2 tempest-SnapshotDependencyTests-1531567735 None] Flow 'volume_create_manager' (67788d0e-e328-473f-9fbc-146ed3872f79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:38:42 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-5b692b72-5e2d-4cc7-93ae-aaf8e86758b2 tempest-SnapshotDependencyTests-1531567735 None] Created volume successfully. Sep 16 20:38:42 devstack sudo[106441]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:42 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-7cb13504-0425-4c95-ab7f-b3fb47353810 tempest-ProjectReaderTests-510915641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-252af13c-c41b-444b-b282-3b47c70a1938 1073741824" returned: 0 in 0.407s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:42 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-7cb13504-0425-4c95-ab7f-b3fb47353810 tempest-ProjectReaderTests-510915641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-252af13c-c41b-444b-b282-3b47c70a1938 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:42 devstack sudo[106446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-252af13c-c41b-444b-b282-3b47c70a1938 Sep 16 20:38:42 devstack sudo[106446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:43 devstack sudo[106446]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:43 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-7cb13504-0425-4c95-ab7f-b3fb47353810 tempest-ProjectReaderTests-510915641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-252af13c-c41b-444b-b282-3b47c70a1938" returned: 0 in 0.237s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:43 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-7cb13504-0425-4c95-ab7f-b3fb47353810 tempest-ProjectReaderTests-510915641 None] <== create_volume: return (684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:38:43 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-7cb13504-0425-4c95-ab7f-b3fb47353810 tempest-ProjectReaderTests-510915641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.688s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:38:43 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-9402ea75-ddeb-41d9-a83e-fee7e3d3a8ba tempest-ProjectReaderTests-2105386862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.325s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:38:43 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-7cb13504-0425-4c95-ab7f-b3fb47353810 tempest-ProjectReaderTests-510915641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f093816d-0b43-40bb-8acb-4830d7596a8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-252af13c-c41b-444b-b282-3b47c70a1938', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:38:43 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-7cb13504-0425-4c95-ab7f-b3fb47353810 tempest-ProjectReaderTests-510915641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7894ac4-e206-4aa3-9bb1-933ef04cdcfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:38:43 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-9402ea75-ddeb-41d9-a83e-fee7e3d3a8ba tempest-ProjectReaderTests-2105386862 None] Creating offline snapshot 171cefea-9d10-4730-aa6b-fceb4b780f60 of volume 0c6e77a8-2bb7-452d-8971-04a61b30b3ed {{(pid=86188) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 20:38:43 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-7cb13504-0425-4c95-ab7f-b3fb47353810 tempest-ProjectReaderTests-510915641 None] Volume volume-252af13c-c41b-444b-b282-3b47c70a1938 (252af13c-c41b-444b-b282-3b47c70a1938): created successfully Sep 16 20:38:43 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-7cb13504-0425-4c95-ab7f-b3fb47353810 tempest-ProjectReaderTests-510915641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7894ac4-e206-4aa3-9bb1-933ef04cdcfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:38:43 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-7cb13504-0425-4c95-ab7f-b3fb47353810 tempest-ProjectReaderTests-510915641 None] Flow 'volume_create_manager' (f310adea-c3fd-48aa-8047-72f27ce8d945) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:38:43 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[d54cdcd4-aae0-4830-9331-1423df799094]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:38:43 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-9402ea75-ddeb-41d9-a83e-fee7e3d3a8ba tempest-ProjectReaderTests-2105386862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-0c6e77a8-2bb7-452d-8971-04a61b30b3ed {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:43 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-7cb13504-0425-4c95-ab7f-b3fb47353810 tempest-ProjectReaderTests-510915641 None] Created volume successfully. Sep 16 20:38:43 devstack sudo[106449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-0c6e77a8-2bb7-452d-8971-04a61b30b3ed Sep 16 20:38:43 devstack sudo[106449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:43 devstack sudo[106449]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:43 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-9402ea75-ddeb-41d9-a83e-fee7e3d3a8ba tempest-ProjectReaderTests-2105386862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-0c6e77a8-2bb7-452d-8971-04a61b30b3ed" returned: 0 in 0.369s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:43 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-9402ea75-ddeb-41d9-a83e-fee7e3d3a8ba tempest-ProjectReaderTests-2105386862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-0c6e77a8-2bb7-452d-8971-04a61b30b3ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-0c6e77a8-2bb7-452d-8971-04a61b30b3ed.171cefea-9d10-4730-aa6b-fceb4b780f60 1G {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:43 devstack sudo[106454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-0c6e77a8-2bb7-452d-8971-04a61b30b3ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-0c6e77a8-2bb7-452d-8971-04a61b30b3ed.171cefea-9d10-4730-aa6b-fceb4b780f60 1G Sep 16 20:38:43 devstack sudo[106454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:43 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-18a4febe-ae1a-4fbc-ad56-357e95b706d5 tempest-SnapshotDependencyTests-1531567735 None] Acquiring lock "cinder-36f35f86-869a-4975-880b-37ce986184d2-delete_snapshot" by "delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:38:43 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-18a4febe-ae1a-4fbc-ad56-357e95b706d5 tempest-SnapshotDependencyTests-1531567735 None] Lock "cinder-36f35f86-869a-4975-880b-37ce986184d2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:38:43 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-18a4febe-ae1a-4fbc-ad56-357e95b706d5 tempest-SnapshotDependencyTests-1531567735 None] Acquiring lock "cinder-quobyte-9aac7519-231e-4085-ae3c-9be2c4b8ce99" by "delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:38:43 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-18a4febe-ae1a-4fbc-ad56-357e95b706d5 tempest-SnapshotDependencyTests-1531567735 None] Lock "cinder-quobyte-9aac7519-231e-4085-ae3c-9be2c4b8ce99" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:38:43 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-18a4febe-ae1a-4fbc-ad56-357e95b706d5 tempest-SnapshotDependencyTests-1531567735 None] Acquiring lock "cinder-quobyte-36f35f86-869a-4975-880b-37ce986184d2" by "_delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:38:43 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-18a4febe-ae1a-4fbc-ad56-357e95b706d5 tempest-SnapshotDependencyTests-1531567735 None] Lock "cinder-quobyte-36f35f86-869a-4975-880b-37ce986184d2" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:38:43 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-18a4febe-ae1a-4fbc-ad56-357e95b706d5 tempest-SnapshotDependencyTests-1531567735 None] Deleting offline snapshot 36f35f86-869a-4975-880b-37ce986184d2 of volume 9aac7519-231e-4085-ae3c-9be2c4b8ce99 {{(pid=86188) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 20:38:43 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-18a4febe-ae1a-4fbc-ad56-357e95b706d5 tempest-SnapshotDependencyTests-1531567735 None] snapshot_file for this snap is: volume-9aac7519-231e-4085-ae3c-9be2c4b8ce99.36f35f86-869a-4975-880b-37ce986184d2 {{(pid=86188) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 20:38:43 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e2c3aaf-06f3-46ea-b454-72a8edc67303]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:38:43 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-18a4febe-ae1a-4fbc-ad56-357e95b706d5 tempest-SnapshotDependencyTests-1531567735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9aac7519-231e-4085-ae3c-9be2c4b8ce99.36f35f86-869a-4975-880b-37ce986184d2 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:43 devstack sudo[106457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9aac7519-231e-4085-ae3c-9be2c4b8ce99.36f35f86-869a-4975-880b-37ce986184d2 Sep 16 20:38:43 devstack sudo[106457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:44 devstack sudo[106454]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:44 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-9402ea75-ddeb-41d9-a83e-fee7e3d3a8ba tempest-ProjectReaderTests-2105386862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-0c6e77a8-2bb7-452d-8971-04a61b30b3ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-0c6e77a8-2bb7-452d-8971-04a61b30b3ed.171cefea-9d10-4730-aa6b-fceb4b780f60 1G" returned: 0 in 0.432s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:44 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-9402ea75-ddeb-41d9-a83e-fee7e3d3a8ba tempest-ProjectReaderTests-2105386862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c6e77a8-2bb7-452d-8971-04a61b30b3ed -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-0c6e77a8-2bb7-452d-8971-04a61b30b3ed.171cefea-9d10-4730-aa6b-fceb4b780f60 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:44 devstack sudo[106462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c6e77a8-2bb7-452d-8971-04a61b30b3ed -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-0c6e77a8-2bb7-452d-8971-04a61b30b3ed.171cefea-9d10-4730-aa6b-fceb4b780f60 Sep 16 20:38:44 devstack sudo[106462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:44 devstack sudo[106457]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:44 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-18a4febe-ae1a-4fbc-ad56-357e95b706d5 tempest-SnapshotDependencyTests-1531567735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9aac7519-231e-4085-ae3c-9be2c4b8ce99.36f35f86-869a-4975-880b-37ce986184d2" returned: 0 in 0.391s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:44 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-18a4febe-ae1a-4fbc-ad56-357e95b706d5 tempest-SnapshotDependencyTests-1531567735 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9aac7519-231e-4085-ae3c-9be2c4b8ce99(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86188) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 20:38:44 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf548b2c-ff6a-4d5b-8326-eca77a7db7d1]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:38:44 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-18a4febe-ae1a-4fbc-ad56-357e95b706d5 tempest-SnapshotDependencyTests-1531567735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9aac7519-231e-4085-ae3c-9be2c4b8ce99 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:44 devstack sudo[106467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9aac7519-231e-4085-ae3c-9be2c4b8ce99 Sep 16 20:38:44 devstack sudo[106467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:44 devstack sudo[106462]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:44 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-9402ea75-ddeb-41d9-a83e-fee7e3d3a8ba tempest-ProjectReaderTests-2105386862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c6e77a8-2bb7-452d-8971-04a61b30b3ed -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-0c6e77a8-2bb7-452d-8971-04a61b30b3ed.171cefea-9d10-4730-aa6b-fceb4b780f60" returned: 0 in 0.310s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:44 devstack cinder-volume[86188]: WARNING cinder.volume.drivers.remotefs [None req-9402ea75-ddeb-41d9-a83e-fee7e3d3a8ba tempest-ProjectReaderTests-2105386862 None] /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-0c6e77a8-2bb7-452d-8971-04a61b30b3ed.171cefea-9d10-4730-aa6b-fceb4b780f60 is being set with open permissions: ugo+rw Sep 16 20:38:44 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-9402ea75-ddeb-41d9-a83e-fee7e3d3a8ba tempest-ProjectReaderTests-2105386862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-0c6e77a8-2bb7-452d-8971-04a61b30b3ed.171cefea-9d10-4730-aa6b-fceb4b780f60 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:44 devstack sudo[106473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-0c6e77a8-2bb7-452d-8971-04a61b30b3ed.171cefea-9d10-4730-aa6b-fceb4b780f60 Sep 16 20:38:44 devstack sudo[106473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:44 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-d595320a-cb86-45e8-adec-d306cd0e93c0 tempest-ProjectReaderTests-510915641 None] Acquiring lock "cinder-252af13c-c41b-444b-b282-3b47c70a1938-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:38:44 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-d595320a-cb86-45e8-adec-d306cd0e93c0 tempest-ProjectReaderTests-510915641 None] Lock "cinder-252af13c-c41b-444b-b282-3b47c70a1938-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:38:44 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-d595320a-cb86-45e8-adec-d306cd0e93c0 tempest-ProjectReaderTests-510915641 None] Acquiring lock "cinder-quobyte-252af13c-c41b-444b-b282-3b47c70a1938" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:38:44 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-d595320a-cb86-45e8-adec-d306cd0e93c0 tempest-ProjectReaderTests-510915641 None] Lock "cinder-quobyte-252af13c-c41b-444b-b282-3b47c70a1938" acquired by "delete_volume" :: waited 0.015s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:38:44 devstack sudo[106473]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:44 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[587708f0-8ad8-4807-a6b8-e0d98f4fdf18]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:38:44 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-d595320a-cb86-45e8-adec-d306cd0e93c0 tempest-ProjectReaderTests-510915641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-252af13c-c41b-444b-b282-3b47c70a1938 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:44 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-9402ea75-ddeb-41d9-a83e-fee7e3d3a8ba tempest-ProjectReaderTests-2105386862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-0c6e77a8-2bb7-452d-8971-04a61b30b3ed.171cefea-9d10-4730-aa6b-fceb4b780f60" returned: 0 in 0.295s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:44 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-9402ea75-ddeb-41d9-a83e-fee7e3d3a8ba tempest-ProjectReaderTests-2105386862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-0c6e77a8-2bb7-452d-8971-04a61b30b3ed.info {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:44 devstack sudo[106479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-0c6e77a8-2bb7-452d-8971-04a61b30b3ed.info Sep 16 20:38:44 devstack sudo[106479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:44 devstack sudo[106478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-252af13c-c41b-444b-b282-3b47c70a1938 Sep 16 20:38:44 devstack sudo[106478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:44 devstack sudo[106467]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:44 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-18a4febe-ae1a-4fbc-ad56-357e95b706d5 tempest-SnapshotDependencyTests-1531567735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9aac7519-231e-4085-ae3c-9be2c4b8ce99" returned: 0 in 0.589s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:44 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-18a4febe-ae1a-4fbc-ad56-357e95b706d5 tempest-SnapshotDependencyTests-1531567735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9aac7519-231e-4085-ae3c-9be2c4b8ce99.36f35f86-869a-4975-880b-37ce986184d2 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:44 devstack sudo[106483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9aac7519-231e-4085-ae3c-9be2c4b8ce99.36f35f86-869a-4975-880b-37ce986184d2 Sep 16 20:38:44 devstack sudo[106483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:44 devstack sudo[106479]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:44 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-9402ea75-ddeb-41d9-a83e-fee7e3d3a8ba tempest-ProjectReaderTests-2105386862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-0c6e77a8-2bb7-452d-8971-04a61b30b3ed.info" returned: 0 in 0.269s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:44 devstack cinder-volume[86188]: WARNING cinder.volume.drivers.remotefs [None req-9402ea75-ddeb-41d9-a83e-fee7e3d3a8ba tempest-ProjectReaderTests-2105386862 None] /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-0c6e77a8-2bb7-452d-8971-04a61b30b3ed.info is being set with open permissions: ugo+rw Sep 16 20:38:44 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-9402ea75-ddeb-41d9-a83e-fee7e3d3a8ba tempest-ProjectReaderTests-2105386862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-0c6e77a8-2bb7-452d-8971-04a61b30b3ed.info {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:44 devstack sudo[106488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-0c6e77a8-2bb7-452d-8971-04a61b30b3ed.info Sep 16 20:38:44 devstack sudo[106488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:45 devstack sudo[106478]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:45 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-d595320a-cb86-45e8-adec-d306cd0e93c0 tempest-ProjectReaderTests-510915641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-252af13c-c41b-444b-b282-3b47c70a1938" returned: 0 in 0.439s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:45 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-d595320a-cb86-45e8-adec-d306cd0e93c0 tempest-ProjectReaderTests-510915641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-252af13c-c41b-444b-b282-3b47c70a1938 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:45 devstack sudo[106494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-252af13c-c41b-444b-b282-3b47c70a1938 Sep 16 20:38:45 devstack sudo[106494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:45 devstack sudo[106483]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:45 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-18a4febe-ae1a-4fbc-ad56-357e95b706d5 tempest-SnapshotDependencyTests-1531567735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9aac7519-231e-4085-ae3c-9be2c4b8ce99.36f35f86-869a-4975-880b-37ce986184d2" returned: 0 in 0.372s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:45 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-18a4febe-ae1a-4fbc-ad56-357e95b706d5 tempest-SnapshotDependencyTests-1531567735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9aac7519-231e-4085-ae3c-9be2c4b8ce99.36f35f86-869a-4975-880b-37ce986184d2 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:45 devstack sudo[106496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9aac7519-231e-4085-ae3c-9be2c4b8ce99.36f35f86-869a-4975-880b-37ce986184d2 Sep 16 20:38:45 devstack sudo[106496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:45 devstack sudo[106488]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:45 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-9402ea75-ddeb-41d9-a83e-fee7e3d3a8ba tempest-ProjectReaderTests-2105386862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-0c6e77a8-2bb7-452d-8971-04a61b30b3ed.info" returned: 0 in 0.307s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:45 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-9402ea75-ddeb-41d9-a83e-fee7e3d3a8ba tempest-ProjectReaderTests-2105386862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.106s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:38:45 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-bd4954ab-5586-4cf4-93e9-c080fff38b68 tempest-ProjectMemberTests-730908627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.610s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:38:45 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-bd4954ab-5586-4cf4-93e9-c080fff38b68 tempest-ProjectMemberTests-730908627 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:38:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-174524634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27ae9b1f-92ba-4125-b30c-45d099a1226f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d632f989377844f6b93c3b9bf838981d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:38:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:38:37Z,use_quota=True,user_id='5db8cf25fcc448629ab58c8006482185',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:38:45 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-bd4954ab-5586-4cf4-93e9-c080fff38b68 tempest-ProjectMemberTests-730908627 None] Creating volume 27ae9b1f-92ba-4125-b30c-45d099a1226f {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:38:45 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-bd4954ab-5586-4cf4-93e9-c080fff38b68 tempest-ProjectMemberTests-730908627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:38:45 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-bd4954ab-5586-4cf4-93e9-c080fff38b68 tempest-ProjectMemberTests-730908627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:38:45 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-bd4954ab-5586-4cf4-93e9-c080fff38b68 tempest-ProjectMemberTests-730908627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:38:45 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-bd4954ab-5586-4cf4-93e9-c080fff38b68 tempest-ProjectMemberTests-730908627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:38:45 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-bd4954ab-5586-4cf4-93e9-c080fff38b68 tempest-ProjectMemberTests-730908627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:38:45 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-bd4954ab-5586-4cf4-93e9-c080fff38b68 tempest-ProjectMemberTests-730908627 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:38:45 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-bd4954ab-5586-4cf4-93e9-c080fff38b68 tempest-ProjectMemberTests-730908627 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:38:45 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-bd4954ab-5586-4cf4-93e9-c080fff38b68 tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-27ae9b1f-92ba-4125-b30c-45d099a1226f 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:45 devstack sudo[106499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-27ae9b1f-92ba-4125-b30c-45d099a1226f 1073741824 Sep 16 20:38:45 devstack sudo[106499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:45 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-9402ea75-ddeb-41d9-a83e-fee7e3d3a8ba tempest-ProjectReaderTests-2105386862 None] Create snapshot completed successfully Sep 16 20:38:45 devstack sudo[106494]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:45 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-d595320a-cb86-45e8-adec-d306cd0e93c0 tempest-ProjectReaderTests-510915641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-252af13c-c41b-444b-b282-3b47c70a1938" returned: 0 in 0.302s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:45 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-d595320a-cb86-45e8-adec-d306cd0e93c0 tempest-ProjectReaderTests-510915641 None] Lock "cinder-quobyte-252af13c-c41b-444b-b282-3b47c70a1938" released by "delete_volume" :: held 0.787s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:38:45 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-d595320a-cb86-45e8-adec-d306cd0e93c0 tempest-ProjectReaderTests-510915641 None] Created reservations ['66733c1d-c69e-49c8-870b-fa2b30cb218b', 'dad8db36-51d0-4e35-b9aa-db471c625cf0', '553e882d-6ff3-4d2d-8512-2c599c4ba32f', '40f17cb3-172f-40c3-8ba8-dae7d130f743'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:38:45 devstack sudo[106496]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:45 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-18a4febe-ae1a-4fbc-ad56-357e95b706d5 tempest-SnapshotDependencyTests-1531567735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9aac7519-231e-4085-ae3c-9be2c4b8ce99.36f35f86-869a-4975-880b-37ce986184d2" returned: 0 in 0.289s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:45 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-18a4febe-ae1a-4fbc-ad56-357e95b706d5 tempest-SnapshotDependencyTests-1531567735 None] Lock "cinder-quobyte-36f35f86-869a-4975-880b-37ce986184d2" released by "_delete_snapshot" :: held 1.754s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:38:45 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-18a4febe-ae1a-4fbc-ad56-357e95b706d5 tempest-SnapshotDependencyTests-1531567735 None] Lock "cinder-quobyte-9aac7519-231e-4085-ae3c-9be2c4b8ce99" released by "delete_snapshot" :: held 1.778s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:38:45 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-d595320a-cb86-45e8-adec-d306cd0e93c0 tempest-ProjectReaderTests-510915641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:38:45 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-d595320a-cb86-45e8-adec-d306cd0e93c0 tempest-ProjectReaderTests-510915641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:38:45 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-d595320a-cb86-45e8-adec-d306cd0e93c0 tempest-ProjectReaderTests-510915641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:38:45 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-d595320a-cb86-45e8-adec-d306cd0e93c0 tempest-ProjectReaderTests-510915641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:38:45 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-d595320a-cb86-45e8-adec-d306cd0e93c0 tempest-ProjectReaderTests-510915641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:38:45 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-d595320a-cb86-45e8-adec-d306cd0e93c0 tempest-ProjectReaderTests-510915641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:45 devstack sudo[106506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:38:45 devstack sudo[106506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:45 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-18a4febe-ae1a-4fbc-ad56-357e95b706d5 tempest-SnapshotDependencyTests-1531567735 None] Created reservations ['c91ee1b5-19d4-41c8-aa6d-58a7c45f8320', 'aac09fdd-08ac-4389-953a-e96d7b495bf8', '7178d6e1-8a6b-44bc-ac54-309cf7179b9b', 'e0c1137f-c1cf-494d-a35d-0b80fe3ba89a'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:38:45 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-18a4febe-ae1a-4fbc-ad56-357e95b706d5 tempest-SnapshotDependencyTests-1531567735 None] Delete snapshot completed successfully. Sep 16 20:38:45 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-18a4febe-ae1a-4fbc-ad56-357e95b706d5 tempest-SnapshotDependencyTests-1531567735 None] Lock "cinder-36f35f86-869a-4975-880b-37ce986184d2-delete_snapshot" released by "delete_snapshot" :: held 1.956s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:38:45 devstack sudo[106499]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:45 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-bd4954ab-5586-4cf4-93e9-c080fff38b68 tempest-ProjectMemberTests-730908627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-27ae9b1f-92ba-4125-b30c-45d099a1226f 1073741824" returned: 0 in 0.495s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:45 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-bd4954ab-5586-4cf4-93e9-c080fff38b68 tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-27ae9b1f-92ba-4125-b30c-45d099a1226f {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:45 devstack sudo[106510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-27ae9b1f-92ba-4125-b30c-45d099a1226f Sep 16 20:38:45 devstack sudo[106510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:45 devstack sudo[106506]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:45 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-d595320a-cb86-45e8-adec-d306cd0e93c0 tempest-ProjectReaderTests-510915641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.310s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:45 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-d595320a-cb86-45e8-adec-d306cd0e93c0 tempest-ProjectReaderTests-510915641 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:38:45 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-d595320a-cb86-45e8-adec-d306cd0e93c0 tempest-ProjectReaderTests-510915641 None] Deleted volume successfully. Sep 16 20:38:45 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-e5f6b329-d175-48d7-a178-85ac65a954bf tempest-SnapshotDependencyTests-1531567735 None] Acquiring lock "cinder-9aac7519-231e-4085-ae3c-9be2c4b8ce99-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:38:45 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-d595320a-cb86-45e8-adec-d306cd0e93c0 tempest-ProjectReaderTests-510915641 None] Lock "cinder-252af13c-c41b-444b-b282-3b47c70a1938-delete_volume" released by "delete_volume" :: held 1.388s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:38:45 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-e5f6b329-d175-48d7-a178-85ac65a954bf tempest-SnapshotDependencyTests-1531567735 None] Lock "cinder-9aac7519-231e-4085-ae3c-9be2c4b8ce99-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:38:45 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-e5f6b329-d175-48d7-a178-85ac65a954bf tempest-SnapshotDependencyTests-1531567735 None] Acquiring lock "cinder-quobyte-9aac7519-231e-4085-ae3c-9be2c4b8ce99" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:38:45 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-e5f6b329-d175-48d7-a178-85ac65a954bf tempest-SnapshotDependencyTests-1531567735 None] Lock "cinder-quobyte-9aac7519-231e-4085-ae3c-9be2c4b8ce99" acquired by "delete_volume" :: waited 0.022s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:38:46 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[c37a757a-490a-490b-95dd-104050a7c764]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:38:46 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e5f6b329-d175-48d7-a178-85ac65a954bf tempest-SnapshotDependencyTests-1531567735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9aac7519-231e-4085-ae3c-9be2c4b8ce99 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:46 devstack sudo[106510]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:46 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-bd4954ab-5586-4cf4-93e9-c080fff38b68 tempest-ProjectMemberTests-730908627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-27ae9b1f-92ba-4125-b30c-45d099a1226f" returned: 0 in 0.363s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:46 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-bd4954ab-5586-4cf4-93e9-c080fff38b68 tempest-ProjectMemberTests-730908627 None] <== create_volume: return (900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:38:46 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-bd4954ab-5586-4cf4-93e9-c080fff38b68 tempest-ProjectMemberTests-730908627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.904s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:38:46 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-bd4954ab-5586-4cf4-93e9-c080fff38b68 tempest-ProjectMemberTests-730908627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a727e1a-e914-496f-9d6c-507860939424) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27ae9b1f-92ba-4125-b30c-45d099a1226f', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:38:46 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-bd4954ab-5586-4cf4-93e9-c080fff38b68 tempest-ProjectMemberTests-730908627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eff1bc8f-1090-4c2a-b200-c920ef208009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:38:46 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-bd4954ab-5586-4cf4-93e9-c080fff38b68 tempest-ProjectMemberTests-730908627 None] Volume volume-27ae9b1f-92ba-4125-b30c-45d099a1226f (27ae9b1f-92ba-4125-b30c-45d099a1226f): created successfully Sep 16 20:38:46 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-bd4954ab-5586-4cf4-93e9-c080fff38b68 tempest-ProjectMemberTests-730908627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eff1bc8f-1090-4c2a-b200-c920ef208009) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:38:46 devstack sudo[106512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9aac7519-231e-4085-ae3c-9be2c4b8ce99 Sep 16 20:38:46 devstack sudo[106512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:46 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-bd4954ab-5586-4cf4-93e9-c080fff38b68 tempest-ProjectMemberTests-730908627 None] Flow 'volume_create_manager' (4750de96-0c8e-4132-91db-bc4d64818b08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:38:46 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-bd4954ab-5586-4cf4-93e9-c080fff38b68 tempest-ProjectMemberTests-730908627 None] Created volume successfully. Sep 16 20:38:46 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-e31ce2f8-ba7e-431a-882e-b5a214855e10 tempest-ProjectReaderTests-510915641 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:38:46 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e31ce2f8-ba7e-431a-882e-b5a214855e10 tempest-ProjectReaderTests-510915641 None] Flow 'volume_create_manager' (a528e089-2a84-49c3-8843-a3abc9d29527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:38:46 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e31ce2f8-ba7e-431a-882e-b5a214855e10 tempest-ProjectReaderTests-510915641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fcc2dba-ef1a-46f3-b622-b4110365572a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:38:46 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e31ce2f8-ba7e-431a-882e-b5a214855e10 tempest-ProjectReaderTests-510915641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fcc2dba-ef1a-46f3-b622-b4110365572a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:38:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1151589264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15ae3bf4-e94c-4cc8-bb08-480dee4a0aa0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ace9fe7829b4403c94750df5f95439e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:38:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:38:46Z,use_quota=True,user_id='4ac8de8833be4dbfa41217152fa8344d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:38:46 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e31ce2f8-ba7e-431a-882e-b5a214855e10 tempest-ProjectReaderTests-510915641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d34f7ab-0079-4b76-b3e8-c3fd30d07dff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:38:46 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e31ce2f8-ba7e-431a-882e-b5a214855e10 tempest-ProjectReaderTests-510915641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d34f7ab-0079-4b76-b3e8-c3fd30d07dff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:38:46 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e31ce2f8-ba7e-431a-882e-b5a214855e10 tempest-ProjectReaderTests-510915641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2fc99a4-c5d5-43b5-a107-5776f579d067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:38:46 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e31ce2f8-ba7e-431a-882e-b5a214855e10 tempest-ProjectReaderTests-510915641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2fc99a4-c5d5-43b5-a107-5776f579d067) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15ae3bf4-e94c-4cc8-bb08-480dee4a0aa0', 'volume_name': 'volume-15ae3bf4-e94c-4cc8-bb08-480dee4a0aa0', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:38:46 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e31ce2f8-ba7e-431a-882e-b5a214855e10 tempest-ProjectReaderTests-510915641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8aa5968f-c418-4b55-88a4-d327bdf0a552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:38:46 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e31ce2f8-ba7e-431a-882e-b5a214855e10 tempest-ProjectReaderTests-510915641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8aa5968f-c418-4b55-88a4-d327bdf0a552) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:38:46 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e31ce2f8-ba7e-431a-882e-b5a214855e10 tempest-ProjectReaderTests-510915641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a418d73-a3a5-40ca-a24b-2c71ae21ab47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:38:46 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-e31ce2f8-ba7e-431a-882e-b5a214855e10 tempest-ProjectReaderTests-510915641 None] Volume 15ae3bf4-e94c-4cc8-bb08-480dee4a0aa0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15ae3bf4-e94c-4cc8-bb08-480dee4a0aa0', 'volume_size': 1} Sep 16 20:38:46 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-e31ce2f8-ba7e-431a-882e-b5a214855e10 tempest-ProjectReaderTests-510915641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:38:46 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-e31ce2f8-ba7e-431a-882e-b5a214855e10 tempest-ProjectReaderTests-510915641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:38:46 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-e31ce2f8-ba7e-431a-882e-b5a214855e10 tempest-ProjectReaderTests-510915641 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:38:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1151589264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15ae3bf4-e94c-4cc8-bb08-480dee4a0aa0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ace9fe7829b4403c94750df5f95439e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:38:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:38:46Z,use_quota=True,user_id='4ac8de8833be4dbfa41217152fa8344d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:38:46 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-e31ce2f8-ba7e-431a-882e-b5a214855e10 tempest-ProjectReaderTests-510915641 None] Creating volume 15ae3bf4-e94c-4cc8-bb08-480dee4a0aa0 {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:38:46 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-e31ce2f8-ba7e-431a-882e-b5a214855e10 tempest-ProjectReaderTests-510915641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:38:46 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-e31ce2f8-ba7e-431a-882e-b5a214855e10 tempest-ProjectReaderTests-510915641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:38:46 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-e31ce2f8-ba7e-431a-882e-b5a214855e10 tempest-ProjectReaderTests-510915641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:38:46 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-e31ce2f8-ba7e-431a-882e-b5a214855e10 tempest-ProjectReaderTests-510915641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:38:46 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-e31ce2f8-ba7e-431a-882e-b5a214855e10 tempest-ProjectReaderTests-510915641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:38:46 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-e31ce2f8-ba7e-431a-882e-b5a214855e10 tempest-ProjectReaderTests-510915641 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:38:46 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-e31ce2f8-ba7e-431a-882e-b5a214855e10 tempest-ProjectReaderTests-510915641 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:38:46 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e31ce2f8-ba7e-431a-882e-b5a214855e10 tempest-ProjectReaderTests-510915641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-15ae3bf4-e94c-4cc8-bb08-480dee4a0aa0 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:46 devstack sudo[106515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-15ae3bf4-e94c-4cc8-bb08-480dee4a0aa0 1073741824 Sep 16 20:38:46 devstack sudo[106515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:46 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-fd6358ec-3d0d-4a39-b02c-63d31912054e tempest-ProjectReaderTests-2105386862 None] Acquiring lock "cinder-171cefea-9d10-4730-aa6b-fceb4b780f60-delete_snapshot" by "delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:38:46 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-fd6358ec-3d0d-4a39-b02c-63d31912054e tempest-ProjectReaderTests-2105386862 None] Lock "cinder-171cefea-9d10-4730-aa6b-fceb4b780f60-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:38:46 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-fd6358ec-3d0d-4a39-b02c-63d31912054e tempest-ProjectReaderTests-2105386862 None] Acquiring lock "cinder-quobyte-0c6e77a8-2bb7-452d-8971-04a61b30b3ed" by "delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:38:46 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-fd6358ec-3d0d-4a39-b02c-63d31912054e tempest-ProjectReaderTests-2105386862 None] Lock "cinder-quobyte-0c6e77a8-2bb7-452d-8971-04a61b30b3ed" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:38:46 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-fd6358ec-3d0d-4a39-b02c-63d31912054e tempest-ProjectReaderTests-2105386862 None] Acquiring lock "cinder-quobyte-171cefea-9d10-4730-aa6b-fceb4b780f60" by "_delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:38:46 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-fd6358ec-3d0d-4a39-b02c-63d31912054e tempest-ProjectReaderTests-2105386862 None] Lock "cinder-quobyte-171cefea-9d10-4730-aa6b-fceb4b780f60" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:38:46 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-fd6358ec-3d0d-4a39-b02c-63d31912054e tempest-ProjectReaderTests-2105386862 None] Deleting offline snapshot 171cefea-9d10-4730-aa6b-fceb4b780f60 of volume 0c6e77a8-2bb7-452d-8971-04a61b30b3ed {{(pid=86188) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 20:38:46 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-fd6358ec-3d0d-4a39-b02c-63d31912054e tempest-ProjectReaderTests-2105386862 None] snapshot_file for this snap is: volume-0c6e77a8-2bb7-452d-8971-04a61b30b3ed.171cefea-9d10-4730-aa6b-fceb4b780f60 {{(pid=86188) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 20:38:46 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f96cc8a-81d1-4ef4-a096-39ba2be768d9]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:38:46 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-fd6358ec-3d0d-4a39-b02c-63d31912054e tempest-ProjectReaderTests-2105386862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-0c6e77a8-2bb7-452d-8971-04a61b30b3ed.171cefea-9d10-4730-aa6b-fceb4b780f60 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:46 devstack sudo[106512]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:46 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e5f6b329-d175-48d7-a178-85ac65a954bf tempest-SnapshotDependencyTests-1531567735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9aac7519-231e-4085-ae3c-9be2c4b8ce99" returned: 0 in 0.473s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:46 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e5f6b329-d175-48d7-a178-85ac65a954bf tempest-SnapshotDependencyTests-1531567735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9aac7519-231e-4085-ae3c-9be2c4b8ce99 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:46 devstack sudo[106521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9aac7519-231e-4085-ae3c-9be2c4b8ce99 Sep 16 20:38:46 devstack sudo[106521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:46 devstack sudo[106520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-0c6e77a8-2bb7-452d-8971-04a61b30b3ed.171cefea-9d10-4730-aa6b-fceb4b780f60 Sep 16 20:38:46 devstack sudo[106520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:46 devstack sudo[106515]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:46 devstack sudo[106521]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:46 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e31ce2f8-ba7e-431a-882e-b5a214855e10 tempest-ProjectReaderTests-510915641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-15ae3bf4-e94c-4cc8-bb08-480dee4a0aa0 1073741824" returned: 0 in 0.461s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:46 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e5f6b329-d175-48d7-a178-85ac65a954bf tempest-SnapshotDependencyTests-1531567735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-9aac7519-231e-4085-ae3c-9be2c4b8ce99" returned: 0 in 0.290s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:46 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-e5f6b329-d175-48d7-a178-85ac65a954bf tempest-SnapshotDependencyTests-1531567735 None] Lock "cinder-quobyte-9aac7519-231e-4085-ae3c-9be2c4b8ce99" released by "delete_volume" :: held 0.853s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:38:46 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e31ce2f8-ba7e-431a-882e-b5a214855e10 tempest-ProjectReaderTests-510915641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-15ae3bf4-e94c-4cc8-bb08-480dee4a0aa0 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:46 devstack sudo[106531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-15ae3bf4-e94c-4cc8-bb08-480dee4a0aa0 Sep 16 20:38:46 devstack sudo[106531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:46 devstack sudo[106520]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:46 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-fd6358ec-3d0d-4a39-b02c-63d31912054e tempest-ProjectReaderTests-2105386862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-0c6e77a8-2bb7-452d-8971-04a61b30b3ed.171cefea-9d10-4730-aa6b-fceb4b780f60" returned: 0 in 0.414s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:46 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-fd6358ec-3d0d-4a39-b02c-63d31912054e tempest-ProjectReaderTests-2105386862 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0c6e77a8-2bb7-452d-8971-04a61b30b3ed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86188) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 20:38:46 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-e5f6b329-d175-48d7-a178-85ac65a954bf tempest-SnapshotDependencyTests-1531567735 None] Created reservations ['dce74356-8f6b-4785-aa70-c8b637918922', 'f98380cd-a52c-49a9-b519-ea487406177d', '82b42e4e-81cd-4b31-97cc-833aebc1519b', '0779e5e8-3d7b-484d-b6f3-d74eaa2fd67b'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:38:46 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd55c7bf-a2af-497d-975d-646933a9942c]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:38:46 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-fd6358ec-3d0d-4a39-b02c-63d31912054e tempest-ProjectReaderTests-2105386862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-0c6e77a8-2bb7-452d-8971-04a61b30b3ed {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:47 devstack sudo[106533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-0c6e77a8-2bb7-452d-8971-04a61b30b3ed Sep 16 20:38:47 devstack sudo[106533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:47 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-e5f6b329-d175-48d7-a178-85ac65a954bf tempest-SnapshotDependencyTests-1531567735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:38:47 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-e5f6b329-d175-48d7-a178-85ac65a954bf tempest-SnapshotDependencyTests-1531567735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:38:47 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-e5f6b329-d175-48d7-a178-85ac65a954bf tempest-SnapshotDependencyTests-1531567735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:38:47 devstack sudo[106531]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:47 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-e5f6b329-d175-48d7-a178-85ac65a954bf tempest-SnapshotDependencyTests-1531567735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:38:47 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-e5f6b329-d175-48d7-a178-85ac65a954bf tempest-SnapshotDependencyTests-1531567735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:38:47 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e5f6b329-d175-48d7-a178-85ac65a954bf tempest-SnapshotDependencyTests-1531567735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:47 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e31ce2f8-ba7e-431a-882e-b5a214855e10 tempest-ProjectReaderTests-510915641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-15ae3bf4-e94c-4cc8-bb08-480dee4a0aa0" returned: 0 in 0.295s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:47 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-e31ce2f8-ba7e-431a-882e-b5a214855e10 tempest-ProjectReaderTests-510915641 None] <== create_volume: return (822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:38:47 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-e31ce2f8-ba7e-431a-882e-b5a214855e10 tempest-ProjectReaderTests-510915641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.825s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:38:47 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e31ce2f8-ba7e-431a-882e-b5a214855e10 tempest-ProjectReaderTests-510915641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a418d73-a3a5-40ca-a24b-2c71ae21ab47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15ae3bf4-e94c-4cc8-bb08-480dee4a0aa0', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:38:47 devstack sudo[106536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:38:47 devstack sudo[106536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:47 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e31ce2f8-ba7e-431a-882e-b5a214855e10 tempest-ProjectReaderTests-510915641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (910ba772-dfd8-4b2f-85c2-ec9a452b73fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:38:47 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-e31ce2f8-ba7e-431a-882e-b5a214855e10 tempest-ProjectReaderTests-510915641 None] Volume volume-15ae3bf4-e94c-4cc8-bb08-480dee4a0aa0 (15ae3bf4-e94c-4cc8-bb08-480dee4a0aa0): created successfully Sep 16 20:38:47 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e31ce2f8-ba7e-431a-882e-b5a214855e10 tempest-ProjectReaderTests-510915641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (910ba772-dfd8-4b2f-85c2-ec9a452b73fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:38:47 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-e31ce2f8-ba7e-431a-882e-b5a214855e10 tempest-ProjectReaderTests-510915641 None] Flow 'volume_create_manager' (a528e089-2a84-49c3-8843-a3abc9d29527) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:38:47 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-e31ce2f8-ba7e-431a-882e-b5a214855e10 tempest-ProjectReaderTests-510915641 None] Created volume successfully. Sep 16 20:38:47 devstack sudo[106533]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:47 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-fd6358ec-3d0d-4a39-b02c-63d31912054e tempest-ProjectReaderTests-2105386862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-0c6e77a8-2bb7-452d-8971-04a61b30b3ed" returned: 0 in 0.454s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:47 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-fd6358ec-3d0d-4a39-b02c-63d31912054e tempest-ProjectReaderTests-2105386862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-0c6e77a8-2bb7-452d-8971-04a61b30b3ed.171cefea-9d10-4730-aa6b-fceb4b780f60 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:47 devstack sudo[106542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-0c6e77a8-2bb7-452d-8971-04a61b30b3ed.171cefea-9d10-4730-aa6b-fceb4b780f60 Sep 16 20:38:47 devstack sudo[106542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:47 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-437ff5e0-02ee-4d62-9a25-ade0f4690aae tempest-ProjectMemberTests-730908627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:38:47 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-437ff5e0-02ee-4d62-9a25-ade0f4690aae tempest-ProjectMemberTests-730908627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:38:47 devstack sudo[106536]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:47 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e5f6b329-d175-48d7-a178-85ac65a954bf tempest-SnapshotDependencyTests-1531567735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.345s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:47 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-e5f6b329-d175-48d7-a178-85ac65a954bf tempest-SnapshotDependencyTests-1531567735 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:38:47 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-437ff5e0-02ee-4d62-9a25-ade0f4690aae tempest-ProjectMemberTests-730908627 None] Creating offline snapshot c6582a48-b1ac-42c9-9164-ad3034d642cb of volume 27ae9b1f-92ba-4125-b30c-45d099a1226f {{(pid=86188) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 20:38:47 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-e5f6b329-d175-48d7-a178-85ac65a954bf tempest-SnapshotDependencyTests-1531567735 None] Deleted volume successfully. Sep 16 20:38:47 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[5543e806-a4c0-4a71-9a19-21011ea7c8c9]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:38:47 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-437ff5e0-02ee-4d62-9a25-ade0f4690aae tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-27ae9b1f-92ba-4125-b30c-45d099a1226f {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:47 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-e5f6b329-d175-48d7-a178-85ac65a954bf tempest-SnapshotDependencyTests-1531567735 None] Lock "cinder-9aac7519-231e-4085-ae3c-9be2c4b8ce99-delete_volume" released by "delete_volume" :: held 1.625s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:38:47 devstack sudo[106545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-27ae9b1f-92ba-4125-b30c-45d099a1226f Sep 16 20:38:47 devstack sudo[106545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:47 devstack sudo[106542]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:47 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-fd6358ec-3d0d-4a39-b02c-63d31912054e tempest-ProjectReaderTests-2105386862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-0c6e77a8-2bb7-452d-8971-04a61b30b3ed.171cefea-9d10-4730-aa6b-fceb4b780f60" returned: 0 in 0.357s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:47 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-fd6358ec-3d0d-4a39-b02c-63d31912054e tempest-ProjectReaderTests-2105386862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-0c6e77a8-2bb7-452d-8971-04a61b30b3ed.171cefea-9d10-4730-aa6b-fceb4b780f60 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:47 devstack sudo[106550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-0c6e77a8-2bb7-452d-8971-04a61b30b3ed.171cefea-9d10-4730-aa6b-fceb4b780f60 Sep 16 20:38:47 devstack sudo[106550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:47 devstack sudo[106545]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:47 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-437ff5e0-02ee-4d62-9a25-ade0f4690aae tempest-ProjectMemberTests-730908627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-27ae9b1f-92ba-4125-b30c-45d099a1226f" returned: 0 in 0.378s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:47 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-437ff5e0-02ee-4d62-9a25-ade0f4690aae tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-27ae9b1f-92ba-4125-b30c-45d099a1226f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-27ae9b1f-92ba-4125-b30c-45d099a1226f.c6582a48-b1ac-42c9-9164-ad3034d642cb 1G {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:47 devstack sudo[106555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-27ae9b1f-92ba-4125-b30c-45d099a1226f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-27ae9b1f-92ba-4125-b30c-45d099a1226f.c6582a48-b1ac-42c9-9164-ad3034d642cb 1G Sep 16 20:38:47 devstack sudo[106555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:48 devstack sudo[106550]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:48 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-fd6358ec-3d0d-4a39-b02c-63d31912054e tempest-ProjectReaderTests-2105386862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-0c6e77a8-2bb7-452d-8971-04a61b30b3ed.171cefea-9d10-4730-aa6b-fceb4b780f60" returned: 0 in 0.277s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:48 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-fd6358ec-3d0d-4a39-b02c-63d31912054e tempest-ProjectReaderTests-2105386862 None] Lock "cinder-quobyte-171cefea-9d10-4730-aa6b-fceb4b780f60" released by "_delete_snapshot" :: held 1.630s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:38:48 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-fd6358ec-3d0d-4a39-b02c-63d31912054e tempest-ProjectReaderTests-2105386862 None] Lock "cinder-quobyte-0c6e77a8-2bb7-452d-8971-04a61b30b3ed" released by "delete_snapshot" :: held 1.666s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:38:48 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-db6f0173-bf58-436a-935d-f41d1990fdf5 tempest-SnapshotDependencyTests-1531567735 None] Acquiring lock "cinder-15f07f55-281d-433b-a25c-9537ab625863-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:38:48 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-db6f0173-bf58-436a-935d-f41d1990fdf5 tempest-SnapshotDependencyTests-1531567735 None] Lock "cinder-15f07f55-281d-433b-a25c-9537ab625863-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:38:48 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-db6f0173-bf58-436a-935d-f41d1990fdf5 tempest-SnapshotDependencyTests-1531567735 None] Acquiring lock "cinder-quobyte-15f07f55-281d-433b-a25c-9537ab625863" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:38:48 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-fd6358ec-3d0d-4a39-b02c-63d31912054e tempest-ProjectReaderTests-2105386862 None] Created reservations ['4fa41ead-d2f7-4a60-aa18-cc20e7d8e517', '0ebe16dc-fb42-4e32-81d3-61db27fe4940', '1232e920-d6be-4daa-a020-0bc000c1bc0b', 'a0c82ca2-98be-441e-8261-ebb588e158ff'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:38:48 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-db6f0173-bf58-436a-935d-f41d1990fdf5 tempest-SnapshotDependencyTests-1531567735 None] Lock "cinder-quobyte-15f07f55-281d-433b-a25c-9537ab625863" acquired by "delete_volume" :: waited 0.025s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:38:48 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d24a231-a321-43a0-8a34-891fb43b8996]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:38:48 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-db6f0173-bf58-436a-935d-f41d1990fdf5 tempest-SnapshotDependencyTests-1531567735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-15f07f55-281d-433b-a25c-9537ab625863 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:48 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-fd6358ec-3d0d-4a39-b02c-63d31912054e tempest-ProjectReaderTests-2105386862 None] Delete snapshot completed successfully. Sep 16 20:38:48 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-fd6358ec-3d0d-4a39-b02c-63d31912054e tempest-ProjectReaderTests-2105386862 None] Lock "cinder-171cefea-9d10-4730-aa6b-fceb4b780f60-delete_snapshot" released by "delete_snapshot" :: held 1.902s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:38:48 devstack sudo[106561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-15f07f55-281d-433b-a25c-9537ab625863 Sep 16 20:38:48 devstack sudo[106561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:48 devstack sudo[106555]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:48 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-437ff5e0-02ee-4d62-9a25-ade0f4690aae tempest-ProjectMemberTests-730908627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-27ae9b1f-92ba-4125-b30c-45d099a1226f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-27ae9b1f-92ba-4125-b30c-45d099a1226f.c6582a48-b1ac-42c9-9164-ad3034d642cb 1G" returned: 0 in 0.496s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:48 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-437ff5e0-02ee-4d62-9a25-ade0f4690aae tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27ae9b1f-92ba-4125-b30c-45d099a1226f -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-27ae9b1f-92ba-4125-b30c-45d099a1226f.c6582a48-b1ac-42c9-9164-ad3034d642cb {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:48 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-74b63dfc-7e09-4e4a-bbef-a33cdeea421e tempest-ProjectReaderTests-510915641 None] Acquiring lock "cinder-15ae3bf4-e94c-4cc8-bb08-480dee4a0aa0-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:38:48 devstack sudo[106563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27ae9b1f-92ba-4125-b30c-45d099a1226f -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-27ae9b1f-92ba-4125-b30c-45d099a1226f.c6582a48-b1ac-42c9-9164-ad3034d642cb Sep 16 20:38:48 devstack sudo[106563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:48 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-74b63dfc-7e09-4e4a-bbef-a33cdeea421e tempest-ProjectReaderTests-510915641 None] Lock "cinder-15ae3bf4-e94c-4cc8-bb08-480dee4a0aa0-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:38:48 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-74b63dfc-7e09-4e4a-bbef-a33cdeea421e tempest-ProjectReaderTests-510915641 None] Acquiring lock "cinder-quobyte-15ae3bf4-e94c-4cc8-bb08-480dee4a0aa0" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:38:48 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-74b63dfc-7e09-4e4a-bbef-a33cdeea421e tempest-ProjectReaderTests-510915641 None] Lock "cinder-quobyte-15ae3bf4-e94c-4cc8-bb08-480dee4a0aa0" acquired by "delete_volume" :: waited 0.024s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:38:48 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[3010b3f6-0a13-4955-9d2c-d2b0fd344dfe]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:38:48 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-74b63dfc-7e09-4e4a-bbef-a33cdeea421e tempest-ProjectReaderTests-510915641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-15ae3bf4-e94c-4cc8-bb08-480dee4a0aa0 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:48 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-040ff64d-315c-4c09-b0da-8c6a16ab7767 tempest-ProjectReaderTests-2105386862 None] Acquiring lock "cinder-0c6e77a8-2bb7-452d-8971-04a61b30b3ed-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:38:48 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-040ff64d-315c-4c09-b0da-8c6a16ab7767 tempest-ProjectReaderTests-2105386862 None] Lock "cinder-0c6e77a8-2bb7-452d-8971-04a61b30b3ed-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:38:48 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-040ff64d-315c-4c09-b0da-8c6a16ab7767 tempest-ProjectReaderTests-2105386862 None] Acquiring lock "cinder-quobyte-0c6e77a8-2bb7-452d-8971-04a61b30b3ed" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:38:48 devstack sudo[106565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-15ae3bf4-e94c-4cc8-bb08-480dee4a0aa0 Sep 16 20:38:48 devstack sudo[106565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:48 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-040ff64d-315c-4c09-b0da-8c6a16ab7767 tempest-ProjectReaderTests-2105386862 None] Lock "cinder-quobyte-0c6e77a8-2bb7-452d-8971-04a61b30b3ed" acquired by "delete_volume" :: waited 0.022s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:38:48 devstack sudo[106561]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:48 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-db6f0173-bf58-436a-935d-f41d1990fdf5 tempest-SnapshotDependencyTests-1531567735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-15f07f55-281d-433b-a25c-9537ab625863" returned: 0 in 0.511s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:48 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-db6f0173-bf58-436a-935d-f41d1990fdf5 tempest-SnapshotDependencyTests-1531567735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-15f07f55-281d-433b-a25c-9537ab625863 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:48 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[a65caaa8-64b4-4e16-a64a-43625f281264]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:38:48 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-040ff64d-315c-4c09-b0da-8c6a16ab7767 tempest-ProjectReaderTests-2105386862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-0c6e77a8-2bb7-452d-8971-04a61b30b3ed {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:48 devstack sudo[106563]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:48 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-437ff5e0-02ee-4d62-9a25-ade0f4690aae tempest-ProjectMemberTests-730908627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27ae9b1f-92ba-4125-b30c-45d099a1226f -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-27ae9b1f-92ba-4125-b30c-45d099a1226f.c6582a48-b1ac-42c9-9164-ad3034d642cb" returned: 0 in 0.392s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:48 devstack sudo[106573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-15f07f55-281d-433b-a25c-9537ab625863 Sep 16 20:38:48 devstack sudo[106573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:48 devstack cinder-volume[86188]: WARNING cinder.volume.drivers.remotefs [None req-437ff5e0-02ee-4d62-9a25-ade0f4690aae tempest-ProjectMemberTests-730908627 None] /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-27ae9b1f-92ba-4125-b30c-45d099a1226f.c6582a48-b1ac-42c9-9164-ad3034d642cb is being set with open permissions: ugo+rw Sep 16 20:38:48 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-437ff5e0-02ee-4d62-9a25-ade0f4690aae tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-27ae9b1f-92ba-4125-b30c-45d099a1226f.c6582a48-b1ac-42c9-9164-ad3034d642cb {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:48 devstack sudo[106576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-27ae9b1f-92ba-4125-b30c-45d099a1226f.c6582a48-b1ac-42c9-9164-ad3034d642cb Sep 16 20:38:48 devstack sudo[106576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:48 devstack sudo[106574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-0c6e77a8-2bb7-452d-8971-04a61b30b3ed Sep 16 20:38:48 devstack sudo[106574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:49 devstack sudo[106565]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:49 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-74b63dfc-7e09-4e4a-bbef-a33cdeea421e tempest-ProjectReaderTests-510915641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-15ae3bf4-e94c-4cc8-bb08-480dee4a0aa0" returned: 0 in 0.472s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:49 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-74b63dfc-7e09-4e4a-bbef-a33cdeea421e tempest-ProjectReaderTests-510915641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-15ae3bf4-e94c-4cc8-bb08-480dee4a0aa0 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:49 devstack sudo[106573]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:49 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-db6f0173-bf58-436a-935d-f41d1990fdf5 tempest-SnapshotDependencyTests-1531567735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-15f07f55-281d-433b-a25c-9537ab625863" returned: 0 in 0.291s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:49 devstack sudo[106576]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:49 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-db6f0173-bf58-436a-935d-f41d1990fdf5 tempest-SnapshotDependencyTests-1531567735 None] Lock "cinder-quobyte-15f07f55-281d-433b-a25c-9537ab625863" released by "delete_volume" :: held 0.860s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:38:49 devstack sudo[106584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-15ae3bf4-e94c-4cc8-bb08-480dee4a0aa0 Sep 16 20:38:49 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-437ff5e0-02ee-4d62-9a25-ade0f4690aae tempest-ProjectMemberTests-730908627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-27ae9b1f-92ba-4125-b30c-45d099a1226f.c6582a48-b1ac-42c9-9164-ad3034d642cb" returned: 0 in 0.283s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:49 devstack sudo[106584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:49 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-437ff5e0-02ee-4d62-9a25-ade0f4690aae tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-27ae9b1f-92ba-4125-b30c-45d099a1226f.info {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:49 devstack sudo[106588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-27ae9b1f-92ba-4125-b30c-45d099a1226f.info Sep 16 20:38:49 devstack sudo[106588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:49 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-db6f0173-bf58-436a-935d-f41d1990fdf5 tempest-SnapshotDependencyTests-1531567735 None] Created reservations ['0b1d63c1-fd65-4ec8-8902-8b1cbbeafcdf', 'fdd91e3e-9454-4936-bf58-55b0c009ad93', '6ad70058-9871-4e73-ad25-dd024cfa5ada', 'fc539cfd-b541-455d-b0f5-33a5d64d6ae8'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:38:49 devstack sudo[106574]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:49 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-040ff64d-315c-4c09-b0da-8c6a16ab7767 tempest-ProjectReaderTests-2105386862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-0c6e77a8-2bb7-452d-8971-04a61b30b3ed" returned: 0 in 0.395s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:49 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-040ff64d-315c-4c09-b0da-8c6a16ab7767 tempest-ProjectReaderTests-2105386862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-0c6e77a8-2bb7-452d-8971-04a61b30b3ed {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:49 devstack sudo[106592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-0c6e77a8-2bb7-452d-8971-04a61b30b3ed Sep 16 20:38:49 devstack sudo[106592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:49 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-db6f0173-bf58-436a-935d-f41d1990fdf5 tempest-SnapshotDependencyTests-1531567735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:38:49 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-db6f0173-bf58-436a-935d-f41d1990fdf5 tempest-SnapshotDependencyTests-1531567735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:38:49 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-db6f0173-bf58-436a-935d-f41d1990fdf5 tempest-SnapshotDependencyTests-1531567735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:38:49 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-db6f0173-bf58-436a-935d-f41d1990fdf5 tempest-SnapshotDependencyTests-1531567735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:38:49 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-db6f0173-bf58-436a-935d-f41d1990fdf5 tempest-SnapshotDependencyTests-1531567735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:38:49 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-db6f0173-bf58-436a-935d-f41d1990fdf5 tempest-SnapshotDependencyTests-1531567735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:49 devstack sudo[106595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:38:49 devstack sudo[106595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:49 devstack sudo[106584]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:49 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-74b63dfc-7e09-4e4a-bbef-a33cdeea421e tempest-ProjectReaderTests-510915641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-15ae3bf4-e94c-4cc8-bb08-480dee4a0aa0" returned: 0 in 0.332s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:49 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-74b63dfc-7e09-4e4a-bbef-a33cdeea421e tempest-ProjectReaderTests-510915641 None] Lock "cinder-quobyte-15ae3bf4-e94c-4cc8-bb08-480dee4a0aa0" released by "delete_volume" :: held 0.874s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:38:49 devstack sudo[106588]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:49 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-437ff5e0-02ee-4d62-9a25-ade0f4690aae tempest-ProjectMemberTests-730908627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-27ae9b1f-92ba-4125-b30c-45d099a1226f.info" returned: 0 in 0.339s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:49 devstack cinder-volume[86188]: WARNING cinder.volume.drivers.remotefs [None req-437ff5e0-02ee-4d62-9a25-ade0f4690aae tempest-ProjectMemberTests-730908627 None] /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-27ae9b1f-92ba-4125-b30c-45d099a1226f.info is being set with open permissions: ugo+rw Sep 16 20:38:49 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-437ff5e0-02ee-4d62-9a25-ade0f4690aae tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-27ae9b1f-92ba-4125-b30c-45d099a1226f.info {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:49 devstack sudo[106599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-27ae9b1f-92ba-4125-b30c-45d099a1226f.info Sep 16 20:38:49 devstack sudo[106599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:49 devstack sudo[106592]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:49 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-040ff64d-315c-4c09-b0da-8c6a16ab7767 tempest-ProjectReaderTests-2105386862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-0c6e77a8-2bb7-452d-8971-04a61b30b3ed" returned: 0 in 0.348s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:49 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-040ff64d-315c-4c09-b0da-8c6a16ab7767 tempest-ProjectReaderTests-2105386862 None] Lock "cinder-quobyte-0c6e77a8-2bb7-452d-8971-04a61b30b3ed" released by "delete_volume" :: held 0.835s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:38:49 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-74b63dfc-7e09-4e4a-bbef-a33cdeea421e tempest-ProjectReaderTests-510915641 None] Created reservations ['a4338614-1e52-4b75-ba64-50e7c450b83c', '270cd807-5cef-467b-a1ae-b3241489f14a', 'bbbcbf3e-fff6-46ed-9fe4-db5c8db5477f', '3cbc53f3-c690-43a1-807d-4d91c0606cf5'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:38:49 devstack sudo[106595]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:49 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-db6f0173-bf58-436a-935d-f41d1990fdf5 tempest-SnapshotDependencyTests-1531567735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.336s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:49 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-db6f0173-bf58-436a-935d-f41d1990fdf5 tempest-SnapshotDependencyTests-1531567735 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:38:49 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-db6f0173-bf58-436a-935d-f41d1990fdf5 tempest-SnapshotDependencyTests-1531567735 None] Deleted volume successfully. Sep 16 20:38:49 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-040ff64d-315c-4c09-b0da-8c6a16ab7767 tempest-ProjectReaderTests-2105386862 None] Created reservations ['c93171bf-7506-441d-95a8-53eeb2b65811', '2f5fd331-7265-478d-83ac-154f011d610a', '1d3a4358-e240-4dd2-aa02-83f36f149593', '3d9079e5-8ef3-4abf-a2f7-25e4313658f2'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:38:49 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-db6f0173-bf58-436a-935d-f41d1990fdf5 tempest-SnapshotDependencyTests-1531567735 None] Lock "cinder-15f07f55-281d-433b-a25c-9537ab625863-delete_volume" released by "delete_volume" :: held 1.531s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:38:49 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-74b63dfc-7e09-4e4a-bbef-a33cdeea421e tempest-ProjectReaderTests-510915641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:38:49 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-74b63dfc-7e09-4e4a-bbef-a33cdeea421e tempest-ProjectReaderTests-510915641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:38:49 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-74b63dfc-7e09-4e4a-bbef-a33cdeea421e tempest-ProjectReaderTests-510915641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:38:49 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-74b63dfc-7e09-4e4a-bbef-a33cdeea421e tempest-ProjectReaderTests-510915641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:38:49 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-74b63dfc-7e09-4e4a-bbef-a33cdeea421e tempest-ProjectReaderTests-510915641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:38:49 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-74b63dfc-7e09-4e4a-bbef-a33cdeea421e tempest-ProjectReaderTests-510915641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:49 devstack sudo[106603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:38:49 devstack sudo[106603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:49 devstack sudo[106599]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:49 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-437ff5e0-02ee-4d62-9a25-ade0f4690aae tempest-ProjectMemberTests-730908627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-27ae9b1f-92ba-4125-b30c-45d099a1226f.info" returned: 0 in 0.347s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:49 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-437ff5e0-02ee-4d62-9a25-ade0f4690aae tempest-ProjectMemberTests-730908627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.352s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:38:49 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-040ff64d-315c-4c09-b0da-8c6a16ab7767 tempest-ProjectReaderTests-2105386862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:38:49 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-040ff64d-315c-4c09-b0da-8c6a16ab7767 tempest-ProjectReaderTests-2105386862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:38:49 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-040ff64d-315c-4c09-b0da-8c6a16ab7767 tempest-ProjectReaderTests-2105386862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:38:49 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-040ff64d-315c-4c09-b0da-8c6a16ab7767 tempest-ProjectReaderTests-2105386862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:38:49 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-040ff64d-315c-4c09-b0da-8c6a16ab7767 tempest-ProjectReaderTests-2105386862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:38:49 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-040ff64d-315c-4c09-b0da-8c6a16ab7767 tempest-ProjectReaderTests-2105386862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:49 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-437ff5e0-02ee-4d62-9a25-ade0f4690aae tempest-ProjectMemberTests-730908627 None] Create snapshot completed successfully Sep 16 20:38:49 devstack sudo[106606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:38:49 devstack sudo[106606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:50 devstack sudo[106603]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:50 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-74b63dfc-7e09-4e4a-bbef-a33cdeea421e tempest-ProjectReaderTests-510915641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.342s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:50 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-74b63dfc-7e09-4e4a-bbef-a33cdeea421e tempest-ProjectReaderTests-510915641 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:38:50 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-74b63dfc-7e09-4e4a-bbef-a33cdeea421e tempest-ProjectReaderTests-510915641 None] Deleted volume successfully. Sep 16 20:38:50 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-74b63dfc-7e09-4e4a-bbef-a33cdeea421e tempest-ProjectReaderTests-510915641 None] Lock "cinder-15ae3bf4-e94c-4cc8-bb08-480dee4a0aa0-delete_volume" released by "delete_volume" :: held 1.656s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:38:50 devstack sudo[106606]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:50 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-040ff64d-315c-4c09-b0da-8c6a16ab7767 tempest-ProjectReaderTests-2105386862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.415s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:50 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-040ff64d-315c-4c09-b0da-8c6a16ab7767 tempest-ProjectReaderTests-2105386862 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:38:50 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-040ff64d-315c-4c09-b0da-8c6a16ab7767 tempest-ProjectReaderTests-2105386862 None] Deleted volume successfully. Sep 16 20:38:50 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-040ff64d-315c-4c09-b0da-8c6a16ab7767 tempest-ProjectReaderTests-2105386862 None] Lock "cinder-0c6e77a8-2bb7-452d-8971-04a61b30b3ed-delete_volume" released by "delete_volume" :: held 1.673s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:38:50 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-d28ca3e6-9aa8-423a-aa69-6dc237e23b7a tempest-ProjectReaderTests-2105386862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:38:50 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-d28ca3e6-9aa8-423a-aa69-6dc237e23b7a tempest-ProjectReaderTests-2105386862 None] Flow 'volume_create_manager' (813557fd-773b-43c3-bba3-f394a235741a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:38:50 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-d28ca3e6-9aa8-423a-aa69-6dc237e23b7a tempest-ProjectReaderTests-2105386862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29704085-c8f0-4ee0-b2bd-99867c996b9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:38:50 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-d28ca3e6-9aa8-423a-aa69-6dc237e23b7a tempest-ProjectReaderTests-2105386862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29704085-c8f0-4ee0-b2bd-99867c996b9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:38:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-393270879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b659560-485c-4a1a-bd7b-e965d2e2227d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a1b5c8e359a4d699325f3e4049d8c93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:38:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:38:50Z,use_quota=True,user_id='af893a5c2de74fa596654573d674555d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:38:50 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-d28ca3e6-9aa8-423a-aa69-6dc237e23b7a tempest-ProjectReaderTests-2105386862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7b12f39-2fac-4235-864d-1d10177dc102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:38:50 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-d28ca3e6-9aa8-423a-aa69-6dc237e23b7a tempest-ProjectReaderTests-2105386862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7b12f39-2fac-4235-864d-1d10177dc102) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:38:50 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-d28ca3e6-9aa8-423a-aa69-6dc237e23b7a tempest-ProjectReaderTests-2105386862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f6cbbbe-17ef-425a-9177-7bbdbea28ec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:38:50 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-d28ca3e6-9aa8-423a-aa69-6dc237e23b7a tempest-ProjectReaderTests-2105386862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f6cbbbe-17ef-425a-9177-7bbdbea28ec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b659560-485c-4a1a-bd7b-e965d2e2227d', 'volume_name': 'volume-6b659560-485c-4a1a-bd7b-e965d2e2227d', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:38:50 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-d28ca3e6-9aa8-423a-aa69-6dc237e23b7a tempest-ProjectReaderTests-2105386862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f273ec77-0904-4275-a32a-4b7a203f85e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:38:50 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-d28ca3e6-9aa8-423a-aa69-6dc237e23b7a tempest-ProjectReaderTests-2105386862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f273ec77-0904-4275-a32a-4b7a203f85e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:38:50 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-d28ca3e6-9aa8-423a-aa69-6dc237e23b7a tempest-ProjectReaderTests-2105386862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ef3090b-295c-4b5a-9aac-49fe7f56005d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:38:50 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-d28ca3e6-9aa8-423a-aa69-6dc237e23b7a tempest-ProjectReaderTests-2105386862 None] Volume 6b659560-485c-4a1a-bd7b-e965d2e2227d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b659560-485c-4a1a-bd7b-e965d2e2227d', 'volume_size': 1} Sep 16 20:38:50 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-d28ca3e6-9aa8-423a-aa69-6dc237e23b7a tempest-ProjectReaderTests-2105386862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:38:50 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-d28ca3e6-9aa8-423a-aa69-6dc237e23b7a tempest-ProjectReaderTests-2105386862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:38:50 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-d28ca3e6-9aa8-423a-aa69-6dc237e23b7a tempest-ProjectReaderTests-2105386862 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:38:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-393270879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b659560-485c-4a1a-bd7b-e965d2e2227d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a1b5c8e359a4d699325f3e4049d8c93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:38:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:38:50Z,use_quota=True,user_id='af893a5c2de74fa596654573d674555d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:38:50 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-d28ca3e6-9aa8-423a-aa69-6dc237e23b7a tempest-ProjectReaderTests-2105386862 None] Creating volume 6b659560-485c-4a1a-bd7b-e965d2e2227d {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:38:50 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-d28ca3e6-9aa8-423a-aa69-6dc237e23b7a tempest-ProjectReaderTests-2105386862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:38:50 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-d28ca3e6-9aa8-423a-aa69-6dc237e23b7a tempest-ProjectReaderTests-2105386862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:38:50 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-d28ca3e6-9aa8-423a-aa69-6dc237e23b7a tempest-ProjectReaderTests-2105386862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:38:50 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-d28ca3e6-9aa8-423a-aa69-6dc237e23b7a tempest-ProjectReaderTests-2105386862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:38:50 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-d28ca3e6-9aa8-423a-aa69-6dc237e23b7a tempest-ProjectReaderTests-2105386862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:38:50 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-d28ca3e6-9aa8-423a-aa69-6dc237e23b7a tempest-ProjectReaderTests-2105386862 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:38:50 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-d28ca3e6-9aa8-423a-aa69-6dc237e23b7a tempest-ProjectReaderTests-2105386862 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:38:50 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-d28ca3e6-9aa8-423a-aa69-6dc237e23b7a tempest-ProjectReaderTests-2105386862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-6b659560-485c-4a1a-bd7b-e965d2e2227d 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:50 devstack sudo[106611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-6b659560-485c-4a1a-bd7b-e965d2e2227d 1073741824 Sep 16 20:38:50 devstack sudo[106611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:50 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-90540330-2bd9-4b73-8bc6-263fe7f234b8 tempest-ProjectMemberTests-730908627 None] Acquiring lock "cinder-c6582a48-b1ac-42c9-9164-ad3034d642cb-delete_snapshot" by "delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:38:50 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-90540330-2bd9-4b73-8bc6-263fe7f234b8 tempest-ProjectMemberTests-730908627 None] Lock "cinder-c6582a48-b1ac-42c9-9164-ad3034d642cb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:38:50 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-90540330-2bd9-4b73-8bc6-263fe7f234b8 tempest-ProjectMemberTests-730908627 None] Acquiring lock "cinder-quobyte-27ae9b1f-92ba-4125-b30c-45d099a1226f" by "delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:38:50 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-90540330-2bd9-4b73-8bc6-263fe7f234b8 tempest-ProjectMemberTests-730908627 None] Lock "cinder-quobyte-27ae9b1f-92ba-4125-b30c-45d099a1226f" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:38:50 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-90540330-2bd9-4b73-8bc6-263fe7f234b8 tempest-ProjectMemberTests-730908627 None] Acquiring lock "cinder-quobyte-c6582a48-b1ac-42c9-9164-ad3034d642cb" by "_delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:38:50 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-90540330-2bd9-4b73-8bc6-263fe7f234b8 tempest-ProjectMemberTests-730908627 None] Lock "cinder-quobyte-c6582a48-b1ac-42c9-9164-ad3034d642cb" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:38:50 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-90540330-2bd9-4b73-8bc6-263fe7f234b8 tempest-ProjectMemberTests-730908627 None] Deleting offline snapshot c6582a48-b1ac-42c9-9164-ad3034d642cb of volume 27ae9b1f-92ba-4125-b30c-45d099a1226f {{(pid=86188) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 20:38:50 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-90540330-2bd9-4b73-8bc6-263fe7f234b8 tempest-ProjectMemberTests-730908627 None] snapshot_file for this snap is: volume-27ae9b1f-92ba-4125-b30c-45d099a1226f.c6582a48-b1ac-42c9-9164-ad3034d642cb {{(pid=86188) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 20:38:50 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce9ec58c-3a99-463d-a00b-5f9e7049b3c5]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:38:50 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-90540330-2bd9-4b73-8bc6-263fe7f234b8 tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-27ae9b1f-92ba-4125-b30c-45d099a1226f.c6582a48-b1ac-42c9-9164-ad3034d642cb {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:50 devstack sudo[106616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-27ae9b1f-92ba-4125-b30c-45d099a1226f.c6582a48-b1ac-42c9-9164-ad3034d642cb Sep 16 20:38:50 devstack sudo[106616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:51 devstack sudo[106611]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:51 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-d28ca3e6-9aa8-423a-aa69-6dc237e23b7a tempest-ProjectReaderTests-2105386862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-6b659560-485c-4a1a-bd7b-e965d2e2227d 1073741824" returned: 0 in 0.586s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:51 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-d28ca3e6-9aa8-423a-aa69-6dc237e23b7a tempest-ProjectReaderTests-2105386862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-6b659560-485c-4a1a-bd7b-e965d2e2227d {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:51 devstack sudo[106620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-6b659560-485c-4a1a-bd7b-e965d2e2227d Sep 16 20:38:51 devstack sudo[106620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:51 devstack sudo[106616]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:51 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-90540330-2bd9-4b73-8bc6-263fe7f234b8 tempest-ProjectMemberTests-730908627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-27ae9b1f-92ba-4125-b30c-45d099a1226f.c6582a48-b1ac-42c9-9164-ad3034d642cb" returned: 0 in 0.600s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:51 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-90540330-2bd9-4b73-8bc6-263fe7f234b8 tempest-ProjectMemberTests-730908627 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-27ae9b1f-92ba-4125-b30c-45d099a1226f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86188) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 20:38:51 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd4c123e-2ee1-46df-a16f-4d9fcbb6848e]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:38:51 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-90540330-2bd9-4b73-8bc6-263fe7f234b8 tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-27ae9b1f-92ba-4125-b30c-45d099a1226f {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:51 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f1daf68-09ad-41f1-a98a-e96bcba1967e tempest-ProjectReaderTests-510915641 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:38:51 devstack sudo[106620]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:51 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-7f1daf68-09ad-41f1-a98a-e96bcba1967e tempest-ProjectReaderTests-510915641 None] Flow 'volume_create_manager' (f21f8178-8196-4927-bc7c-9298ad81f146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:38:51 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-7f1daf68-09ad-41f1-a98a-e96bcba1967e tempest-ProjectReaderTests-510915641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f7c0a18-3e98-45b1-a562-6e3ba02341fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:38:51 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-d28ca3e6-9aa8-423a-aa69-6dc237e23b7a tempest-ProjectReaderTests-2105386862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-6b659560-485c-4a1a-bd7b-e965d2e2227d" returned: 0 in 0.379s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:51 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-d28ca3e6-9aa8-423a-aa69-6dc237e23b7a tempest-ProjectReaderTests-2105386862 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:38:51 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-d28ca3e6-9aa8-423a-aa69-6dc237e23b7a tempest-ProjectReaderTests-2105386862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.026s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:38:51 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-7f1daf68-09ad-41f1-a98a-e96bcba1967e tempest-ProjectReaderTests-510915641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f7c0a18-3e98-45b1-a562-6e3ba02341fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:38:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-39816622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9a64fac-0aaa-4592-89f9-ed14a7ab7fbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ace9fe7829b4403c94750df5f95439e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:38:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:38:51Z,use_quota=True,user_id='4ac8de8833be4dbfa41217152fa8344d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:38:51 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-7f1daf68-09ad-41f1-a98a-e96bcba1967e tempest-ProjectReaderTests-510915641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75b77d76-61d9-423a-a08f-27a4f6467bfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:38:51 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-7f1daf68-09ad-41f1-a98a-e96bcba1967e tempest-ProjectReaderTests-510915641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75b77d76-61d9-423a-a08f-27a4f6467bfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:38:51 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-7f1daf68-09ad-41f1-a98a-e96bcba1967e tempest-ProjectReaderTests-510915641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d72f2ce5-6e1d-43c7-89c4-646fc45592a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:38:51 devstack sudo[106626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-27ae9b1f-92ba-4125-b30c-45d099a1226f Sep 16 20:38:51 devstack sudo[106626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:51 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-7f1daf68-09ad-41f1-a98a-e96bcba1967e tempest-ProjectReaderTests-510915641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d72f2ce5-6e1d-43c7-89c4-646fc45592a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9a64fac-0aaa-4592-89f9-ed14a7ab7fbc', 'volume_name': 'volume-f9a64fac-0aaa-4592-89f9-ed14a7ab7fbc', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:38:51 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-7f1daf68-09ad-41f1-a98a-e96bcba1967e tempest-ProjectReaderTests-510915641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea0155a3-3d43-460c-a10e-dbff2f67f9c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:38:51 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-7f1daf68-09ad-41f1-a98a-e96bcba1967e tempest-ProjectReaderTests-510915641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea0155a3-3d43-460c-a10e-dbff2f67f9c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:38:51 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-7f1daf68-09ad-41f1-a98a-e96bcba1967e tempest-ProjectReaderTests-510915641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91525523-b01f-45a4-9196-373cecadace8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:38:51 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-7f1daf68-09ad-41f1-a98a-e96bcba1967e tempest-ProjectReaderTests-510915641 None] Volume f9a64fac-0aaa-4592-89f9-ed14a7ab7fbc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9a64fac-0aaa-4592-89f9-ed14a7ab7fbc', 'volume_size': 1} Sep 16 20:38:51 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-7f1daf68-09ad-41f1-a98a-e96bcba1967e tempest-ProjectReaderTests-510915641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:38:51 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-7f1daf68-09ad-41f1-a98a-e96bcba1967e tempest-ProjectReaderTests-510915641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:38:51 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-7f1daf68-09ad-41f1-a98a-e96bcba1967e tempest-ProjectReaderTests-510915641 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:38:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-39816622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9a64fac-0aaa-4592-89f9-ed14a7ab7fbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ace9fe7829b4403c94750df5f95439e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:38:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:38:51Z,use_quota=True,user_id='4ac8de8833be4dbfa41217152fa8344d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:38:51 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-7f1daf68-09ad-41f1-a98a-e96bcba1967e tempest-ProjectReaderTests-510915641 None] Creating volume f9a64fac-0aaa-4592-89f9-ed14a7ab7fbc {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:38:51 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-7f1daf68-09ad-41f1-a98a-e96bcba1967e tempest-ProjectReaderTests-510915641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:38:51 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-7f1daf68-09ad-41f1-a98a-e96bcba1967e tempest-ProjectReaderTests-510915641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:38:51 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-7f1daf68-09ad-41f1-a98a-e96bcba1967e tempest-ProjectReaderTests-510915641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:38:51 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-7f1daf68-09ad-41f1-a98a-e96bcba1967e tempest-ProjectReaderTests-510915641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:38:51 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-7f1daf68-09ad-41f1-a98a-e96bcba1967e tempest-ProjectReaderTests-510915641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:38:51 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-7f1daf68-09ad-41f1-a98a-e96bcba1967e tempest-ProjectReaderTests-510915641 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:38:51 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-7f1daf68-09ad-41f1-a98a-e96bcba1967e tempest-ProjectReaderTests-510915641 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:38:51 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-7f1daf68-09ad-41f1-a98a-e96bcba1967e tempest-ProjectReaderTests-510915641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-f9a64fac-0aaa-4592-89f9-ed14a7ab7fbc 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:51 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-d28ca3e6-9aa8-423a-aa69-6dc237e23b7a tempest-ProjectReaderTests-2105386862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ef3090b-295c-4b5a-9aac-49fe7f56005d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b659560-485c-4a1a-bd7b-e965d2e2227d', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:38:51 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-d28ca3e6-9aa8-423a-aa69-6dc237e23b7a tempest-ProjectReaderTests-2105386862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e654daf-be2a-44e6-993b-1822d2dc2fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:38:51 devstack sudo[106629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-f9a64fac-0aaa-4592-89f9-ed14a7ab7fbc 1073741824 Sep 16 20:38:51 devstack sudo[106629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:51 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-d28ca3e6-9aa8-423a-aa69-6dc237e23b7a tempest-ProjectReaderTests-2105386862 None] Volume volume-6b659560-485c-4a1a-bd7b-e965d2e2227d (6b659560-485c-4a1a-bd7b-e965d2e2227d): created successfully Sep 16 20:38:51 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-d28ca3e6-9aa8-423a-aa69-6dc237e23b7a tempest-ProjectReaderTests-2105386862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e654daf-be2a-44e6-993b-1822d2dc2fbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:38:51 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-d28ca3e6-9aa8-423a-aa69-6dc237e23b7a tempest-ProjectReaderTests-2105386862 None] Flow 'volume_create_manager' (813557fd-773b-43c3-bba3-f394a235741a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:38:51 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-d28ca3e6-9aa8-423a-aa69-6dc237e23b7a tempest-ProjectReaderTests-2105386862 None] Created volume successfully. Sep 16 20:38:51 devstack sudo[106626]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:51 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-90540330-2bd9-4b73-8bc6-263fe7f234b8 tempest-ProjectMemberTests-730908627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-27ae9b1f-92ba-4125-b30c-45d099a1226f" returned: 0 in 0.420s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:51 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-90540330-2bd9-4b73-8bc6-263fe7f234b8 tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-27ae9b1f-92ba-4125-b30c-45d099a1226f.c6582a48-b1ac-42c9-9164-ad3034d642cb {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:51 devstack sudo[106636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-27ae9b1f-92ba-4125-b30c-45d099a1226f.c6582a48-b1ac-42c9-9164-ad3034d642cb Sep 16 20:38:51 devstack sudo[106636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:52 devstack sudo[106629]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:52 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-7f1daf68-09ad-41f1-a98a-e96bcba1967e tempest-ProjectReaderTests-510915641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-f9a64fac-0aaa-4592-89f9-ed14a7ab7fbc 1073741824" returned: 0 in 0.490s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:52 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-7f1daf68-09ad-41f1-a98a-e96bcba1967e tempest-ProjectReaderTests-510915641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-f9a64fac-0aaa-4592-89f9-ed14a7ab7fbc {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:52 devstack sudo[106642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-f9a64fac-0aaa-4592-89f9-ed14a7ab7fbc Sep 16 20:38:52 devstack sudo[106642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:52 devstack sudo[106636]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:52 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-90540330-2bd9-4b73-8bc6-263fe7f234b8 tempest-ProjectMemberTests-730908627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-27ae9b1f-92ba-4125-b30c-45d099a1226f.c6582a48-b1ac-42c9-9164-ad3034d642cb" returned: 0 in 0.383s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:52 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-90540330-2bd9-4b73-8bc6-263fe7f234b8 tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-27ae9b1f-92ba-4125-b30c-45d099a1226f.c6582a48-b1ac-42c9-9164-ad3034d642cb {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:52 devstack sudo[106644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-27ae9b1f-92ba-4125-b30c-45d099a1226f.c6582a48-b1ac-42c9-9164-ad3034d642cb Sep 16 20:38:52 devstack sudo[106644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:52 devstack sudo[106642]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:52 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-7f1daf68-09ad-41f1-a98a-e96bcba1967e tempest-ProjectReaderTests-510915641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-f9a64fac-0aaa-4592-89f9-ed14a7ab7fbc" returned: 0 in 0.334s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:52 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-7f1daf68-09ad-41f1-a98a-e96bcba1967e tempest-ProjectReaderTests-510915641 None] <== create_volume: return (864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:38:52 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-7f1daf68-09ad-41f1-a98a-e96bcba1967e tempest-ProjectReaderTests-510915641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.866s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:38:52 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-7f1daf68-09ad-41f1-a98a-e96bcba1967e tempest-ProjectReaderTests-510915641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91525523-b01f-45a4-9196-373cecadace8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9a64fac-0aaa-4592-89f9-ed14a7ab7fbc', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:38:52 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-7f1daf68-09ad-41f1-a98a-e96bcba1967e tempest-ProjectReaderTests-510915641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a71a77cc-06cd-42c7-bb65-b45b2e819d0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:38:52 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-7f1daf68-09ad-41f1-a98a-e96bcba1967e tempest-ProjectReaderTests-510915641 None] Volume volume-f9a64fac-0aaa-4592-89f9-ed14a7ab7fbc (f9a64fac-0aaa-4592-89f9-ed14a7ab7fbc): created successfully Sep 16 20:38:52 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-7f1daf68-09ad-41f1-a98a-e96bcba1967e tempest-ProjectReaderTests-510915641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a71a77cc-06cd-42c7-bb65-b45b2e819d0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:38:52 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-7f1daf68-09ad-41f1-a98a-e96bcba1967e tempest-ProjectReaderTests-510915641 None] Flow 'volume_create_manager' (f21f8178-8196-4927-bc7c-9298ad81f146) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:38:52 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-7f1daf68-09ad-41f1-a98a-e96bcba1967e tempest-ProjectReaderTests-510915641 None] Created volume successfully. Sep 16 20:38:52 devstack sudo[106644]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:52 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-90540330-2bd9-4b73-8bc6-263fe7f234b8 tempest-ProjectMemberTests-730908627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-27ae9b1f-92ba-4125-b30c-45d099a1226f.c6582a48-b1ac-42c9-9164-ad3034d642cb" returned: 0 in 0.329s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:52 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-90540330-2bd9-4b73-8bc6-263fe7f234b8 tempest-ProjectMemberTests-730908627 None] Lock "cinder-quobyte-c6582a48-b1ac-42c9-9164-ad3034d642cb" released by "_delete_snapshot" :: held 1.861s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:38:52 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-90540330-2bd9-4b73-8bc6-263fe7f234b8 tempest-ProjectMemberTests-730908627 None] Lock "cinder-quobyte-27ae9b1f-92ba-4125-b30c-45d099a1226f" released by "delete_snapshot" :: held 1.895s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:38:52 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-90540330-2bd9-4b73-8bc6-263fe7f234b8 tempest-ProjectMemberTests-730908627 None] Created reservations ['d2c2d1ef-e644-4e60-87ed-1b16f24b5718', 'eb890018-45be-4e4f-a657-d9a69f04cd7c', 'a70da5f3-925d-4051-a009-8f6eae4a8800', '4109c01a-37f5-4885-8f71-615a4510f3d9'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:38:52 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-b78b8cfb-1e45-4d41-a4c4-fcfa1f7917c5 tempest-ProjectReaderTests-2105386862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:38:52 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-b78b8cfb-1e45-4d41-a4c4-fcfa1f7917c5 tempest-ProjectReaderTests-2105386862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:38:52 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-b78b8cfb-1e45-4d41-a4c4-fcfa1f7917c5 tempest-ProjectReaderTests-2105386862 None] Creating offline snapshot f3c7bd11-3a47-4cda-abf9-0e0f94680e80 of volume 6b659560-485c-4a1a-bd7b-e965d2e2227d {{(pid=86188) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 20:38:52 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-90540330-2bd9-4b73-8bc6-263fe7f234b8 tempest-ProjectMemberTests-730908627 None] Delete snapshot completed successfully. Sep 16 20:38:52 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4aa1c53-9651-4b8b-bd47-ced721855a8c]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:38:52 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b78b8cfb-1e45-4d41-a4c4-fcfa1f7917c5 tempest-ProjectReaderTests-2105386862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-6b659560-485c-4a1a-bd7b-e965d2e2227d {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:52 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-90540330-2bd9-4b73-8bc6-263fe7f234b8 tempest-ProjectMemberTests-730908627 None] Lock "cinder-c6582a48-b1ac-42c9-9164-ad3034d642cb-delete_snapshot" released by "delete_snapshot" :: held 2.084s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:38:52 devstack sudo[106648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-6b659560-485c-4a1a-bd7b-e965d2e2227d Sep 16 20:38:52 devstack sudo[106648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:52 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-ee70855c-77c1-4dda-939b-feb8c24d55b5 tempest-ProjectMemberTests-730908627 None] Acquiring lock "cinder-27ae9b1f-92ba-4125-b30c-45d099a1226f-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:38:52 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-ee70855c-77c1-4dda-939b-feb8c24d55b5 tempest-ProjectMemberTests-730908627 None] Lock "cinder-27ae9b1f-92ba-4125-b30c-45d099a1226f-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:38:52 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-ee70855c-77c1-4dda-939b-feb8c24d55b5 tempest-ProjectMemberTests-730908627 None] Acquiring lock "cinder-quobyte-27ae9b1f-92ba-4125-b30c-45d099a1226f" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:38:52 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-ee70855c-77c1-4dda-939b-feb8c24d55b5 tempest-ProjectMemberTests-730908627 None] Lock "cinder-quobyte-27ae9b1f-92ba-4125-b30c-45d099a1226f" acquired by "delete_volume" :: waited 0.015s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:38:52 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[90426e75-f022-4143-b646-a1cac3921a70]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:38:52 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ee70855c-77c1-4dda-939b-feb8c24d55b5 tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-27ae9b1f-92ba-4125-b30c-45d099a1226f {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:53 devstack cinder-volume[86188]: DEBUG oslo_service.periodic_task [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86188) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 20:38:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:38:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:38:53 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:38:53 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:38:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:38:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:53 devstack sudo[106650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-27ae9b1f-92ba-4125-b30c-45d099a1226f Sep 16 20:38:53 devstack sudo[106650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:53 devstack sudo[106653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:38:53 devstack sudo[106653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:53 devstack sudo[106648]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b78b8cfb-1e45-4d41-a4c4-fcfa1f7917c5 tempest-ProjectReaderTests-2105386862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-6b659560-485c-4a1a-bd7b-e965d2e2227d" returned: 0 in 0.413s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b78b8cfb-1e45-4d41-a4c4-fcfa1f7917c5 tempest-ProjectReaderTests-2105386862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-6b659560-485c-4a1a-bd7b-e965d2e2227d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-6b659560-485c-4a1a-bd7b-e965d2e2227d.f3c7bd11-3a47-4cda-abf9-0e0f94680e80 1G {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:53 devstack sudo[106657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-6b659560-485c-4a1a-bd7b-e965d2e2227d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-6b659560-485c-4a1a-bd7b-e965d2e2227d.f3c7bd11-3a47-4cda-abf9-0e0f94680e80 1G Sep 16 20:38:53 devstack sudo[106657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:53 devstack sudo[106653]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.346s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:53 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:38:53 devstack cinder-volume[86188]: DEBUG oslo_service.periodic_task [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Running periodic task VolumeManager._thread_info {{(pid=86188) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 20:38:53 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] thread count: 28 {{(pid=86188) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 16 20:38:53 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] thread info: [<_MainThread(MainThread, started 139858124406912)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86188) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 16 20:38:53 devstack sudo[106650]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ee70855c-77c1-4dda-939b-feb8c24d55b5 tempest-ProjectMemberTests-730908627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-27ae9b1f-92ba-4125-b30c-45d099a1226f" returned: 0 in 0.468s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ee70855c-77c1-4dda-939b-feb8c24d55b5 tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-27ae9b1f-92ba-4125-b30c-45d099a1226f {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:53 devstack sudo[106665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-27ae9b1f-92ba-4125-b30c-45d099a1226f Sep 16 20:38:53 devstack sudo[106665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:53 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-983a4d25-703f-4d4c-911b-34453169ca2a tempest-ProjectReaderTests-510915641 None] Acquiring lock "cinder-f9a64fac-0aaa-4592-89f9-ed14a7ab7fbc-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:38:53 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-983a4d25-703f-4d4c-911b-34453169ca2a tempest-ProjectReaderTests-510915641 None] Lock "cinder-f9a64fac-0aaa-4592-89f9-ed14a7ab7fbc-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:38:53 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-983a4d25-703f-4d4c-911b-34453169ca2a tempest-ProjectReaderTests-510915641 None] Acquiring lock "cinder-quobyte-f9a64fac-0aaa-4592-89f9-ed14a7ab7fbc" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:38:53 devstack sudo[106657]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b78b8cfb-1e45-4d41-a4c4-fcfa1f7917c5 tempest-ProjectReaderTests-2105386862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-6b659560-485c-4a1a-bd7b-e965d2e2227d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-6b659560-485c-4a1a-bd7b-e965d2e2227d.f3c7bd11-3a47-4cda-abf9-0e0f94680e80 1G" returned: 0 in 0.619s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b78b8cfb-1e45-4d41-a4c4-fcfa1f7917c5 tempest-ProjectReaderTests-2105386862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b659560-485c-4a1a-bd7b-e965d2e2227d -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-6b659560-485c-4a1a-bd7b-e965d2e2227d.f3c7bd11-3a47-4cda-abf9-0e0f94680e80 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:53 devstack sudo[106665]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:53 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-983a4d25-703f-4d4c-911b-34453169ca2a tempest-ProjectReaderTests-510915641 None] Lock "cinder-quobyte-f9a64fac-0aaa-4592-89f9-ed14a7ab7fbc" acquired by "delete_volume" :: waited 0.039s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:38:53 devstack sudo[106670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b659560-485c-4a1a-bd7b-e965d2e2227d -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-6b659560-485c-4a1a-bd7b-e965d2e2227d.f3c7bd11-3a47-4cda-abf9-0e0f94680e80 Sep 16 20:38:53 devstack sudo[106670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ee70855c-77c1-4dda-939b-feb8c24d55b5 tempest-ProjectMemberTests-730908627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-27ae9b1f-92ba-4125-b30c-45d099a1226f" returned: 0 in 0.366s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:53 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[3276df4f-058d-495c-b3b2-d8dda66147fc]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:38:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-983a4d25-703f-4d4c-911b-34453169ca2a tempest-ProjectReaderTests-510915641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-f9a64fac-0aaa-4592-89f9-ed14a7ab7fbc {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:53 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-ee70855c-77c1-4dda-939b-feb8c24d55b5 tempest-ProjectMemberTests-730908627 None] Lock "cinder-quobyte-27ae9b1f-92ba-4125-b30c-45d099a1226f" released by "delete_volume" :: held 0.923s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:38:53 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-ee70855c-77c1-4dda-939b-feb8c24d55b5 tempest-ProjectMemberTests-730908627 None] Created reservations ['110c42fb-7ea1-44a4-920d-89de5d73377b', '5fcd3449-3f16-4048-931e-3a491a6958bb', 'a8302150-866f-4867-a1a8-7acaec2684a7', 'f8e0688d-0dfa-4a15-b46a-2a3baa194fc9'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:38:54 devstack sudo[106672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-f9a64fac-0aaa-4592-89f9-ed14a7ab7fbc Sep 16 20:38:54 devstack sudo[106672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:54 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-ee70855c-77c1-4dda-939b-feb8c24d55b5 tempest-ProjectMemberTests-730908627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:38:54 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-ee70855c-77c1-4dda-939b-feb8c24d55b5 tempest-ProjectMemberTests-730908627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:38:54 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-ee70855c-77c1-4dda-939b-feb8c24d55b5 tempest-ProjectMemberTests-730908627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:38:54 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-ee70855c-77c1-4dda-939b-feb8c24d55b5 tempest-ProjectMemberTests-730908627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:38:54 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-ee70855c-77c1-4dda-939b-feb8c24d55b5 tempest-ProjectMemberTests-730908627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:38:54 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ee70855c-77c1-4dda-939b-feb8c24d55b5 tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:54 devstack sudo[106676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:38:54 devstack sudo[106676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:54 devstack sudo[106670]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:54 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b78b8cfb-1e45-4d41-a4c4-fcfa1f7917c5 tempest-ProjectReaderTests-2105386862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b659560-485c-4a1a-bd7b-e965d2e2227d -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-6b659560-485c-4a1a-bd7b-e965d2e2227d.f3c7bd11-3a47-4cda-abf9-0e0f94680e80" returned: 0 in 0.447s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:54 devstack cinder-volume[86188]: WARNING cinder.volume.drivers.remotefs [None req-b78b8cfb-1e45-4d41-a4c4-fcfa1f7917c5 tempest-ProjectReaderTests-2105386862 None] /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-6b659560-485c-4a1a-bd7b-e965d2e2227d.f3c7bd11-3a47-4cda-abf9-0e0f94680e80 is being set with open permissions: ugo+rw Sep 16 20:38:54 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b78b8cfb-1e45-4d41-a4c4-fcfa1f7917c5 tempest-ProjectReaderTests-2105386862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-6b659560-485c-4a1a-bd7b-e965d2e2227d.f3c7bd11-3a47-4cda-abf9-0e0f94680e80 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:54 devstack sudo[106679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-6b659560-485c-4a1a-bd7b-e965d2e2227d.f3c7bd11-3a47-4cda-abf9-0e0f94680e80 Sep 16 20:38:54 devstack sudo[106679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:54 devstack sudo[106676]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:54 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ee70855c-77c1-4dda-939b-feb8c24d55b5 tempest-ProjectMemberTests-730908627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.374s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:54 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-ee70855c-77c1-4dda-939b-feb8c24d55b5 tempest-ProjectMemberTests-730908627 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:38:54 devstack sudo[106672]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:54 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-ee70855c-77c1-4dda-939b-feb8c24d55b5 tempest-ProjectMemberTests-730908627 None] Deleted volume successfully. Sep 16 20:38:54 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-983a4d25-703f-4d4c-911b-34453169ca2a tempest-ProjectReaderTests-510915641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-f9a64fac-0aaa-4592-89f9-ed14a7ab7fbc" returned: 0 in 0.637s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:54 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-983a4d25-703f-4d4c-911b-34453169ca2a tempest-ProjectReaderTests-510915641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-f9a64fac-0aaa-4592-89f9-ed14a7ab7fbc {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:54 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-ee70855c-77c1-4dda-939b-feb8c24d55b5 tempest-ProjectMemberTests-730908627 None] Lock "cinder-27ae9b1f-92ba-4125-b30c-45d099a1226f-delete_volume" released by "delete_volume" :: held 1.630s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:38:54 devstack sudo[106685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-f9a64fac-0aaa-4592-89f9-ed14a7ab7fbc Sep 16 20:38:54 devstack sudo[106685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:54 devstack sudo[106679]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:54 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b78b8cfb-1e45-4d41-a4c4-fcfa1f7917c5 tempest-ProjectReaderTests-2105386862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-6b659560-485c-4a1a-bd7b-e965d2e2227d.f3c7bd11-3a47-4cda-abf9-0e0f94680e80" returned: 0 in 0.491s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:54 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-85299c67-f366-4a6a-b3b3-31e159b8877a tempest-ProjectMemberTests-730908627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:38:54 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-85299c67-f366-4a6a-b3b3-31e159b8877a tempest-ProjectMemberTests-730908627 None] Flow 'volume_create_manager' (6ba33ae4-3323-4d1e-bdd3-f2bcda9f75f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:38:54 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-85299c67-f366-4a6a-b3b3-31e159b8877a tempest-ProjectMemberTests-730908627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a41fd037-7b14-4864-9f9e-0b6d6593fd83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:38:54 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-85299c67-f366-4a6a-b3b3-31e159b8877a tempest-ProjectMemberTests-730908627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a41fd037-7b14-4864-9f9e-0b6d6593fd83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:38:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1526122710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ab6b2c0-318a-4e90-9f68-d48d93bc2f5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d632f989377844f6b93c3b9bf838981d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:38:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:38:55Z,use_quota=True,user_id='5db8cf25fcc448629ab58c8006482185',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:38:54 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-85299c67-f366-4a6a-b3b3-31e159b8877a tempest-ProjectMemberTests-730908627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21b2216b-14f0-47db-80ac-dcf483a741da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:38:54 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-85299c67-f366-4a6a-b3b3-31e159b8877a tempest-ProjectMemberTests-730908627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21b2216b-14f0-47db-80ac-dcf483a741da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:38:54 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-85299c67-f366-4a6a-b3b3-31e159b8877a tempest-ProjectMemberTests-730908627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e84da42-4f02-4732-aeb1-096183318679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:38:54 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-85299c67-f366-4a6a-b3b3-31e159b8877a tempest-ProjectMemberTests-730908627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e84da42-4f02-4732-aeb1-096183318679) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ab6b2c0-318a-4e90-9f68-d48d93bc2f5a', 'volume_name': 'volume-5ab6b2c0-318a-4e90-9f68-d48d93bc2f5a', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:38:54 devstack sudo[106685]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:54 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-85299c67-f366-4a6a-b3b3-31e159b8877a tempest-ProjectMemberTests-730908627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9c2f321-ad93-4fc8-b00a-860f7f3f6643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:38:54 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-85299c67-f366-4a6a-b3b3-31e159b8877a tempest-ProjectMemberTests-730908627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9c2f321-ad93-4fc8-b00a-860f7f3f6643) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:38:54 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-85299c67-f366-4a6a-b3b3-31e159b8877a tempest-ProjectMemberTests-730908627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9159792-6ae2-43cb-9b0a-11af6902f0f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:38:54 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-85299c67-f366-4a6a-b3b3-31e159b8877a tempest-ProjectMemberTests-730908627 None] Volume 5ab6b2c0-318a-4e90-9f68-d48d93bc2f5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ab6b2c0-318a-4e90-9f68-d48d93bc2f5a', 'volume_size': 1} Sep 16 20:38:54 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-85299c67-f366-4a6a-b3b3-31e159b8877a tempest-ProjectMemberTests-730908627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:38:54 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b78b8cfb-1e45-4d41-a4c4-fcfa1f7917c5 tempest-ProjectReaderTests-2105386862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-6b659560-485c-4a1a-bd7b-e965d2e2227d.info {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:54 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-983a4d25-703f-4d4c-911b-34453169ca2a tempest-ProjectReaderTests-510915641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-f9a64fac-0aaa-4592-89f9-ed14a7ab7fbc" returned: 0 in 0.393s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:54 devstack sudo[106690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-6b659560-485c-4a1a-bd7b-e965d2e2227d.info Sep 16 20:38:54 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-983a4d25-703f-4d4c-911b-34453169ca2a tempest-ProjectReaderTests-510915641 None] Lock "cinder-quobyte-f9a64fac-0aaa-4592-89f9-ed14a7ab7fbc" released by "delete_volume" :: held 1.099s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:38:54 devstack sudo[106690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:54 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-983a4d25-703f-4d4c-911b-34453169ca2a tempest-ProjectReaderTests-510915641 None] Created reservations ['84f90cb3-ab9c-4bb6-8ea1-4c20708d5d2a', '4b93001d-deab-4840-9d5c-b4544e4192c9', '56fc5e09-bbba-4394-80bd-4863d9d7ede5', '7bdbe8b6-51d4-49c1-baa5-f046c268ccfc'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:38:55 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-983a4d25-703f-4d4c-911b-34453169ca2a tempest-ProjectReaderTests-510915641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:38:55 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-983a4d25-703f-4d4c-911b-34453169ca2a tempest-ProjectReaderTests-510915641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:38:55 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-983a4d25-703f-4d4c-911b-34453169ca2a tempest-ProjectReaderTests-510915641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:38:55 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-983a4d25-703f-4d4c-911b-34453169ca2a tempest-ProjectReaderTests-510915641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:38:55 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-983a4d25-703f-4d4c-911b-34453169ca2a tempest-ProjectReaderTests-510915641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:38:55 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-983a4d25-703f-4d4c-911b-34453169ca2a tempest-ProjectReaderTests-510915641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:55 devstack sudo[106692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:38:55 devstack sudo[106692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:55 devstack sudo[106690]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:55 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b78b8cfb-1e45-4d41-a4c4-fcfa1f7917c5 tempest-ProjectReaderTests-2105386862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-6b659560-485c-4a1a-bd7b-e965d2e2227d.info" returned: 0 in 0.296s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:55 devstack cinder-volume[86188]: WARNING cinder.volume.drivers.remotefs [None req-b78b8cfb-1e45-4d41-a4c4-fcfa1f7917c5 tempest-ProjectReaderTests-2105386862 None] /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-6b659560-485c-4a1a-bd7b-e965d2e2227d.info is being set with open permissions: ugo+rw Sep 16 20:38:55 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b78b8cfb-1e45-4d41-a4c4-fcfa1f7917c5 tempest-ProjectReaderTests-2105386862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-6b659560-485c-4a1a-bd7b-e965d2e2227d.info {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:55 devstack sudo[106695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-6b659560-485c-4a1a-bd7b-e965d2e2227d.info Sep 16 20:38:55 devstack sudo[106695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:55 devstack sudo[106692]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:55 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-983a4d25-703f-4d4c-911b-34453169ca2a tempest-ProjectReaderTests-510915641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.252s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:55 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-983a4d25-703f-4d4c-911b-34453169ca2a tempest-ProjectReaderTests-510915641 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:38:55 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-983a4d25-703f-4d4c-911b-34453169ca2a tempest-ProjectReaderTests-510915641 None] Deleted volume successfully. Sep 16 20:38:55 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-983a4d25-703f-4d4c-911b-34453169ca2a tempest-ProjectReaderTests-510915641 None] Lock "cinder-f9a64fac-0aaa-4592-89f9-ed14a7ab7fbc-delete_volume" released by "delete_volume" :: held 1.623s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:38:55 devstack sudo[106695]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:55 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b78b8cfb-1e45-4d41-a4c4-fcfa1f7917c5 tempest-ProjectReaderTests-2105386862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-6b659560-485c-4a1a-bd7b-e965d2e2227d.info" returned: 0 in 0.280s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:55 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-b78b8cfb-1e45-4d41-a4c4-fcfa1f7917c5 tempest-ProjectReaderTests-2105386862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.761s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:38:55 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-85299c67-f366-4a6a-b3b3-31e159b8877a tempest-ProjectMemberTests-730908627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.601s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:38:55 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-85299c67-f366-4a6a-b3b3-31e159b8877a tempest-ProjectMemberTests-730908627 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:38:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1526122710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ab6b2c0-318a-4e90-9f68-d48d93bc2f5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d632f989377844f6b93c3b9bf838981d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:38:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:38:55Z,use_quota=True,user_id='5db8cf25fcc448629ab58c8006482185',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:38:55 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-85299c67-f366-4a6a-b3b3-31e159b8877a tempest-ProjectMemberTests-730908627 None] Creating volume 5ab6b2c0-318a-4e90-9f68-d48d93bc2f5a {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:38:55 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-85299c67-f366-4a6a-b3b3-31e159b8877a tempest-ProjectMemberTests-730908627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:38:55 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-85299c67-f366-4a6a-b3b3-31e159b8877a tempest-ProjectMemberTests-730908627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:38:55 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-85299c67-f366-4a6a-b3b3-31e159b8877a tempest-ProjectMemberTests-730908627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:38:55 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-85299c67-f366-4a6a-b3b3-31e159b8877a tempest-ProjectMemberTests-730908627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:38:55 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-85299c67-f366-4a6a-b3b3-31e159b8877a tempest-ProjectMemberTests-730908627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:38:55 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-85299c67-f366-4a6a-b3b3-31e159b8877a tempest-ProjectMemberTests-730908627 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:38:55 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-85299c67-f366-4a6a-b3b3-31e159b8877a tempest-ProjectMemberTests-730908627 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:38:55 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-85299c67-f366-4a6a-b3b3-31e159b8877a tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-5ab6b2c0-318a-4e90-9f68-d48d93bc2f5a 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:55 devstack sudo[106699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-5ab6b2c0-318a-4e90-9f68-d48d93bc2f5a 1073741824 Sep 16 20:38:55 devstack sudo[106699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:55 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-b78b8cfb-1e45-4d41-a4c4-fcfa1f7917c5 tempest-ProjectReaderTests-2105386862 None] Create snapshot completed successfully Sep 16 20:38:55 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-49451d82-7505-4b09-98fb-ab76ce2c223b tempest-ProjectReaderTests-2105386862 None] Acquiring lock "cinder-f3c7bd11-3a47-4cda-abf9-0e0f94680e80-delete_snapshot" by "delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:38:55 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-49451d82-7505-4b09-98fb-ab76ce2c223b tempest-ProjectReaderTests-2105386862 None] Lock "cinder-f3c7bd11-3a47-4cda-abf9-0e0f94680e80-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:38:55 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-49451d82-7505-4b09-98fb-ab76ce2c223b tempest-ProjectReaderTests-2105386862 None] Acquiring lock "cinder-quobyte-6b659560-485c-4a1a-bd7b-e965d2e2227d" by "delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:38:55 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-49451d82-7505-4b09-98fb-ab76ce2c223b tempest-ProjectReaderTests-2105386862 None] Lock "cinder-quobyte-6b659560-485c-4a1a-bd7b-e965d2e2227d" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:38:55 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-49451d82-7505-4b09-98fb-ab76ce2c223b tempest-ProjectReaderTests-2105386862 None] Acquiring lock "cinder-quobyte-f3c7bd11-3a47-4cda-abf9-0e0f94680e80" by "_delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:38:56 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-49451d82-7505-4b09-98fb-ab76ce2c223b tempest-ProjectReaderTests-2105386862 None] Lock "cinder-quobyte-f3c7bd11-3a47-4cda-abf9-0e0f94680e80" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:38:56 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-49451d82-7505-4b09-98fb-ab76ce2c223b tempest-ProjectReaderTests-2105386862 None] Deleting offline snapshot f3c7bd11-3a47-4cda-abf9-0e0f94680e80 of volume 6b659560-485c-4a1a-bd7b-e965d2e2227d {{(pid=86188) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 20:38:56 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-49451d82-7505-4b09-98fb-ab76ce2c223b tempest-ProjectReaderTests-2105386862 None] snapshot_file for this snap is: volume-6b659560-485c-4a1a-bd7b-e965d2e2227d.f3c7bd11-3a47-4cda-abf9-0e0f94680e80 {{(pid=86188) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 20:38:56 devstack sudo[106699]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:56 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-85299c67-f366-4a6a-b3b3-31e159b8877a tempest-ProjectMemberTests-730908627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-5ab6b2c0-318a-4e90-9f68-d48d93bc2f5a 1073741824" returned: 0 in 0.592s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:56 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[e755b9a8-7b73-47e0-8662-aa7244f318ec]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:38:56 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-49451d82-7505-4b09-98fb-ab76ce2c223b tempest-ProjectReaderTests-2105386862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-6b659560-485c-4a1a-bd7b-e965d2e2227d.f3c7bd11-3a47-4cda-abf9-0e0f94680e80 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:56 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-85299c67-f366-4a6a-b3b3-31e159b8877a tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-5ab6b2c0-318a-4e90-9f68-d48d93bc2f5a {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:56 devstack sudo[106705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-5ab6b2c0-318a-4e90-9f68-d48d93bc2f5a Sep 16 20:38:56 devstack sudo[106705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:56 devstack sudo[106704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-6b659560-485c-4a1a-bd7b-e965d2e2227d.f3c7bd11-3a47-4cda-abf9-0e0f94680e80 Sep 16 20:38:56 devstack sudo[106704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:56 devstack sudo[106704]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:56 devstack sudo[106705]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:56 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-49451d82-7505-4b09-98fb-ab76ce2c223b tempest-ProjectReaderTests-2105386862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-6b659560-485c-4a1a-bd7b-e965d2e2227d.f3c7bd11-3a47-4cda-abf9-0e0f94680e80" returned: 0 in 0.490s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:56 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-49451d82-7505-4b09-98fb-ab76ce2c223b tempest-ProjectReaderTests-2105386862 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6b659560-485c-4a1a-bd7b-e965d2e2227d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86188) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 20:38:56 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-305bfc16-b38c-4417-8ca6-10b55492ee53 tempest-ProjectReaderTests-510915641 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:38:56 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-305bfc16-b38c-4417-8ca6-10b55492ee53 tempest-ProjectReaderTests-510915641 None] Flow 'volume_create_manager' (c7f48708-cf0a-4a8f-a2e1-52ed104b33f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:38:56 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-305bfc16-b38c-4417-8ca6-10b55492ee53 tempest-ProjectReaderTests-510915641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (990cfe7d-5e0c-4121-8769-274fe336146d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:38:56 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[58cbeb03-fe63-454c-923a-195e6022b1f8]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:38:56 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-85299c67-f366-4a6a-b3b3-31e159b8877a tempest-ProjectMemberTests-730908627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-5ab6b2c0-318a-4e90-9f68-d48d93bc2f5a" returned: 0 in 0.505s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:56 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-49451d82-7505-4b09-98fb-ab76ce2c223b tempest-ProjectReaderTests-2105386862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-6b659560-485c-4a1a-bd7b-e965d2e2227d {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:56 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-85299c67-f366-4a6a-b3b3-31e159b8877a tempest-ProjectMemberTests-730908627 None] <== create_volume: return (1172ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:38:56 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-85299c67-f366-4a6a-b3b3-31e159b8877a tempest-ProjectMemberTests-730908627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.176s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:38:56 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-305bfc16-b38c-4417-8ca6-10b55492ee53 tempest-ProjectReaderTests-510915641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (990cfe7d-5e0c-4121-8769-274fe336146d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:38:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1225744714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5efd8534-6a8d-4c75-8036-267984e62675,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ace9fe7829b4403c94750df5f95439e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:38:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:38:57Z,use_quota=True,user_id='4ac8de8833be4dbfa41217152fa8344d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:38:56 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-305bfc16-b38c-4417-8ca6-10b55492ee53 tempest-ProjectReaderTests-510915641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (227f2916-c2d4-4758-8585-8a8d64c22548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:38:56 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-305bfc16-b38c-4417-8ca6-10b55492ee53 tempest-ProjectReaderTests-510915641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (227f2916-c2d4-4758-8585-8a8d64c22548) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:38:56 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-305bfc16-b38c-4417-8ca6-10b55492ee53 tempest-ProjectReaderTests-510915641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (081cdd4d-5c65-42b9-9cf8-e75f81f0bde9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:38:56 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-305bfc16-b38c-4417-8ca6-10b55492ee53 tempest-ProjectReaderTests-510915641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (081cdd4d-5c65-42b9-9cf8-e75f81f0bde9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5efd8534-6a8d-4c75-8036-267984e62675', 'volume_name': 'volume-5efd8534-6a8d-4c75-8036-267984e62675', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:38:56 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-305bfc16-b38c-4417-8ca6-10b55492ee53 tempest-ProjectReaderTests-510915641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26201422-3ae5-4ae0-9d44-d95629615f20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:38:56 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-305bfc16-b38c-4417-8ca6-10b55492ee53 tempest-ProjectReaderTests-510915641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26201422-3ae5-4ae0-9d44-d95629615f20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:38:56 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-305bfc16-b38c-4417-8ca6-10b55492ee53 tempest-ProjectReaderTests-510915641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e70dfa80-8b6b-40e0-ae02-aa83158b78e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:38:56 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-305bfc16-b38c-4417-8ca6-10b55492ee53 tempest-ProjectReaderTests-510915641 None] Volume 5efd8534-6a8d-4c75-8036-267984e62675: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5efd8534-6a8d-4c75-8036-267984e62675', 'volume_size': 1} Sep 16 20:38:56 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-305bfc16-b38c-4417-8ca6-10b55492ee53 tempest-ProjectReaderTests-510915641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:38:56 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-305bfc16-b38c-4417-8ca6-10b55492ee53 tempest-ProjectReaderTests-510915641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:38:56 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-305bfc16-b38c-4417-8ca6-10b55492ee53 tempest-ProjectReaderTests-510915641 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:38:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1225744714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5efd8534-6a8d-4c75-8036-267984e62675,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ace9fe7829b4403c94750df5f95439e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:38:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:38:57Z,use_quota=True,user_id='4ac8de8833be4dbfa41217152fa8344d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:38:56 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-305bfc16-b38c-4417-8ca6-10b55492ee53 tempest-ProjectReaderTests-510915641 None] Creating volume 5efd8534-6a8d-4c75-8036-267984e62675 {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:38:56 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-305bfc16-b38c-4417-8ca6-10b55492ee53 tempest-ProjectReaderTests-510915641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:38:56 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-305bfc16-b38c-4417-8ca6-10b55492ee53 tempest-ProjectReaderTests-510915641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:38:56 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-305bfc16-b38c-4417-8ca6-10b55492ee53 tempest-ProjectReaderTests-510915641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:38:56 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-305bfc16-b38c-4417-8ca6-10b55492ee53 tempest-ProjectReaderTests-510915641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:38:56 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-305bfc16-b38c-4417-8ca6-10b55492ee53 tempest-ProjectReaderTests-510915641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:38:56 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-305bfc16-b38c-4417-8ca6-10b55492ee53 tempest-ProjectReaderTests-510915641 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:38:56 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-305bfc16-b38c-4417-8ca6-10b55492ee53 tempest-ProjectReaderTests-510915641 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:38:56 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-305bfc16-b38c-4417-8ca6-10b55492ee53 tempest-ProjectReaderTests-510915641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-5efd8534-6a8d-4c75-8036-267984e62675 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:56 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-85299c67-f366-4a6a-b3b3-31e159b8877a tempest-ProjectMemberTests-730908627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9159792-6ae2-43cb-9b0a-11af6902f0f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ab6b2c0-318a-4e90-9f68-d48d93bc2f5a', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:38:56 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-85299c67-f366-4a6a-b3b3-31e159b8877a tempest-ProjectMemberTests-730908627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74ce8192-e534-44db-a429-c34389b9a1c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:38:56 devstack sudo[106715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-5efd8534-6a8d-4c75-8036-267984e62675 1073741824 Sep 16 20:38:56 devstack sudo[106714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-6b659560-485c-4a1a-bd7b-e965d2e2227d Sep 16 20:38:56 devstack sudo[106715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:56 devstack sudo[106714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:56 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-85299c67-f366-4a6a-b3b3-31e159b8877a tempest-ProjectMemberTests-730908627 None] Volume volume-5ab6b2c0-318a-4e90-9f68-d48d93bc2f5a (5ab6b2c0-318a-4e90-9f68-d48d93bc2f5a): created successfully Sep 16 20:38:56 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-85299c67-f366-4a6a-b3b3-31e159b8877a tempest-ProjectMemberTests-730908627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74ce8192-e534-44db-a429-c34389b9a1c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:38:56 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-85299c67-f366-4a6a-b3b3-31e159b8877a tempest-ProjectMemberTests-730908627 None] Flow 'volume_create_manager' (6ba33ae4-3323-4d1e-bdd3-f2bcda9f75f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:38:56 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-85299c67-f366-4a6a-b3b3-31e159b8877a tempest-ProjectMemberTests-730908627 None] Created volume successfully. Sep 16 20:38:57 devstack sudo[106714]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:57 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-49451d82-7505-4b09-98fb-ab76ce2c223b tempest-ProjectReaderTests-2105386862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-6b659560-485c-4a1a-bd7b-e965d2e2227d" returned: 0 in 0.421s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:57 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-49451d82-7505-4b09-98fb-ab76ce2c223b tempest-ProjectReaderTests-2105386862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-6b659560-485c-4a1a-bd7b-e965d2e2227d.f3c7bd11-3a47-4cda-abf9-0e0f94680e80 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:57 devstack sudo[106725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-6b659560-485c-4a1a-bd7b-e965d2e2227d.f3c7bd11-3a47-4cda-abf9-0e0f94680e80 Sep 16 20:38:57 devstack sudo[106725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:57 devstack sudo[106715]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:57 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-305bfc16-b38c-4417-8ca6-10b55492ee53 tempest-ProjectReaderTests-510915641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-5efd8534-6a8d-4c75-8036-267984e62675 1073741824" returned: 0 in 0.525s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:57 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-305bfc16-b38c-4417-8ca6-10b55492ee53 tempest-ProjectReaderTests-510915641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-5efd8534-6a8d-4c75-8036-267984e62675 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:57 devstack sudo[106730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-5efd8534-6a8d-4c75-8036-267984e62675 Sep 16 20:38:57 devstack sudo[106730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:57 devstack sudo[106725]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:57 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-49451d82-7505-4b09-98fb-ab76ce2c223b tempest-ProjectReaderTests-2105386862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-6b659560-485c-4a1a-bd7b-e965d2e2227d.f3c7bd11-3a47-4cda-abf9-0e0f94680e80" returned: 0 in 0.389s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:57 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-49451d82-7505-4b09-98fb-ab76ce2c223b tempest-ProjectReaderTests-2105386862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-6b659560-485c-4a1a-bd7b-e965d2e2227d.f3c7bd11-3a47-4cda-abf9-0e0f94680e80 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:57 devstack sudo[106734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-6b659560-485c-4a1a-bd7b-e965d2e2227d.f3c7bd11-3a47-4cda-abf9-0e0f94680e80 Sep 16 20:38:57 devstack sudo[106734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:57 devstack sudo[106730]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:57 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-305bfc16-b38c-4417-8ca6-10b55492ee53 tempest-ProjectReaderTests-510915641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-5efd8534-6a8d-4c75-8036-267984e62675" returned: 0 in 0.311s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:57 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-305bfc16-b38c-4417-8ca6-10b55492ee53 tempest-ProjectReaderTests-510915641 None] <== create_volume: return (887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:38:57 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-305bfc16-b38c-4417-8ca6-10b55492ee53 tempest-ProjectReaderTests-510915641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:38:57 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-305bfc16-b38c-4417-8ca6-10b55492ee53 tempest-ProjectReaderTests-510915641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e70dfa80-8b6b-40e0-ae02-aa83158b78e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5efd8534-6a8d-4c75-8036-267984e62675', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:38:57 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-305bfc16-b38c-4417-8ca6-10b55492ee53 tempest-ProjectReaderTests-510915641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (016df15a-820b-4f89-a775-84e880a144f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:38:57 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-305bfc16-b38c-4417-8ca6-10b55492ee53 tempest-ProjectReaderTests-510915641 None] Volume volume-5efd8534-6a8d-4c75-8036-267984e62675 (5efd8534-6a8d-4c75-8036-267984e62675): created successfully Sep 16 20:38:57 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-305bfc16-b38c-4417-8ca6-10b55492ee53 tempest-ProjectReaderTests-510915641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (016df15a-820b-4f89-a775-84e880a144f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:38:57 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-305bfc16-b38c-4417-8ca6-10b55492ee53 tempest-ProjectReaderTests-510915641 None] Flow 'volume_create_manager' (c7f48708-cf0a-4a8f-a2e1-52ed104b33f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:38:57 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-305bfc16-b38c-4417-8ca6-10b55492ee53 tempest-ProjectReaderTests-510915641 None] Created volume successfully. Sep 16 20:38:57 devstack sudo[106734]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:57 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-49451d82-7505-4b09-98fb-ab76ce2c223b tempest-ProjectReaderTests-2105386862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-6b659560-485c-4a1a-bd7b-e965d2e2227d.f3c7bd11-3a47-4cda-abf9-0e0f94680e80" returned: 0 in 0.301s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:57 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-49451d82-7505-4b09-98fb-ab76ce2c223b tempest-ProjectReaderTests-2105386862 None] Lock "cinder-quobyte-f3c7bd11-3a47-4cda-abf9-0e0f94680e80" released by "_delete_snapshot" :: held 1.742s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:38:57 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-49451d82-7505-4b09-98fb-ab76ce2c223b tempest-ProjectReaderTests-2105386862 None] Lock "cinder-quobyte-6b659560-485c-4a1a-bd7b-e965d2e2227d" released by "delete_snapshot" :: held 1.778s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:38:57 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-49451d82-7505-4b09-98fb-ab76ce2c223b tempest-ProjectReaderTests-2105386862 None] Created reservations ['d6b09e23-987a-4f35-8878-ae924ef1a08d', '21c51260-3a1b-4083-90b7-286b06e745c3', 'd081ec1f-f7dc-4be3-9bba-3ae70857bcf3', '9abd8246-1d4a-428f-b356-52792ae98f25'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:38:57 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-49451d82-7505-4b09-98fb-ab76ce2c223b tempest-ProjectReaderTests-2105386862 None] Delete snapshot completed successfully. Sep 16 20:38:57 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-49451d82-7505-4b09-98fb-ab76ce2c223b tempest-ProjectReaderTests-2105386862 None] Lock "cinder-f3c7bd11-3a47-4cda-abf9-0e0f94680e80-delete_snapshot" released by "delete_snapshot" :: held 1.965s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:38:57 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-fb516e8d-043e-48be-91b8-b94a7653998d tempest-ProjectMemberTests-730908627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:38:57 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-fb516e8d-043e-48be-91b8-b94a7653998d tempest-ProjectMemberTests-730908627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:38:57 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-fb516e8d-043e-48be-91b8-b94a7653998d tempest-ProjectMemberTests-730908627 None] Creating offline snapshot 9ae8b5e7-39da-4704-b4fe-74226b89f677 of volume 5ab6b2c0-318a-4e90-9f68-d48d93bc2f5a {{(pid=86188) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 20:38:57 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[685bf709-4e58-428e-9185-98ea86945bc6]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:38:57 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-fb516e8d-043e-48be-91b8-b94a7653998d tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-5ab6b2c0-318a-4e90-9f68-d48d93bc2f5a {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:58 devstack sudo[106738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-5ab6b2c0-318a-4e90-9f68-d48d93bc2f5a Sep 16 20:38:58 devstack sudo[106738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:58 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-d39ca34e-bc4b-48cd-8b5c-5425bb5796a1 tempest-ProjectReaderTests-2105386862 None] Acquiring lock "cinder-6b659560-485c-4a1a-bd7b-e965d2e2227d-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:38:58 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-d39ca34e-bc4b-48cd-8b5c-5425bb5796a1 tempest-ProjectReaderTests-2105386862 None] Lock "cinder-6b659560-485c-4a1a-bd7b-e965d2e2227d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:38:58 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-d39ca34e-bc4b-48cd-8b5c-5425bb5796a1 tempest-ProjectReaderTests-2105386862 None] Acquiring lock "cinder-quobyte-6b659560-485c-4a1a-bd7b-e965d2e2227d" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:38:58 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-d39ca34e-bc4b-48cd-8b5c-5425bb5796a1 tempest-ProjectReaderTests-2105386862 None] Lock "cinder-quobyte-6b659560-485c-4a1a-bd7b-e965d2e2227d" acquired by "delete_volume" :: waited 0.015s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:38:58 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[23444563-a1a5-4d58-99b1-f8b006e42a00]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:38:58 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-d39ca34e-bc4b-48cd-8b5c-5425bb5796a1 tempest-ProjectReaderTests-2105386862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-6b659560-485c-4a1a-bd7b-e965d2e2227d {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:58 devstack sudo[106740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-6b659560-485c-4a1a-bd7b-e965d2e2227d Sep 16 20:38:58 devstack sudo[106740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:58 devstack sudo[106738]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:58 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-fb516e8d-043e-48be-91b8-b94a7653998d tempest-ProjectMemberTests-730908627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-5ab6b2c0-318a-4e90-9f68-d48d93bc2f5a" returned: 0 in 0.382s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:58 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-fb516e8d-043e-48be-91b8-b94a7653998d tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-5ab6b2c0-318a-4e90-9f68-d48d93bc2f5a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-5ab6b2c0-318a-4e90-9f68-d48d93bc2f5a.9ae8b5e7-39da-4704-b4fe-74226b89f677 1G {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:58 devstack sudo[106745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-5ab6b2c0-318a-4e90-9f68-d48d93bc2f5a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-5ab6b2c0-318a-4e90-9f68-d48d93bc2f5a.9ae8b5e7-39da-4704-b4fe-74226b89f677 1G Sep 16 20:38:58 devstack sudo[106745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:58 devstack sudo[106740]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:58 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-d39ca34e-bc4b-48cd-8b5c-5425bb5796a1 tempest-ProjectReaderTests-2105386862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-6b659560-485c-4a1a-bd7b-e965d2e2227d" returned: 0 in 0.492s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:58 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-d39ca34e-bc4b-48cd-8b5c-5425bb5796a1 tempest-ProjectReaderTests-2105386862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-6b659560-485c-4a1a-bd7b-e965d2e2227d {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:58 devstack sudo[106752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-6b659560-485c-4a1a-bd7b-e965d2e2227d Sep 16 20:38:58 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-84fdc1dd-2a25-41bc-a1f0-d73c9df8e52f tempest-ProjectReaderTests-510915641 None] Acquiring lock "cinder-5efd8534-6a8d-4c75-8036-267984e62675-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:38:58 devstack sudo[106752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:58 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-84fdc1dd-2a25-41bc-a1f0-d73c9df8e52f tempest-ProjectReaderTests-510915641 None] Lock "cinder-5efd8534-6a8d-4c75-8036-267984e62675-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:38:58 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-84fdc1dd-2a25-41bc-a1f0-d73c9df8e52f tempest-ProjectReaderTests-510915641 None] Acquiring lock "cinder-quobyte-5efd8534-6a8d-4c75-8036-267984e62675" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:38:58 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-84fdc1dd-2a25-41bc-a1f0-d73c9df8e52f tempest-ProjectReaderTests-510915641 None] Lock "cinder-quobyte-5efd8534-6a8d-4c75-8036-267984e62675" acquired by "delete_volume" :: waited 0.017s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:38:58 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d5ffc07-058c-44c5-bc94-65a707a606fc]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:38:58 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-84fdc1dd-2a25-41bc-a1f0-d73c9df8e52f tempest-ProjectReaderTests-510915641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-5efd8534-6a8d-4c75-8036-267984e62675 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:59 devstack sudo[106752]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:59 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-d39ca34e-bc4b-48cd-8b5c-5425bb5796a1 tempest-ProjectReaderTests-2105386862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-6b659560-485c-4a1a-bd7b-e965d2e2227d" returned: 0 in 0.311s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:59 devstack sudo[106755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-5efd8534-6a8d-4c75-8036-267984e62675 Sep 16 20:38:59 devstack sudo[106755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:59 devstack sudo[106745]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:59 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-fb516e8d-043e-48be-91b8-b94a7653998d tempest-ProjectMemberTests-730908627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-5ab6b2c0-318a-4e90-9f68-d48d93bc2f5a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-5ab6b2c0-318a-4e90-9f68-d48d93bc2f5a.9ae8b5e7-39da-4704-b4fe-74226b89f677 1G" returned: 0 in 0.693s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:59 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-fb516e8d-043e-48be-91b8-b94a7653998d tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ab6b2c0-318a-4e90-9f68-d48d93bc2f5a -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-5ab6b2c0-318a-4e90-9f68-d48d93bc2f5a.9ae8b5e7-39da-4704-b4fe-74226b89f677 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:59 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-d39ca34e-bc4b-48cd-8b5c-5425bb5796a1 tempest-ProjectReaderTests-2105386862 None] Lock "cinder-quobyte-6b659560-485c-4a1a-bd7b-e965d2e2227d" released by "delete_volume" :: held 0.890s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:38:59 devstack sudo[106759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ab6b2c0-318a-4e90-9f68-d48d93bc2f5a -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-5ab6b2c0-318a-4e90-9f68-d48d93bc2f5a.9ae8b5e7-39da-4704-b4fe-74226b89f677 Sep 16 20:38:59 devstack sudo[106759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:59 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-d39ca34e-bc4b-48cd-8b5c-5425bb5796a1 tempest-ProjectReaderTests-2105386862 None] Created reservations ['9a1d87e8-0fdc-4fe1-bb10-7c8f5d30b22e', '0cda98d3-ced6-42e6-920b-8c4354d208f4', 'b43703c3-d771-4ff9-9d05-6a55def4600f', 'b50b1d42-9de4-4352-9720-bacb1b005b1f'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:38:59 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-d39ca34e-bc4b-48cd-8b5c-5425bb5796a1 tempest-ProjectReaderTests-2105386862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:38:59 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-d39ca34e-bc4b-48cd-8b5c-5425bb5796a1 tempest-ProjectReaderTests-2105386862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:38:59 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-d39ca34e-bc4b-48cd-8b5c-5425bb5796a1 tempest-ProjectReaderTests-2105386862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:38:59 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-d39ca34e-bc4b-48cd-8b5c-5425bb5796a1 tempest-ProjectReaderTests-2105386862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:38:59 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-d39ca34e-bc4b-48cd-8b5c-5425bb5796a1 tempest-ProjectReaderTests-2105386862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:38:59 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-d39ca34e-bc4b-48cd-8b5c-5425bb5796a1 tempest-ProjectReaderTests-2105386862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:59 devstack sudo[106763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:38:59 devstack sudo[106763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:59 devstack sudo[106755]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:59 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-84fdc1dd-2a25-41bc-a1f0-d73c9df8e52f tempest-ProjectReaderTests-510915641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-5efd8534-6a8d-4c75-8036-267984e62675" returned: 0 in 0.483s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:59 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-84fdc1dd-2a25-41bc-a1f0-d73c9df8e52f tempest-ProjectReaderTests-510915641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-5efd8534-6a8d-4c75-8036-267984e62675 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:59 devstack sudo[106768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-5efd8534-6a8d-4c75-8036-267984e62675 Sep 16 20:38:59 devstack sudo[106768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:59 devstack sudo[106759]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:59 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-fb516e8d-043e-48be-91b8-b94a7653998d tempest-ProjectMemberTests-730908627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ab6b2c0-318a-4e90-9f68-d48d93bc2f5a -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-5ab6b2c0-318a-4e90-9f68-d48d93bc2f5a.9ae8b5e7-39da-4704-b4fe-74226b89f677" returned: 0 in 0.431s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:59 devstack cinder-volume[86188]: WARNING cinder.volume.drivers.remotefs [None req-fb516e8d-043e-48be-91b8-b94a7653998d tempest-ProjectMemberTests-730908627 None] /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-5ab6b2c0-318a-4e90-9f68-d48d93bc2f5a.9ae8b5e7-39da-4704-b4fe-74226b89f677 is being set with open permissions: ugo+rw Sep 16 20:38:59 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-fb516e8d-043e-48be-91b8-b94a7653998d tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-5ab6b2c0-318a-4e90-9f68-d48d93bc2f5a.9ae8b5e7-39da-4704-b4fe-74226b89f677 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:59 devstack sudo[106773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-5ab6b2c0-318a-4e90-9f68-d48d93bc2f5a.9ae8b5e7-39da-4704-b4fe-74226b89f677 Sep 16 20:38:59 devstack sudo[106773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:38:59 devstack sudo[106763]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:59 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-d39ca34e-bc4b-48cd-8b5c-5425bb5796a1 tempest-ProjectReaderTests-2105386862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.352s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:59 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-d39ca34e-bc4b-48cd-8b5c-5425bb5796a1 tempest-ProjectReaderTests-2105386862 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:38:59 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-d39ca34e-bc4b-48cd-8b5c-5425bb5796a1 tempest-ProjectReaderTests-2105386862 None] Deleted volume successfully. Sep 16 20:38:59 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-d39ca34e-bc4b-48cd-8b5c-5425bb5796a1 tempest-ProjectReaderTests-2105386862 None] Lock "cinder-6b659560-485c-4a1a-bd7b-e965d2e2227d-delete_volume" released by "delete_volume" :: held 1.504s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:38:59 devstack sudo[106768]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:59 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-84fdc1dd-2a25-41bc-a1f0-d73c9df8e52f tempest-ProjectReaderTests-510915641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-5efd8534-6a8d-4c75-8036-267984e62675" returned: 0 in 0.348s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:59 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-84fdc1dd-2a25-41bc-a1f0-d73c9df8e52f tempest-ProjectReaderTests-510915641 None] Lock "cinder-quobyte-5efd8534-6a8d-4c75-8036-267984e62675" released by "delete_volume" :: held 0.890s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:38:59 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-84fdc1dd-2a25-41bc-a1f0-d73c9df8e52f tempest-ProjectReaderTests-510915641 None] Created reservations ['adc7ca84-7c37-42e2-a7f5-2a1c027aea65', 'c1a82f88-eded-4e41-aaff-164582c17ea3', 'fb06b5d9-3c99-485a-a5a2-dc344712815f', '9fa0c19e-80f8-40b8-a909-436335a7e314'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:38:59 devstack sudo[106773]: pam_unix(sudo:session): session closed for user root Sep 16 20:38:59 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-fb516e8d-043e-48be-91b8-b94a7653998d tempest-ProjectMemberTests-730908627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-5ab6b2c0-318a-4e90-9f68-d48d93bc2f5a.9ae8b5e7-39da-4704-b4fe-74226b89f677" returned: 0 in 0.361s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:38:59 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-fb516e8d-043e-48be-91b8-b94a7653998d tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-5ab6b2c0-318a-4e90-9f68-d48d93bc2f5a.info {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:38:59 devstack sudo[106778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-5ab6b2c0-318a-4e90-9f68-d48d93bc2f5a.info Sep 16 20:38:59 devstack sudo[106778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:00 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-84fdc1dd-2a25-41bc-a1f0-d73c9df8e52f tempest-ProjectReaderTests-510915641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:39:00 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-84fdc1dd-2a25-41bc-a1f0-d73c9df8e52f tempest-ProjectReaderTests-510915641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:39:00 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-84fdc1dd-2a25-41bc-a1f0-d73c9df8e52f tempest-ProjectReaderTests-510915641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:39:00 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-84fdc1dd-2a25-41bc-a1f0-d73c9df8e52f tempest-ProjectReaderTests-510915641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:39:00 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-84fdc1dd-2a25-41bc-a1f0-d73c9df8e52f tempest-ProjectReaderTests-510915641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:39:00 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-84fdc1dd-2a25-41bc-a1f0-d73c9df8e52f tempest-ProjectReaderTests-510915641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:00 devstack sudo[106780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:39:00 devstack sudo[106780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:00 devstack sudo[106778]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:00 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-fb516e8d-043e-48be-91b8-b94a7653998d tempest-ProjectMemberTests-730908627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-5ab6b2c0-318a-4e90-9f68-d48d93bc2f5a.info" returned: 0 in 0.402s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:00 devstack cinder-volume[86188]: WARNING cinder.volume.drivers.remotefs [None req-fb516e8d-043e-48be-91b8-b94a7653998d tempest-ProjectMemberTests-730908627 None] /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-5ab6b2c0-318a-4e90-9f68-d48d93bc2f5a.info is being set with open permissions: ugo+rw Sep 16 20:39:00 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-fb516e8d-043e-48be-91b8-b94a7653998d tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-5ab6b2c0-318a-4e90-9f68-d48d93bc2f5a.info {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:00 devstack sudo[106783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-5ab6b2c0-318a-4e90-9f68-d48d93bc2f5a.info Sep 16 20:39:00 devstack sudo[106783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:00 devstack sudo[106780]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:00 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-84fdc1dd-2a25-41bc-a1f0-d73c9df8e52f tempest-ProjectReaderTests-510915641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.432s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:00 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-84fdc1dd-2a25-41bc-a1f0-d73c9df8e52f tempest-ProjectReaderTests-510915641 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:39:00 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a5d6c82-3403-4a25-ae22-1bea65937d25 tempest-ProjectReaderTests-2105386862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:39:00 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-6a5d6c82-3403-4a25-ae22-1bea65937d25 tempest-ProjectReaderTests-2105386862 None] Flow 'volume_create_manager' (3798671b-c6c4-48fd-87a4-e9d3fad5071d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:39:00 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-6a5d6c82-3403-4a25-ae22-1bea65937d25 tempest-ProjectReaderTests-2105386862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7755402e-4982-46d1-805b-d26cfac2ead4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:39:00 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-84fdc1dd-2a25-41bc-a1f0-d73c9df8e52f tempest-ProjectReaderTests-510915641 None] Deleted volume successfully. Sep 16 20:39:00 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-6a5d6c82-3403-4a25-ae22-1bea65937d25 tempest-ProjectReaderTests-2105386862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7755402e-4982-46d1-805b-d26cfac2ead4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:39:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-903445210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddd885bf-02bc-4bf5-8162-d80eac80b06d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a1b5c8e359a4d699325f3e4049d8c93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:39:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:39:00Z,use_quota=True,user_id='af893a5c2de74fa596654573d674555d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:39:00 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-6a5d6c82-3403-4a25-ae22-1bea65937d25 tempest-ProjectReaderTests-2105386862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f86bd840-3c1d-4d23-a402-7a5fa6d48c86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:39:00 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-6a5d6c82-3403-4a25-ae22-1bea65937d25 tempest-ProjectReaderTests-2105386862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f86bd840-3c1d-4d23-a402-7a5fa6d48c86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:39:00 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-6a5d6c82-3403-4a25-ae22-1bea65937d25 tempest-ProjectReaderTests-2105386862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0de48b79-02e8-49a2-891e-48bc765579c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:39:00 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-6a5d6c82-3403-4a25-ae22-1bea65937d25 tempest-ProjectReaderTests-2105386862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0de48b79-02e8-49a2-891e-48bc765579c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ddd885bf-02bc-4bf5-8162-d80eac80b06d', 'volume_name': 'volume-ddd885bf-02bc-4bf5-8162-d80eac80b06d', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:39:00 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-6a5d6c82-3403-4a25-ae22-1bea65937d25 tempest-ProjectReaderTests-2105386862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aea9d902-602f-4cdb-bffa-31a52bb0a0f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:39:00 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-6a5d6c82-3403-4a25-ae22-1bea65937d25 tempest-ProjectReaderTests-2105386862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aea9d902-602f-4cdb-bffa-31a52bb0a0f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:39:00 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-6a5d6c82-3403-4a25-ae22-1bea65937d25 tempest-ProjectReaderTests-2105386862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df05893d-46c7-47c0-a687-2817ae86b1e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:39:00 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-6a5d6c82-3403-4a25-ae22-1bea65937d25 tempest-ProjectReaderTests-2105386862 None] Volume ddd885bf-02bc-4bf5-8162-d80eac80b06d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ddd885bf-02bc-4bf5-8162-d80eac80b06d', 'volume_size': 1} Sep 16 20:39:00 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-6a5d6c82-3403-4a25-ae22-1bea65937d25 tempest-ProjectReaderTests-2105386862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:39:00 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-84fdc1dd-2a25-41bc-a1f0-d73c9df8e52f tempest-ProjectReaderTests-510915641 None] Lock "cinder-5efd8534-6a8d-4c75-8036-267984e62675-delete_volume" released by "delete_volume" :: held 1.817s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:39:00 devstack sudo[106783]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:00 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-fb516e8d-043e-48be-91b8-b94a7653998d tempest-ProjectMemberTests-730908627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-5ab6b2c0-318a-4e90-9f68-d48d93bc2f5a.info" returned: 0 in 0.394s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:00 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-fb516e8d-043e-48be-91b8-b94a7653998d tempest-ProjectMemberTests-730908627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.792s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:39:00 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-6a5d6c82-3403-4a25-ae22-1bea65937d25 tempest-ProjectReaderTests-2105386862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.158s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:39:00 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-6a5d6c82-3403-4a25-ae22-1bea65937d25 tempest-ProjectReaderTests-2105386862 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:39:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-903445210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddd885bf-02bc-4bf5-8162-d80eac80b06d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a1b5c8e359a4d699325f3e4049d8c93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:39:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:39:00Z,use_quota=True,user_id='af893a5c2de74fa596654573d674555d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:39:00 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-6a5d6c82-3403-4a25-ae22-1bea65937d25 tempest-ProjectReaderTests-2105386862 None] Creating volume ddd885bf-02bc-4bf5-8162-d80eac80b06d {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:39:00 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-6a5d6c82-3403-4a25-ae22-1bea65937d25 tempest-ProjectReaderTests-2105386862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:39:00 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-6a5d6c82-3403-4a25-ae22-1bea65937d25 tempest-ProjectReaderTests-2105386862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:39:00 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-6a5d6c82-3403-4a25-ae22-1bea65937d25 tempest-ProjectReaderTests-2105386862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:39:00 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-6a5d6c82-3403-4a25-ae22-1bea65937d25 tempest-ProjectReaderTests-2105386862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:39:00 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-6a5d6c82-3403-4a25-ae22-1bea65937d25 tempest-ProjectReaderTests-2105386862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:39:00 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-6a5d6c82-3403-4a25-ae22-1bea65937d25 tempest-ProjectReaderTests-2105386862 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:39:00 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-6a5d6c82-3403-4a25-ae22-1bea65937d25 tempest-ProjectReaderTests-2105386862 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:39:00 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-6a5d6c82-3403-4a25-ae22-1bea65937d25 tempest-ProjectReaderTests-2105386862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ddd885bf-02bc-4bf5-8162-d80eac80b06d 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:00 devstack sudo[106787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ddd885bf-02bc-4bf5-8162-d80eac80b06d 1073741824 Sep 16 20:39:00 devstack sudo[106787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:00 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-fb516e8d-043e-48be-91b8-b94a7653998d tempest-ProjectMemberTests-730908627 None] Create snapshot completed successfully Sep 16 20:39:01 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-cf2a3976-8b39-4509-8a75-dfb345632225 tempest-ProjectMemberTests-730908627 None] Acquiring lock "cinder-9ae8b5e7-39da-4704-b4fe-74226b89f677-delete_snapshot" by "delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:39:01 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-cf2a3976-8b39-4509-8a75-dfb345632225 tempest-ProjectMemberTests-730908627 None] Lock "cinder-9ae8b5e7-39da-4704-b4fe-74226b89f677-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:39:01 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-cf2a3976-8b39-4509-8a75-dfb345632225 tempest-ProjectMemberTests-730908627 None] Acquiring lock "cinder-quobyte-5ab6b2c0-318a-4e90-9f68-d48d93bc2f5a" by "delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:39:01 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-cf2a3976-8b39-4509-8a75-dfb345632225 tempest-ProjectMemberTests-730908627 None] Lock "cinder-quobyte-5ab6b2c0-318a-4e90-9f68-d48d93bc2f5a" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:39:01 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-cf2a3976-8b39-4509-8a75-dfb345632225 tempest-ProjectMemberTests-730908627 None] Acquiring lock "cinder-quobyte-9ae8b5e7-39da-4704-b4fe-74226b89f677" by "_delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:39:01 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-cf2a3976-8b39-4509-8a75-dfb345632225 tempest-ProjectMemberTests-730908627 None] Lock "cinder-quobyte-9ae8b5e7-39da-4704-b4fe-74226b89f677" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:39:01 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-cf2a3976-8b39-4509-8a75-dfb345632225 tempest-ProjectMemberTests-730908627 None] Deleting offline snapshot 9ae8b5e7-39da-4704-b4fe-74226b89f677 of volume 5ab6b2c0-318a-4e90-9f68-d48d93bc2f5a {{(pid=86188) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 20:39:01 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-cf2a3976-8b39-4509-8a75-dfb345632225 tempest-ProjectMemberTests-730908627 None] snapshot_file for this snap is: volume-5ab6b2c0-318a-4e90-9f68-d48d93bc2f5a.9ae8b5e7-39da-4704-b4fe-74226b89f677 {{(pid=86188) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 20:39:01 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[06d14fb0-bc38-4d9b-9767-dcecd70874d1]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:39:01 devstack sudo[106787]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:01 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-cf2a3976-8b39-4509-8a75-dfb345632225 tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-5ab6b2c0-318a-4e90-9f68-d48d93bc2f5a.9ae8b5e7-39da-4704-b4fe-74226b89f677 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:01 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-6a5d6c82-3403-4a25-ae22-1bea65937d25 tempest-ProjectReaderTests-2105386862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ddd885bf-02bc-4bf5-8162-d80eac80b06d 1073741824" returned: 0 in 0.674s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:01 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-6a5d6c82-3403-4a25-ae22-1bea65937d25 tempest-ProjectReaderTests-2105386862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ddd885bf-02bc-4bf5-8162-d80eac80b06d {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:01 devstack sudo[106828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ddd885bf-02bc-4bf5-8162-d80eac80b06d Sep 16 20:39:01 devstack sudo[106828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:01 devstack sudo[106827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-5ab6b2c0-318a-4e90-9f68-d48d93bc2f5a.9ae8b5e7-39da-4704-b4fe-74226b89f677 Sep 16 20:39:01 devstack sudo[106827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:01 devstack sudo[106828]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:01 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-6a5d6c82-3403-4a25-ae22-1bea65937d25 tempest-ProjectReaderTests-2105386862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ddd885bf-02bc-4bf5-8162-d80eac80b06d" returned: 0 in 0.332s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:01 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-6a5d6c82-3403-4a25-ae22-1bea65937d25 tempest-ProjectReaderTests-2105386862 None] <== create_volume: return (1081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:39:01 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-6a5d6c82-3403-4a25-ae22-1bea65937d25 tempest-ProjectReaderTests-2105386862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.083s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:39:01 devstack sudo[106827]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:01 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-6a5d6c82-3403-4a25-ae22-1bea65937d25 tempest-ProjectReaderTests-2105386862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df05893d-46c7-47c0-a687-2817ae86b1e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ddd885bf-02bc-4bf5-8162-d80eac80b06d', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:39:01 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-6a5d6c82-3403-4a25-ae22-1bea65937d25 tempest-ProjectReaderTests-2105386862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6adb4780-d963-481e-a0cb-9488773750b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:39:01 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-cf2a3976-8b39-4509-8a75-dfb345632225 tempest-ProjectMemberTests-730908627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-5ab6b2c0-318a-4e90-9f68-d48d93bc2f5a.9ae8b5e7-39da-4704-b4fe-74226b89f677" returned: 0 in 0.516s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:01 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-cf2a3976-8b39-4509-8a75-dfb345632225 tempest-ProjectMemberTests-730908627 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5ab6b2c0-318a-4e90-9f68-d48d93bc2f5a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86188) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 20:39:01 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[125c0e8e-cd17-4b5f-a72e-606f7cfcefd0]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:39:01 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-cf2a3976-8b39-4509-8a75-dfb345632225 tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-5ab6b2c0-318a-4e90-9f68-d48d93bc2f5a {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:02 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-6a5d6c82-3403-4a25-ae22-1bea65937d25 tempest-ProjectReaderTests-2105386862 None] Volume volume-ddd885bf-02bc-4bf5-8162-d80eac80b06d (ddd885bf-02bc-4bf5-8162-d80eac80b06d): created successfully Sep 16 20:39:02 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-6a5d6c82-3403-4a25-ae22-1bea65937d25 tempest-ProjectReaderTests-2105386862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6adb4780-d963-481e-a0cb-9488773750b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:39:02 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-6a5d6c82-3403-4a25-ae22-1bea65937d25 tempest-ProjectReaderTests-2105386862 None] Flow 'volume_create_manager' (3798671b-c6c4-48fd-87a4-e9d3fad5071d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:39:02 devstack sudo[106837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-5ab6b2c0-318a-4e90-9f68-d48d93bc2f5a Sep 16 20:39:02 devstack sudo[106837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:02 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-6a5d6c82-3403-4a25-ae22-1bea65937d25 tempest-ProjectReaderTests-2105386862 None] Created volume successfully. Sep 16 20:39:02 devstack sudo[106837]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:02 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-cf2a3976-8b39-4509-8a75-dfb345632225 tempest-ProjectMemberTests-730908627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-5ab6b2c0-318a-4e90-9f68-d48d93bc2f5a" returned: 0 in 0.448s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:02 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-cf2a3976-8b39-4509-8a75-dfb345632225 tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-5ab6b2c0-318a-4e90-9f68-d48d93bc2f5a.9ae8b5e7-39da-4704-b4fe-74226b89f677 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:02 devstack sudo[106842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-5ab6b2c0-318a-4e90-9f68-d48d93bc2f5a.9ae8b5e7-39da-4704-b4fe-74226b89f677 Sep 16 20:39:02 devstack sudo[106842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:02 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-ce859f07-39e8-4ecf-b5e9-80b10baa1b18 tempest-ProjectReaderTests-2105386862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:39:02 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-ce859f07-39e8-4ecf-b5e9-80b10baa1b18 tempest-ProjectReaderTests-2105386862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:39:02 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-ce859f07-39e8-4ecf-b5e9-80b10baa1b18 tempest-ProjectReaderTests-2105386862 None] Creating offline snapshot c6055532-b08f-436f-94fd-cfb6eb15a228 of volume ddd885bf-02bc-4bf5-8162-d80eac80b06d {{(pid=86188) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 20:39:02 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c8ebceb-84bd-4719-884c-892a534b61dd]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:39:02 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ce859f07-39e8-4ecf-b5e9-80b10baa1b18 tempest-ProjectReaderTests-2105386862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ddd885bf-02bc-4bf5-8162-d80eac80b06d {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:02 devstack sudo[106846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ddd885bf-02bc-4bf5-8162-d80eac80b06d Sep 16 20:39:02 devstack sudo[106846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:02 devstack sudo[106842]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:02 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-cf2a3976-8b39-4509-8a75-dfb345632225 tempest-ProjectMemberTests-730908627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-5ab6b2c0-318a-4e90-9f68-d48d93bc2f5a.9ae8b5e7-39da-4704-b4fe-74226b89f677" returned: 0 in 0.507s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:02 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-cf2a3976-8b39-4509-8a75-dfb345632225 tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-5ab6b2c0-318a-4e90-9f68-d48d93bc2f5a.9ae8b5e7-39da-4704-b4fe-74226b89f677 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:02 devstack sudo[106850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-5ab6b2c0-318a-4e90-9f68-d48d93bc2f5a.9ae8b5e7-39da-4704-b4fe-74226b89f677 Sep 16 20:39:02 devstack sudo[106850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:03 devstack sudo[106846]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:03 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ce859f07-39e8-4ecf-b5e9-80b10baa1b18 tempest-ProjectReaderTests-2105386862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ddd885bf-02bc-4bf5-8162-d80eac80b06d" returned: 0 in 0.385s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:03 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ce859f07-39e8-4ecf-b5e9-80b10baa1b18 tempest-ProjectReaderTests-2105386862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ddd885bf-02bc-4bf5-8162-d80eac80b06d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ddd885bf-02bc-4bf5-8162-d80eac80b06d.c6055532-b08f-436f-94fd-cfb6eb15a228 1G {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:03 devstack sudo[106855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ddd885bf-02bc-4bf5-8162-d80eac80b06d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ddd885bf-02bc-4bf5-8162-d80eac80b06d.c6055532-b08f-436f-94fd-cfb6eb15a228 1G Sep 16 20:39:03 devstack sudo[106855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:03 devstack sudo[106850]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:03 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-cf2a3976-8b39-4509-8a75-dfb345632225 tempest-ProjectMemberTests-730908627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-5ab6b2c0-318a-4e90-9f68-d48d93bc2f5a.9ae8b5e7-39da-4704-b4fe-74226b89f677" returned: 0 in 0.274s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:03 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-cf2a3976-8b39-4509-8a75-dfb345632225 tempest-ProjectMemberTests-730908627 None] Lock "cinder-quobyte-9ae8b5e7-39da-4704-b4fe-74226b89f677" released by "_delete_snapshot" :: held 1.879s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:39:03 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-cf2a3976-8b39-4509-8a75-dfb345632225 tempest-ProjectMemberTests-730908627 None] Lock "cinder-quobyte-5ab6b2c0-318a-4e90-9f68-d48d93bc2f5a" released by "delete_snapshot" :: held 1.914s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:39:03 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-cf2a3976-8b39-4509-8a75-dfb345632225 tempest-ProjectMemberTests-730908627 None] Created reservations ['2bd77671-9892-462a-99d3-d89e27fc76ac', '23c91182-0f5e-49b4-8614-9188680e026a', 'b9a7c093-adc9-4544-ac85-c10c5e50ea45', 'd0c29567-f741-4d1a-801d-0f5259a74ac0'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:39:03 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-cf2a3976-8b39-4509-8a75-dfb345632225 tempest-ProjectMemberTests-730908627 None] Delete snapshot completed successfully. Sep 16 20:39:03 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-cf2a3976-8b39-4509-8a75-dfb345632225 tempest-ProjectMemberTests-730908627 None] Lock "cinder-9ae8b5e7-39da-4704-b4fe-74226b89f677-delete_snapshot" released by "delete_snapshot" :: held 2.074s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:39:03 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-828bd57a-b016-4045-aa00-1558ddaf5030 tempest-ProjectMemberTests-730908627 None] Acquiring lock "cinder-5ab6b2c0-318a-4e90-9f68-d48d93bc2f5a-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:39:03 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-828bd57a-b016-4045-aa00-1558ddaf5030 tempest-ProjectMemberTests-730908627 None] Lock "cinder-5ab6b2c0-318a-4e90-9f68-d48d93bc2f5a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:39:03 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-828bd57a-b016-4045-aa00-1558ddaf5030 tempest-ProjectMemberTests-730908627 None] Acquiring lock "cinder-quobyte-5ab6b2c0-318a-4e90-9f68-d48d93bc2f5a" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:39:03 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-828bd57a-b016-4045-aa00-1558ddaf5030 tempest-ProjectMemberTests-730908627 None] Lock "cinder-quobyte-5ab6b2c0-318a-4e90-9f68-d48d93bc2f5a" acquired by "delete_volume" :: waited 0.019s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:39:03 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[690cffec-26cb-4825-8121-09641da4c446]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:39:03 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-828bd57a-b016-4045-aa00-1558ddaf5030 tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-5ab6b2c0-318a-4e90-9f68-d48d93bc2f5a {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:03 devstack sudo[106855]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:03 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ce859f07-39e8-4ecf-b5e9-80b10baa1b18 tempest-ProjectReaderTests-2105386862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ddd885bf-02bc-4bf5-8162-d80eac80b06d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ddd885bf-02bc-4bf5-8162-d80eac80b06d.c6055532-b08f-436f-94fd-cfb6eb15a228 1G" returned: 0 in 0.459s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:03 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ce859f07-39e8-4ecf-b5e9-80b10baa1b18 tempest-ProjectReaderTests-2105386862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ddd885bf-02bc-4bf5-8162-d80eac80b06d -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ddd885bf-02bc-4bf5-8162-d80eac80b06d.c6055532-b08f-436f-94fd-cfb6eb15a228 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:03 devstack sudo[106863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ddd885bf-02bc-4bf5-8162-d80eac80b06d -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ddd885bf-02bc-4bf5-8162-d80eac80b06d.c6055532-b08f-436f-94fd-cfb6eb15a228 Sep 16 20:39:03 devstack sudo[106863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:03 devstack sudo[106862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-5ab6b2c0-318a-4e90-9f68-d48d93bc2f5a Sep 16 20:39:03 devstack sudo[106862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:03 devstack sudo[106863]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:03 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ce859f07-39e8-4ecf-b5e9-80b10baa1b18 tempest-ProjectReaderTests-2105386862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ddd885bf-02bc-4bf5-8162-d80eac80b06d -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ddd885bf-02bc-4bf5-8162-d80eac80b06d.c6055532-b08f-436f-94fd-cfb6eb15a228" returned: 0 in 0.279s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:03 devstack cinder-volume[86188]: WARNING cinder.volume.drivers.remotefs [None req-ce859f07-39e8-4ecf-b5e9-80b10baa1b18 tempest-ProjectReaderTests-2105386862 None] /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ddd885bf-02bc-4bf5-8162-d80eac80b06d.c6055532-b08f-436f-94fd-cfb6eb15a228 is being set with open permissions: ugo+rw Sep 16 20:39:03 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ce859f07-39e8-4ecf-b5e9-80b10baa1b18 tempest-ProjectReaderTests-2105386862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ddd885bf-02bc-4bf5-8162-d80eac80b06d.c6055532-b08f-436f-94fd-cfb6eb15a228 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:03 devstack sudo[106870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ddd885bf-02bc-4bf5-8162-d80eac80b06d.c6055532-b08f-436f-94fd-cfb6eb15a228 Sep 16 20:39:03 devstack sudo[106870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:03 devstack sudo[106862]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:03 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-828bd57a-b016-4045-aa00-1558ddaf5030 tempest-ProjectMemberTests-730908627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-5ab6b2c0-318a-4e90-9f68-d48d93bc2f5a" returned: 0 in 0.381s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:03 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-828bd57a-b016-4045-aa00-1558ddaf5030 tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-5ab6b2c0-318a-4e90-9f68-d48d93bc2f5a {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:03 devstack sudo[106874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-5ab6b2c0-318a-4e90-9f68-d48d93bc2f5a Sep 16 20:39:03 devstack sudo[106874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:04 devstack sudo[106870]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:04 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ce859f07-39e8-4ecf-b5e9-80b10baa1b18 tempest-ProjectReaderTests-2105386862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ddd885bf-02bc-4bf5-8162-d80eac80b06d.c6055532-b08f-436f-94fd-cfb6eb15a228" returned: 0 in 0.247s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:04 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ce859f07-39e8-4ecf-b5e9-80b10baa1b18 tempest-ProjectReaderTests-2105386862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ddd885bf-02bc-4bf5-8162-d80eac80b06d.info {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:04 devstack sudo[106877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ddd885bf-02bc-4bf5-8162-d80eac80b06d.info Sep 16 20:39:04 devstack sudo[106877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:04 devstack sudo[106874]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:04 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-828bd57a-b016-4045-aa00-1558ddaf5030 tempest-ProjectMemberTests-730908627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-5ab6b2c0-318a-4e90-9f68-d48d93bc2f5a" returned: 0 in 0.250s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:04 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-828bd57a-b016-4045-aa00-1558ddaf5030 tempest-ProjectMemberTests-730908627 None] Lock "cinder-quobyte-5ab6b2c0-318a-4e90-9f68-d48d93bc2f5a" released by "delete_volume" :: held 0.695s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:39:04 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-828bd57a-b016-4045-aa00-1558ddaf5030 tempest-ProjectMemberTests-730908627 None] Created reservations ['85172d8e-888a-4301-8a76-4d189ff720d4', '1abb088b-c890-4673-bf2f-af3d528a2267', '96213abe-83c3-4ed9-a6ca-a7969e8e510c', '628a0356-35db-4f34-ab89-4120e341a92e'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:39:04 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-828bd57a-b016-4045-aa00-1558ddaf5030 tempest-ProjectMemberTests-730908627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:39:04 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-828bd57a-b016-4045-aa00-1558ddaf5030 tempest-ProjectMemberTests-730908627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:39:04 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-828bd57a-b016-4045-aa00-1558ddaf5030 tempest-ProjectMemberTests-730908627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:39:04 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-828bd57a-b016-4045-aa00-1558ddaf5030 tempest-ProjectMemberTests-730908627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:39:04 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-828bd57a-b016-4045-aa00-1558ddaf5030 tempest-ProjectMemberTests-730908627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:39:04 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-828bd57a-b016-4045-aa00-1558ddaf5030 tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:04 devstack sudo[106881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:39:04 devstack sudo[106881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:04 devstack sudo[106877]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:04 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ce859f07-39e8-4ecf-b5e9-80b10baa1b18 tempest-ProjectReaderTests-2105386862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ddd885bf-02bc-4bf5-8162-d80eac80b06d.info" returned: 0 in 0.258s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:04 devstack cinder-volume[86188]: WARNING cinder.volume.drivers.remotefs [None req-ce859f07-39e8-4ecf-b5e9-80b10baa1b18 tempest-ProjectReaderTests-2105386862 None] /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ddd885bf-02bc-4bf5-8162-d80eac80b06d.info is being set with open permissions: ugo+rw Sep 16 20:39:04 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ce859f07-39e8-4ecf-b5e9-80b10baa1b18 tempest-ProjectReaderTests-2105386862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ddd885bf-02bc-4bf5-8162-d80eac80b06d.info {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:04 devstack sudo[106883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ddd885bf-02bc-4bf5-8162-d80eac80b06d.info Sep 16 20:39:04 devstack sudo[106883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:04 devstack sudo[106881]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:04 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-828bd57a-b016-4045-aa00-1558ddaf5030 tempest-ProjectMemberTests-730908627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.251s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:04 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-828bd57a-b016-4045-aa00-1558ddaf5030 tempest-ProjectMemberTests-730908627 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:39:04 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-828bd57a-b016-4045-aa00-1558ddaf5030 tempest-ProjectMemberTests-730908627 None] Deleted volume successfully. Sep 16 20:39:04 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-828bd57a-b016-4045-aa00-1558ddaf5030 tempest-ProjectMemberTests-730908627 None] Lock "cinder-5ab6b2c0-318a-4e90-9f68-d48d93bc2f5a-delete_volume" released by "delete_volume" :: held 1.181s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:39:04 devstack sudo[106883]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:04 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-ce859f07-39e8-4ecf-b5e9-80b10baa1b18 tempest-ProjectReaderTests-2105386862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ddd885bf-02bc-4bf5-8162-d80eac80b06d.info" returned: 0 in 0.270s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:04 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-ce859f07-39e8-4ecf-b5e9-80b10baa1b18 tempest-ProjectReaderTests-2105386862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:39:04 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-ce859f07-39e8-4ecf-b5e9-80b10baa1b18 tempest-ProjectReaderTests-2105386862 None] Create snapshot completed successfully Sep 16 20:39:04 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-e26783ca-e166-41ea-b09b-6eaff85e35b6 tempest-ProjectReaderTests-2105386862 None] Acquiring lock "cinder-c6055532-b08f-436f-94fd-cfb6eb15a228-delete_snapshot" by "delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:39:04 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-e26783ca-e166-41ea-b09b-6eaff85e35b6 tempest-ProjectReaderTests-2105386862 None] Lock "cinder-c6055532-b08f-436f-94fd-cfb6eb15a228-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:39:04 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-e26783ca-e166-41ea-b09b-6eaff85e35b6 tempest-ProjectReaderTests-2105386862 None] Acquiring lock "cinder-quobyte-ddd885bf-02bc-4bf5-8162-d80eac80b06d" by "delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:39:04 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-e26783ca-e166-41ea-b09b-6eaff85e35b6 tempest-ProjectReaderTests-2105386862 None] Lock "cinder-quobyte-ddd885bf-02bc-4bf5-8162-d80eac80b06d" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:39:04 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-e26783ca-e166-41ea-b09b-6eaff85e35b6 tempest-ProjectReaderTests-2105386862 None] Acquiring lock "cinder-quobyte-c6055532-b08f-436f-94fd-cfb6eb15a228" by "_delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:39:04 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-e26783ca-e166-41ea-b09b-6eaff85e35b6 tempest-ProjectReaderTests-2105386862 None] Lock "cinder-quobyte-c6055532-b08f-436f-94fd-cfb6eb15a228" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:39:04 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-e26783ca-e166-41ea-b09b-6eaff85e35b6 tempest-ProjectReaderTests-2105386862 None] Deleting offline snapshot c6055532-b08f-436f-94fd-cfb6eb15a228 of volume ddd885bf-02bc-4bf5-8162-d80eac80b06d {{(pid=86188) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 20:39:04 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-e26783ca-e166-41ea-b09b-6eaff85e35b6 tempest-ProjectReaderTests-2105386862 None] snapshot_file for this snap is: volume-ddd885bf-02bc-4bf5-8162-d80eac80b06d.c6055532-b08f-436f-94fd-cfb6eb15a228 {{(pid=86188) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 20:39:04 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[80051fdd-d02a-4ec7-909a-82f6a859fbd6]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:39:04 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e26783ca-e166-41ea-b09b-6eaff85e35b6 tempest-ProjectReaderTests-2105386862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ddd885bf-02bc-4bf5-8162-d80eac80b06d.c6055532-b08f-436f-94fd-cfb6eb15a228 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:05 devstack sudo[106888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ddd885bf-02bc-4bf5-8162-d80eac80b06d.c6055532-b08f-436f-94fd-cfb6eb15a228 Sep 16 20:39:05 devstack sudo[106888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:05 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-22ac26eb-5092-49f4-9037-143184a191ae tempest-ProjectMemberTests-730908627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:39:05 devstack sudo[106888]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:05 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-22ac26eb-5092-49f4-9037-143184a191ae tempest-ProjectMemberTests-730908627 None] Flow 'volume_create_manager' (b3f0d930-e817-4882-bbae-1568d6969417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:39:05 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-22ac26eb-5092-49f4-9037-143184a191ae tempest-ProjectMemberTests-730908627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (349f37c3-ca5f-4806-bc4c-e58b007c3e6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:39:05 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e26783ca-e166-41ea-b09b-6eaff85e35b6 tempest-ProjectReaderTests-2105386862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ddd885bf-02bc-4bf5-8162-d80eac80b06d.c6055532-b08f-436f-94fd-cfb6eb15a228" returned: 0 in 0.439s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:05 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-e26783ca-e166-41ea-b09b-6eaff85e35b6 tempest-ProjectReaderTests-2105386862 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ddd885bf-02bc-4bf5-8162-d80eac80b06d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86188) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 20:39:05 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-22ac26eb-5092-49f4-9037-143184a191ae tempest-ProjectMemberTests-730908627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (349f37c3-ca5f-4806-bc4c-e58b007c3e6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:39:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1638943570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d79febb4-f286-4043-971a-5fe77b4cd807,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d632f989377844f6b93c3b9bf838981d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:39:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:39:05Z,use_quota=True,user_id='5db8cf25fcc448629ab58c8006482185',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:39:05 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-22ac26eb-5092-49f4-9037-143184a191ae tempest-ProjectMemberTests-730908627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c146f35f-4e2f-42bf-b334-d778be46146c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:39:05 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-22ac26eb-5092-49f4-9037-143184a191ae tempest-ProjectMemberTests-730908627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c146f35f-4e2f-42bf-b334-d778be46146c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:39:05 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-22ac26eb-5092-49f4-9037-143184a191ae tempest-ProjectMemberTests-730908627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72f0e5dc-35ed-4325-b797-9955b78ffdea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:39:05 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-22ac26eb-5092-49f4-9037-143184a191ae tempest-ProjectMemberTests-730908627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72f0e5dc-35ed-4325-b797-9955b78ffdea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd79febb4-f286-4043-971a-5fe77b4cd807', 'volume_name': 'volume-d79febb4-f286-4043-971a-5fe77b4cd807', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:39:05 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-22ac26eb-5092-49f4-9037-143184a191ae tempest-ProjectMemberTests-730908627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dda46950-5db9-4390-a08b-b206d2f63e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:39:05 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-22ac26eb-5092-49f4-9037-143184a191ae tempest-ProjectMemberTests-730908627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dda46950-5db9-4390-a08b-b206d2f63e06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:39:05 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-22ac26eb-5092-49f4-9037-143184a191ae tempest-ProjectMemberTests-730908627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (931d8d88-e5f2-4bdd-9229-23c7e7a5692a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:39:05 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-22ac26eb-5092-49f4-9037-143184a191ae tempest-ProjectMemberTests-730908627 None] Volume d79febb4-f286-4043-971a-5fe77b4cd807: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d79febb4-f286-4043-971a-5fe77b4cd807', 'volume_size': 1} Sep 16 20:39:05 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-22ac26eb-5092-49f4-9037-143184a191ae tempest-ProjectMemberTests-730908627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:39:05 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-22ac26eb-5092-49f4-9037-143184a191ae tempest-ProjectMemberTests-730908627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:39:05 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-22ac26eb-5092-49f4-9037-143184a191ae tempest-ProjectMemberTests-730908627 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:39:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1638943570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d79febb4-f286-4043-971a-5fe77b4cd807,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d632f989377844f6b93c3b9bf838981d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:39:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:39:05Z,use_quota=True,user_id='5db8cf25fcc448629ab58c8006482185',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:39:05 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-22ac26eb-5092-49f4-9037-143184a191ae tempest-ProjectMemberTests-730908627 None] Creating volume d79febb4-f286-4043-971a-5fe77b4cd807 {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:39:05 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-22ac26eb-5092-49f4-9037-143184a191ae tempest-ProjectMemberTests-730908627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:39:05 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-22ac26eb-5092-49f4-9037-143184a191ae tempest-ProjectMemberTests-730908627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:39:05 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-22ac26eb-5092-49f4-9037-143184a191ae tempest-ProjectMemberTests-730908627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:39:05 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-22ac26eb-5092-49f4-9037-143184a191ae tempest-ProjectMemberTests-730908627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:39:05 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-22ac26eb-5092-49f4-9037-143184a191ae tempest-ProjectMemberTests-730908627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:39:05 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-22ac26eb-5092-49f4-9037-143184a191ae tempest-ProjectMemberTests-730908627 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:39:05 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-22ac26eb-5092-49f4-9037-143184a191ae tempest-ProjectMemberTests-730908627 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:39:05 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-22ac26eb-5092-49f4-9037-143184a191ae tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d79febb4-f286-4043-971a-5fe77b4cd807 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:05 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bf42920-b8b3-4334-85a9-92098239b8ed]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:39:05 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e26783ca-e166-41ea-b09b-6eaff85e35b6 tempest-ProjectReaderTests-2105386862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ddd885bf-02bc-4bf5-8162-d80eac80b06d {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:05 devstack sudo[106899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d79febb4-f286-4043-971a-5fe77b4cd807 1073741824 Sep 16 20:39:05 devstack sudo[106899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:05 devstack sudo[106900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ddd885bf-02bc-4bf5-8162-d80eac80b06d Sep 16 20:39:05 devstack sudo[106900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:05 devstack sudo[106900]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:05 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e26783ca-e166-41ea-b09b-6eaff85e35b6 tempest-ProjectReaderTests-2105386862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ddd885bf-02bc-4bf5-8162-d80eac80b06d" returned: 0 in 0.364s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:05 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e26783ca-e166-41ea-b09b-6eaff85e35b6 tempest-ProjectReaderTests-2105386862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ddd885bf-02bc-4bf5-8162-d80eac80b06d.c6055532-b08f-436f-94fd-cfb6eb15a228 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:05 devstack sudo[106911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ddd885bf-02bc-4bf5-8162-d80eac80b06d.c6055532-b08f-436f-94fd-cfb6eb15a228 Sep 16 20:39:05 devstack sudo[106911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:05 devstack sudo[106899]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:05 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-22ac26eb-5092-49f4-9037-143184a191ae tempest-ProjectMemberTests-730908627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d79febb4-f286-4043-971a-5fe77b4cd807 1073741824" returned: 0 in 0.428s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:05 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-22ac26eb-5092-49f4-9037-143184a191ae tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d79febb4-f286-4043-971a-5fe77b4cd807 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:05 devstack sudo[106913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d79febb4-f286-4043-971a-5fe77b4cd807 Sep 16 20:39:05 devstack sudo[106913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:06 devstack sudo[106911]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:06 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e26783ca-e166-41ea-b09b-6eaff85e35b6 tempest-ProjectReaderTests-2105386862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ddd885bf-02bc-4bf5-8162-d80eac80b06d.c6055532-b08f-436f-94fd-cfb6eb15a228" returned: 0 in 0.330s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:06 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e26783ca-e166-41ea-b09b-6eaff85e35b6 tempest-ProjectReaderTests-2105386862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ddd885bf-02bc-4bf5-8162-d80eac80b06d.c6055532-b08f-436f-94fd-cfb6eb15a228 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:06 devstack sudo[106919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ddd885bf-02bc-4bf5-8162-d80eac80b06d.c6055532-b08f-436f-94fd-cfb6eb15a228 Sep 16 20:39:06 devstack sudo[106919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:06 devstack sudo[106913]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:06 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-22ac26eb-5092-49f4-9037-143184a191ae tempest-ProjectMemberTests-730908627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d79febb4-f286-4043-971a-5fe77b4cd807" returned: 0 in 0.261s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:06 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-22ac26eb-5092-49f4-9037-143184a191ae tempest-ProjectMemberTests-730908627 None] <== create_volume: return (755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:39:06 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-22ac26eb-5092-49f4-9037-143184a191ae tempest-ProjectMemberTests-730908627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.759s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:39:06 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-22ac26eb-5092-49f4-9037-143184a191ae tempest-ProjectMemberTests-730908627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (931d8d88-e5f2-4bdd-9229-23c7e7a5692a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d79febb4-f286-4043-971a-5fe77b4cd807', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:39:06 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-22ac26eb-5092-49f4-9037-143184a191ae tempest-ProjectMemberTests-730908627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3637b4c8-fcaf-407d-80cb-3a69a30fc680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:39:06 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-22ac26eb-5092-49f4-9037-143184a191ae tempest-ProjectMemberTests-730908627 None] Volume volume-d79febb4-f286-4043-971a-5fe77b4cd807 (d79febb4-f286-4043-971a-5fe77b4cd807): created successfully Sep 16 20:39:06 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-22ac26eb-5092-49f4-9037-143184a191ae tempest-ProjectMemberTests-730908627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3637b4c8-fcaf-407d-80cb-3a69a30fc680) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:39:06 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-22ac26eb-5092-49f4-9037-143184a191ae tempest-ProjectMemberTests-730908627 None] Flow 'volume_create_manager' (b3f0d930-e817-4882-bbae-1568d6969417) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:39:06 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-22ac26eb-5092-49f4-9037-143184a191ae tempest-ProjectMemberTests-730908627 None] Created volume successfully. Sep 16 20:39:06 devstack sudo[106919]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:06 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-e26783ca-e166-41ea-b09b-6eaff85e35b6 tempest-ProjectReaderTests-2105386862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ddd885bf-02bc-4bf5-8162-d80eac80b06d.c6055532-b08f-436f-94fd-cfb6eb15a228" returned: 0 in 0.251s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:06 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-e26783ca-e166-41ea-b09b-6eaff85e35b6 tempest-ProjectReaderTests-2105386862 None] Lock "cinder-quobyte-c6055532-b08f-436f-94fd-cfb6eb15a228" released by "_delete_snapshot" :: held 1.540s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:39:06 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-e26783ca-e166-41ea-b09b-6eaff85e35b6 tempest-ProjectReaderTests-2105386862 None] Lock "cinder-quobyte-ddd885bf-02bc-4bf5-8162-d80eac80b06d" released by "delete_snapshot" :: held 1.562s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:39:06 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-e26783ca-e166-41ea-b09b-6eaff85e35b6 tempest-ProjectReaderTests-2105386862 None] Created reservations ['313217da-1426-493e-8899-f6d6c5256705', 'edf01a45-834d-431a-8ac5-e2805fc9d95e', 'c44d0d7c-d9af-4d72-8da9-59792bd1b3d4', 'e1ba17ff-4a7a-4fa4-9721-061d301b14dc'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:39:06 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-e26783ca-e166-41ea-b09b-6eaff85e35b6 tempest-ProjectReaderTests-2105386862 None] Delete snapshot completed successfully. Sep 16 20:39:06 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-e26783ca-e166-41ea-b09b-6eaff85e35b6 tempest-ProjectReaderTests-2105386862 None] Lock "cinder-c6055532-b08f-436f-94fd-cfb6eb15a228-delete_snapshot" released by "delete_snapshot" :: held 1.694s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:39:07 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-3f9cabc6-e52c-4d23-b132-1e74caecf764 tempest-ProjectReaderTests-2105386862 None] Acquiring lock "cinder-ddd885bf-02bc-4bf5-8162-d80eac80b06d-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:39:07 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-3f9cabc6-e52c-4d23-b132-1e74caecf764 tempest-ProjectReaderTests-2105386862 None] Lock "cinder-ddd885bf-02bc-4bf5-8162-d80eac80b06d-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:39:07 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-3f9cabc6-e52c-4d23-b132-1e74caecf764 tempest-ProjectReaderTests-2105386862 None] Acquiring lock "cinder-quobyte-ddd885bf-02bc-4bf5-8162-d80eac80b06d" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:39:07 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-3f9cabc6-e52c-4d23-b132-1e74caecf764 tempest-ProjectReaderTests-2105386862 None] Lock "cinder-quobyte-ddd885bf-02bc-4bf5-8162-d80eac80b06d" acquired by "delete_volume" :: waited 0.015s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:39:07 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[46e0e5f4-ab8c-4cd5-8246-2b7210da780d]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:39:07 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-3f9cabc6-e52c-4d23-b132-1e74caecf764 tempest-ProjectReaderTests-2105386862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ddd885bf-02bc-4bf5-8162-d80eac80b06d {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:07 devstack sudo[106924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ddd885bf-02bc-4bf5-8162-d80eac80b06d Sep 16 20:39:07 devstack sudo[106924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:07 devstack sudo[106924]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:07 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-3f9cabc6-e52c-4d23-b132-1e74caecf764 tempest-ProjectReaderTests-2105386862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ddd885bf-02bc-4bf5-8162-d80eac80b06d" returned: 0 in 0.377s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:07 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-3f9cabc6-e52c-4d23-b132-1e74caecf764 tempest-ProjectReaderTests-2105386862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ddd885bf-02bc-4bf5-8162-d80eac80b06d {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:07 devstack sudo[106929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ddd885bf-02bc-4bf5-8162-d80eac80b06d Sep 16 20:39:07 devstack sudo[106929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:07 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-0abb4117-3a05-46d7-b1fb-5d454f7b2780 tempest-ProjectMemberTests-730908627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:39:07 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-0abb4117-3a05-46d7-b1fb-5d454f7b2780 tempest-ProjectMemberTests-730908627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:39:07 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-0abb4117-3a05-46d7-b1fb-5d454f7b2780 tempest-ProjectMemberTests-730908627 None] Creating offline snapshot 57120fa8-555f-4505-9314-845d788b36fc of volume d79febb4-f286-4043-971a-5fe77b4cd807 {{(pid=86188) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 20:39:07 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab2da6d0-040f-43da-9e0f-4383913144b8]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:39:07 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-0abb4117-3a05-46d7-b1fb-5d454f7b2780 tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d79febb4-f286-4043-971a-5fe77b4cd807 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:07 devstack sudo[106931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d79febb4-f286-4043-971a-5fe77b4cd807 Sep 16 20:39:07 devstack sudo[106931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:07 devstack sudo[106929]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:07 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-3f9cabc6-e52c-4d23-b132-1e74caecf764 tempest-ProjectReaderTests-2105386862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-ddd885bf-02bc-4bf5-8162-d80eac80b06d" returned: 0 in 0.262s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:07 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-3f9cabc6-e52c-4d23-b132-1e74caecf764 tempest-ProjectReaderTests-2105386862 None] Lock "cinder-quobyte-ddd885bf-02bc-4bf5-8162-d80eac80b06d" released by "delete_volume" :: held 0.701s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:39:07 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-3f9cabc6-e52c-4d23-b132-1e74caecf764 tempest-ProjectReaderTests-2105386862 None] Created reservations ['00eda7bd-ba0d-44ad-83ae-b0acfee2d8b3', '919a4034-cb89-4f55-adc8-f572cf9579c1', 'dab30f02-74d3-48eb-a2de-bdbe631a2b60', '553b7d2f-366d-4d89-8c6e-b4cdf99530a6'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:39:07 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-3f9cabc6-e52c-4d23-b132-1e74caecf764 tempest-ProjectReaderTests-2105386862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:39:07 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-3f9cabc6-e52c-4d23-b132-1e74caecf764 tempest-ProjectReaderTests-2105386862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:39:07 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-3f9cabc6-e52c-4d23-b132-1e74caecf764 tempest-ProjectReaderTests-2105386862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:39:07 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-3f9cabc6-e52c-4d23-b132-1e74caecf764 tempest-ProjectReaderTests-2105386862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:39:07 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-3f9cabc6-e52c-4d23-b132-1e74caecf764 tempest-ProjectReaderTests-2105386862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:39:07 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-3f9cabc6-e52c-4d23-b132-1e74caecf764 tempest-ProjectReaderTests-2105386862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:07 devstack sudo[106936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:39:07 devstack sudo[106936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:07 devstack sudo[106931]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:07 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-0abb4117-3a05-46d7-b1fb-5d454f7b2780 tempest-ProjectMemberTests-730908627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d79febb4-f286-4043-971a-5fe77b4cd807" returned: 0 in 0.381s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:07 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-0abb4117-3a05-46d7-b1fb-5d454f7b2780 tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d79febb4-f286-4043-971a-5fe77b4cd807,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d79febb4-f286-4043-971a-5fe77b4cd807.57120fa8-555f-4505-9314-845d788b36fc 1G {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:08 devstack sudo[106939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d79febb4-f286-4043-971a-5fe77b4cd807,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d79febb4-f286-4043-971a-5fe77b4cd807.57120fa8-555f-4505-9314-845d788b36fc 1G Sep 16 20:39:08 devstack sudo[106939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:08 devstack sudo[106936]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:08 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-3f9cabc6-e52c-4d23-b132-1e74caecf764 tempest-ProjectReaderTests-2105386862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.258s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:08 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-3f9cabc6-e52c-4d23-b132-1e74caecf764 tempest-ProjectReaderTests-2105386862 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:39:08 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-3f9cabc6-e52c-4d23-b132-1e74caecf764 tempest-ProjectReaderTests-2105386862 None] Deleted volume successfully. Sep 16 20:39:08 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-3f9cabc6-e52c-4d23-b132-1e74caecf764 tempest-ProjectReaderTests-2105386862 None] Lock "cinder-ddd885bf-02bc-4bf5-8162-d80eac80b06d-delete_volume" released by "delete_volume" :: held 1.166s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:39:08 devstack sudo[106939]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:08 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-0abb4117-3a05-46d7-b1fb-5d454f7b2780 tempest-ProjectMemberTests-730908627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d79febb4-f286-4043-971a-5fe77b4cd807,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d79febb4-f286-4043-971a-5fe77b4cd807.57120fa8-555f-4505-9314-845d788b36fc 1G" returned: 0 in 0.450s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:08 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-0abb4117-3a05-46d7-b1fb-5d454f7b2780 tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d79febb4-f286-4043-971a-5fe77b4cd807 -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d79febb4-f286-4043-971a-5fe77b4cd807.57120fa8-555f-4505-9314-845d788b36fc {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:08 devstack sudo[106946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d79febb4-f286-4043-971a-5fe77b4cd807 -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d79febb4-f286-4043-971a-5fe77b4cd807.57120fa8-555f-4505-9314-845d788b36fc Sep 16 20:39:08 devstack sudo[106946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:08 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0093735-05b1-4c6f-99ae-7dd00fc26d0b tempest-ProjectReaderTests-2105386862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:39:08 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f0093735-05b1-4c6f-99ae-7dd00fc26d0b tempest-ProjectReaderTests-2105386862 None] Flow 'volume_create_manager' (0f4d6a44-6cb3-45fd-9b20-19452ea94231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:39:08 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f0093735-05b1-4c6f-99ae-7dd00fc26d0b tempest-ProjectReaderTests-2105386862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5b80191-5098-4726-887b-78391d133b7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:39:08 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f0093735-05b1-4c6f-99ae-7dd00fc26d0b tempest-ProjectReaderTests-2105386862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5b80191-5098-4726-887b-78391d133b7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:39:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-826375392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50304123-8b22-450f-b265-bb73f1cd6ff9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a1b5c8e359a4d699325f3e4049d8c93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:39:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:39:09Z,use_quota=True,user_id='af893a5c2de74fa596654573d674555d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:39:08 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f0093735-05b1-4c6f-99ae-7dd00fc26d0b tempest-ProjectReaderTests-2105386862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (825d75a1-92ec-49f1-b578-7de17edaf892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:39:08 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f0093735-05b1-4c6f-99ae-7dd00fc26d0b tempest-ProjectReaderTests-2105386862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (825d75a1-92ec-49f1-b578-7de17edaf892) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:39:08 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f0093735-05b1-4c6f-99ae-7dd00fc26d0b tempest-ProjectReaderTests-2105386862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb7d9ad7-330c-4e25-8d84-8ae18471b223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:39:08 devstack sudo[106946]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:08 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f0093735-05b1-4c6f-99ae-7dd00fc26d0b tempest-ProjectReaderTests-2105386862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb7d9ad7-330c-4e25-8d84-8ae18471b223) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50304123-8b22-450f-b265-bb73f1cd6ff9', 'volume_name': 'volume-50304123-8b22-450f-b265-bb73f1cd6ff9', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:39:08 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f0093735-05b1-4c6f-99ae-7dd00fc26d0b tempest-ProjectReaderTests-2105386862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2bb6c78-5dbf-4720-9f78-d84b0a815c75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:39:08 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f0093735-05b1-4c6f-99ae-7dd00fc26d0b tempest-ProjectReaderTests-2105386862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2bb6c78-5dbf-4720-9f78-d84b0a815c75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:39:08 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f0093735-05b1-4c6f-99ae-7dd00fc26d0b tempest-ProjectReaderTests-2105386862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a58e8e90-5c99-4a57-9b02-b1909932b60f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:39:08 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-f0093735-05b1-4c6f-99ae-7dd00fc26d0b tempest-ProjectReaderTests-2105386862 None] Volume 50304123-8b22-450f-b265-bb73f1cd6ff9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50304123-8b22-450f-b265-bb73f1cd6ff9', 'volume_size': 1} Sep 16 20:39:08 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-f0093735-05b1-4c6f-99ae-7dd00fc26d0b tempest-ProjectReaderTests-2105386862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:39:08 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-0abb4117-3a05-46d7-b1fb-5d454f7b2780 tempest-ProjectMemberTests-730908627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d79febb4-f286-4043-971a-5fe77b4cd807 -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d79febb4-f286-4043-971a-5fe77b4cd807.57120fa8-555f-4505-9314-845d788b36fc" returned: 0 in 0.325s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:08 devstack cinder-volume[86188]: WARNING cinder.volume.drivers.remotefs [None req-0abb4117-3a05-46d7-b1fb-5d454f7b2780 tempest-ProjectMemberTests-730908627 None] /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d79febb4-f286-4043-971a-5fe77b4cd807.57120fa8-555f-4505-9314-845d788b36fc is being set with open permissions: ugo+rw Sep 16 20:39:08 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-0abb4117-3a05-46d7-b1fb-5d454f7b2780 tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d79febb4-f286-4043-971a-5fe77b4cd807.57120fa8-555f-4505-9314-845d788b36fc {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:08 devstack sudo[106951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d79febb4-f286-4043-971a-5fe77b4cd807.57120fa8-555f-4505-9314-845d788b36fc Sep 16 20:39:08 devstack sudo[106951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:09 devstack sudo[106951]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:09 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-0abb4117-3a05-46d7-b1fb-5d454f7b2780 tempest-ProjectMemberTests-730908627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d79febb4-f286-4043-971a-5fe77b4cd807.57120fa8-555f-4505-9314-845d788b36fc" returned: 0 in 0.248s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:09 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-0abb4117-3a05-46d7-b1fb-5d454f7b2780 tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d79febb4-f286-4043-971a-5fe77b4cd807.info {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:09 devstack sudo[106954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d79febb4-f286-4043-971a-5fe77b4cd807.info Sep 16 20:39:09 devstack sudo[106954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:09 devstack sudo[106954]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:09 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-0abb4117-3a05-46d7-b1fb-5d454f7b2780 tempest-ProjectMemberTests-730908627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d79febb4-f286-4043-971a-5fe77b4cd807.info" returned: 0 in 0.242s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:09 devstack cinder-volume[86188]: WARNING cinder.volume.drivers.remotefs [None req-0abb4117-3a05-46d7-b1fb-5d454f7b2780 tempest-ProjectMemberTests-730908627 None] /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d79febb4-f286-4043-971a-5fe77b4cd807.info is being set with open permissions: ugo+rw Sep 16 20:39:09 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-0abb4117-3a05-46d7-b1fb-5d454f7b2780 tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d79febb4-f286-4043-971a-5fe77b4cd807.info {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:09 devstack sudo[106957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d79febb4-f286-4043-971a-5fe77b4cd807.info Sep 16 20:39:09 devstack sudo[106957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:09 devstack sudo[106957]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:09 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-0abb4117-3a05-46d7-b1fb-5d454f7b2780 tempest-ProjectMemberTests-730908627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d79febb4-f286-4043-971a-5fe77b4cd807.info" returned: 0 in 0.241s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:09 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-0abb4117-3a05-46d7-b1fb-5d454f7b2780 tempest-ProjectMemberTests-730908627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.966s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:39:09 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-f0093735-05b1-4c6f-99ae-7dd00fc26d0b tempest-ProjectReaderTests-2105386862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.776s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:39:09 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-f0093735-05b1-4c6f-99ae-7dd00fc26d0b tempest-ProjectReaderTests-2105386862 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:39:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-826375392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50304123-8b22-450f-b265-bb73f1cd6ff9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a1b5c8e359a4d699325f3e4049d8c93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:39:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:39:09Z,use_quota=True,user_id='af893a5c2de74fa596654573d674555d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:39:09 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-f0093735-05b1-4c6f-99ae-7dd00fc26d0b tempest-ProjectReaderTests-2105386862 None] Creating volume 50304123-8b22-450f-b265-bb73f1cd6ff9 {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:39:09 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-f0093735-05b1-4c6f-99ae-7dd00fc26d0b tempest-ProjectReaderTests-2105386862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:39:09 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-f0093735-05b1-4c6f-99ae-7dd00fc26d0b tempest-ProjectReaderTests-2105386862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:39:09 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-f0093735-05b1-4c6f-99ae-7dd00fc26d0b tempest-ProjectReaderTests-2105386862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:39:09 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-f0093735-05b1-4c6f-99ae-7dd00fc26d0b tempest-ProjectReaderTests-2105386862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:39:09 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-f0093735-05b1-4c6f-99ae-7dd00fc26d0b tempest-ProjectReaderTests-2105386862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:39:09 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-f0093735-05b1-4c6f-99ae-7dd00fc26d0b tempest-ProjectReaderTests-2105386862 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:39:09 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-f0093735-05b1-4c6f-99ae-7dd00fc26d0b tempest-ProjectReaderTests-2105386862 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:39:09 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f0093735-05b1-4c6f-99ae-7dd00fc26d0b tempest-ProjectReaderTests-2105386862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-50304123-8b22-450f-b265-bb73f1cd6ff9 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:09 devstack sudo[106961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-50304123-8b22-450f-b265-bb73f1cd6ff9 1073741824 Sep 16 20:39:09 devstack sudo[106961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:09 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-0abb4117-3a05-46d7-b1fb-5d454f7b2780 tempest-ProjectMemberTests-730908627 None] Create snapshot completed successfully Sep 16 20:39:09 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-3fbba480-47e3-4ac6-a18f-4c7bf4b19459 tempest-ProjectMemberTests-730908627 None] Acquiring lock "cinder-57120fa8-555f-4505-9314-845d788b36fc-delete_snapshot" by "delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:39:09 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-3fbba480-47e3-4ac6-a18f-4c7bf4b19459 tempest-ProjectMemberTests-730908627 None] Lock "cinder-57120fa8-555f-4505-9314-845d788b36fc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:39:09 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-3fbba480-47e3-4ac6-a18f-4c7bf4b19459 tempest-ProjectMemberTests-730908627 None] Acquiring lock "cinder-quobyte-d79febb4-f286-4043-971a-5fe77b4cd807" by "delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:39:09 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-3fbba480-47e3-4ac6-a18f-4c7bf4b19459 tempest-ProjectMemberTests-730908627 None] Lock "cinder-quobyte-d79febb4-f286-4043-971a-5fe77b4cd807" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:39:09 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-3fbba480-47e3-4ac6-a18f-4c7bf4b19459 tempest-ProjectMemberTests-730908627 None] Acquiring lock "cinder-quobyte-57120fa8-555f-4505-9314-845d788b36fc" by "_delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:39:09 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-3fbba480-47e3-4ac6-a18f-4c7bf4b19459 tempest-ProjectMemberTests-730908627 None] Lock "cinder-quobyte-57120fa8-555f-4505-9314-845d788b36fc" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:39:09 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-3fbba480-47e3-4ac6-a18f-4c7bf4b19459 tempest-ProjectMemberTests-730908627 None] Deleting offline snapshot 57120fa8-555f-4505-9314-845d788b36fc of volume d79febb4-f286-4043-971a-5fe77b4cd807 {{(pid=86188) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 20:39:09 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-3fbba480-47e3-4ac6-a18f-4c7bf4b19459 tempest-ProjectMemberTests-730908627 None] snapshot_file for this snap is: volume-d79febb4-f286-4043-971a-5fe77b4cd807.57120fa8-555f-4505-9314-845d788b36fc {{(pid=86188) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 20:39:09 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[7be1c9aa-5f3a-48b2-85e9-574b101ed615]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:39:09 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-3fbba480-47e3-4ac6-a18f-4c7bf4b19459 tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d79febb4-f286-4043-971a-5fe77b4cd807.57120fa8-555f-4505-9314-845d788b36fc {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:09 devstack sudo[106966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d79febb4-f286-4043-971a-5fe77b4cd807.57120fa8-555f-4505-9314-845d788b36fc Sep 16 20:39:09 devstack sudo[106966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:09 devstack sudo[106961]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:09 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f0093735-05b1-4c6f-99ae-7dd00fc26d0b tempest-ProjectReaderTests-2105386862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-50304123-8b22-450f-b265-bb73f1cd6ff9 1073741824" returned: 0 in 0.441s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:10 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f0093735-05b1-4c6f-99ae-7dd00fc26d0b tempest-ProjectReaderTests-2105386862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-50304123-8b22-450f-b265-bb73f1cd6ff9 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:10 devstack sudo[106969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-50304123-8b22-450f-b265-bb73f1cd6ff9 Sep 16 20:39:10 devstack sudo[106969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:10 devstack sudo[106966]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:10 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-3fbba480-47e3-4ac6-a18f-4c7bf4b19459 tempest-ProjectMemberTests-730908627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d79febb4-f286-4043-971a-5fe77b4cd807.57120fa8-555f-4505-9314-845d788b36fc" returned: 0 in 0.382s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:10 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-3fbba480-47e3-4ac6-a18f-4c7bf4b19459 tempest-ProjectMemberTests-730908627 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d79febb4-f286-4043-971a-5fe77b4cd807(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86188) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 20:39:10 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1ee8e2c-bfcb-4268-9451-1abd0e573132]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:39:10 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-3fbba480-47e3-4ac6-a18f-4c7bf4b19459 tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d79febb4-f286-4043-971a-5fe77b4cd807 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:10 devstack sudo[106969]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:10 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f0093735-05b1-4c6f-99ae-7dd00fc26d0b tempest-ProjectReaderTests-2105386862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-50304123-8b22-450f-b265-bb73f1cd6ff9" returned: 0 in 0.252s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:10 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-f0093735-05b1-4c6f-99ae-7dd00fc26d0b tempest-ProjectReaderTests-2105386862 None] <== create_volume: return (734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:39:10 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-f0093735-05b1-4c6f-99ae-7dd00fc26d0b tempest-ProjectReaderTests-2105386862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.738s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:39:10 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f0093735-05b1-4c6f-99ae-7dd00fc26d0b tempest-ProjectReaderTests-2105386862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a58e8e90-5c99-4a57-9b02-b1909932b60f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50304123-8b22-450f-b265-bb73f1cd6ff9', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:39:10 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f0093735-05b1-4c6f-99ae-7dd00fc26d0b tempest-ProjectReaderTests-2105386862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee76d062-1e84-4bdb-9218-ce8b52832a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:39:10 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-f0093735-05b1-4c6f-99ae-7dd00fc26d0b tempest-ProjectReaderTests-2105386862 None] Volume volume-50304123-8b22-450f-b265-bb73f1cd6ff9 (50304123-8b22-450f-b265-bb73f1cd6ff9): created successfully Sep 16 20:39:10 devstack sudo[106974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d79febb4-f286-4043-971a-5fe77b4cd807 Sep 16 20:39:10 devstack sudo[106974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:10 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f0093735-05b1-4c6f-99ae-7dd00fc26d0b tempest-ProjectReaderTests-2105386862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee76d062-1e84-4bdb-9218-ce8b52832a77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:39:10 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-f0093735-05b1-4c6f-99ae-7dd00fc26d0b tempest-ProjectReaderTests-2105386862 None] Flow 'volume_create_manager' (0f4d6a44-6cb3-45fd-9b20-19452ea94231) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:39:10 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-f0093735-05b1-4c6f-99ae-7dd00fc26d0b tempest-ProjectReaderTests-2105386862 None] Created volume successfully. Sep 16 20:39:10 devstack sudo[106974]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:10 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-3fbba480-47e3-4ac6-a18f-4c7bf4b19459 tempest-ProjectMemberTests-730908627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d79febb4-f286-4043-971a-5fe77b4cd807" returned: 0 in 0.350s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:10 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-3fbba480-47e3-4ac6-a18f-4c7bf4b19459 tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d79febb4-f286-4043-971a-5fe77b4cd807.57120fa8-555f-4505-9314-845d788b36fc {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:10 devstack sudo[106980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d79febb4-f286-4043-971a-5fe77b4cd807.57120fa8-555f-4505-9314-845d788b36fc Sep 16 20:39:10 devstack sudo[106980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:10 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-eea825ba-da6e-4446-8557-d8ac2419f045 tempest-ProjectReaderTests-2105386862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:39:10 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-eea825ba-da6e-4446-8557-d8ac2419f045 tempest-ProjectReaderTests-2105386862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:39:10 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-eea825ba-da6e-4446-8557-d8ac2419f045 tempest-ProjectReaderTests-2105386862 None] Creating offline snapshot 477fdc43-514f-46f9-9100-f1e57b865352 of volume 50304123-8b22-450f-b265-bb73f1cd6ff9 {{(pid=86188) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 20:39:10 devstack sudo[106980]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:10 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-3fbba480-47e3-4ac6-a18f-4c7bf4b19459 tempest-ProjectMemberTests-730908627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d79febb4-f286-4043-971a-5fe77b4cd807.57120fa8-555f-4505-9314-845d788b36fc" returned: 0 in 0.367s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:10 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-3fbba480-47e3-4ac6-a18f-4c7bf4b19459 tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d79febb4-f286-4043-971a-5fe77b4cd807.57120fa8-555f-4505-9314-845d788b36fc {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:10 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[61d20e17-ba7a-49b5-bde0-e4962ebae341]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:39:10 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-eea825ba-da6e-4446-8557-d8ac2419f045 tempest-ProjectReaderTests-2105386862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-50304123-8b22-450f-b265-bb73f1cd6ff9 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:10 devstack sudo[106986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d79febb4-f286-4043-971a-5fe77b4cd807.57120fa8-555f-4505-9314-845d788b36fc Sep 16 20:39:10 devstack sudo[106986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:11 devstack sudo[106987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-50304123-8b22-450f-b265-bb73f1cd6ff9 Sep 16 20:39:11 devstack sudo[106987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:11 devstack sudo[106986]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:11 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-3fbba480-47e3-4ac6-a18f-4c7bf4b19459 tempest-ProjectMemberTests-730908627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d79febb4-f286-4043-971a-5fe77b4cd807.57120fa8-555f-4505-9314-845d788b36fc" returned: 0 in 0.244s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:11 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-3fbba480-47e3-4ac6-a18f-4c7bf4b19459 tempest-ProjectMemberTests-730908627 None] Lock "cinder-quobyte-57120fa8-555f-4505-9314-845d788b36fc" released by "_delete_snapshot" :: held 1.437s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:39:11 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-3fbba480-47e3-4ac6-a18f-4c7bf4b19459 tempest-ProjectMemberTests-730908627 None] Lock "cinder-quobyte-d79febb4-f286-4043-971a-5fe77b4cd807" released by "delete_snapshot" :: held 1.459s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:39:11 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-3fbba480-47e3-4ac6-a18f-4c7bf4b19459 tempest-ProjectMemberTests-730908627 None] Created reservations ['c77d9e64-fb50-4391-8bdb-f43e0969fca8', '13efb78d-c893-437e-a5f0-48bbe35f4c02', '521d4b8d-a246-4f19-a7b9-c60b7d207f73', '9e9acf15-de53-48a4-9dcd-83f2dc073472'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:39:11 devstack sudo[106987]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:11 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-eea825ba-da6e-4446-8557-d8ac2419f045 tempest-ProjectReaderTests-2105386862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-50304123-8b22-450f-b265-bb73f1cd6ff9" returned: 0 in 0.382s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:11 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-eea825ba-da6e-4446-8557-d8ac2419f045 tempest-ProjectReaderTests-2105386862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-50304123-8b22-450f-b265-bb73f1cd6ff9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-50304123-8b22-450f-b265-bb73f1cd6ff9.477fdc43-514f-46f9-9100-f1e57b865352 1G {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:11 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-3fbba480-47e3-4ac6-a18f-4c7bf4b19459 tempest-ProjectMemberTests-730908627 None] Delete snapshot completed successfully. Sep 16 20:39:11 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-3fbba480-47e3-4ac6-a18f-4c7bf4b19459 tempest-ProjectMemberTests-730908627 None] Lock "cinder-57120fa8-555f-4505-9314-845d788b36fc-delete_snapshot" released by "delete_snapshot" :: held 1.619s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:39:11 devstack sudo[106994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-50304123-8b22-450f-b265-bb73f1cd6ff9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-50304123-8b22-450f-b265-bb73f1cd6ff9.477fdc43-514f-46f9-9100-f1e57b865352 1G Sep 16 20:39:11 devstack sudo[106994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:11 devstack sudo[106994]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:11 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-eea825ba-da6e-4446-8557-d8ac2419f045 tempest-ProjectReaderTests-2105386862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-50304123-8b22-450f-b265-bb73f1cd6ff9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-50304123-8b22-450f-b265-bb73f1cd6ff9.477fdc43-514f-46f9-9100-f1e57b865352 1G" returned: 0 in 0.366s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:11 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-eea825ba-da6e-4446-8557-d8ac2419f045 tempest-ProjectReaderTests-2105386862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50304123-8b22-450f-b265-bb73f1cd6ff9 -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-50304123-8b22-450f-b265-bb73f1cd6ff9.477fdc43-514f-46f9-9100-f1e57b865352 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:11 devstack sudo[106999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50304123-8b22-450f-b265-bb73f1cd6ff9 -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-50304123-8b22-450f-b265-bb73f1cd6ff9.477fdc43-514f-46f9-9100-f1e57b865352 Sep 16 20:39:11 devstack sudo[106999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:11 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-2fdefd2f-fe3c-40ff-9c1f-a8be561e4c86 tempest-ProjectMemberTests-730908627 None] Acquiring lock "cinder-d79febb4-f286-4043-971a-5fe77b4cd807-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:39:11 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-2fdefd2f-fe3c-40ff-9c1f-a8be561e4c86 tempest-ProjectMemberTests-730908627 None] Lock "cinder-d79febb4-f286-4043-971a-5fe77b4cd807-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:39:11 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-2fdefd2f-fe3c-40ff-9c1f-a8be561e4c86 tempest-ProjectMemberTests-730908627 None] Acquiring lock "cinder-quobyte-d79febb4-f286-4043-971a-5fe77b4cd807" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:39:11 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-2fdefd2f-fe3c-40ff-9c1f-a8be561e4c86 tempest-ProjectMemberTests-730908627 None] Lock "cinder-quobyte-d79febb4-f286-4043-971a-5fe77b4cd807" acquired by "delete_volume" :: waited 0.014s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:39:11 devstack sudo[106999]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:11 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[13fda643-1148-43db-8c9c-c917c3a12124]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:39:11 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-2fdefd2f-fe3c-40ff-9c1f-a8be561e4c86 tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d79febb4-f286-4043-971a-5fe77b4cd807 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:12 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-eea825ba-da6e-4446-8557-d8ac2419f045 tempest-ProjectReaderTests-2105386862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50304123-8b22-450f-b265-bb73f1cd6ff9 -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-50304123-8b22-450f-b265-bb73f1cd6ff9.477fdc43-514f-46f9-9100-f1e57b865352" returned: 0 in 0.327s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:12 devstack cinder-volume[86188]: WARNING cinder.volume.drivers.remotefs [None req-eea825ba-da6e-4446-8557-d8ac2419f045 tempest-ProjectReaderTests-2105386862 None] /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-50304123-8b22-450f-b265-bb73f1cd6ff9.477fdc43-514f-46f9-9100-f1e57b865352 is being set with open permissions: ugo+rw Sep 16 20:39:12 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-eea825ba-da6e-4446-8557-d8ac2419f045 tempest-ProjectReaderTests-2105386862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-50304123-8b22-450f-b265-bb73f1cd6ff9.477fdc43-514f-46f9-9100-f1e57b865352 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:12 devstack sudo[107005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-50304123-8b22-450f-b265-bb73f1cd6ff9.477fdc43-514f-46f9-9100-f1e57b865352 Sep 16 20:39:12 devstack sudo[107005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:12 devstack sudo[107004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d79febb4-f286-4043-971a-5fe77b4cd807 Sep 16 20:39:12 devstack sudo[107004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:12 devstack sudo[107005]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:12 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-eea825ba-da6e-4446-8557-d8ac2419f045 tempest-ProjectReaderTests-2105386862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-50304123-8b22-450f-b265-bb73f1cd6ff9.477fdc43-514f-46f9-9100-f1e57b865352" returned: 0 in 0.247s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:12 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-eea825ba-da6e-4446-8557-d8ac2419f045 tempest-ProjectReaderTests-2105386862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-50304123-8b22-450f-b265-bb73f1cd6ff9.info {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:12 devstack sudo[107009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-50304123-8b22-450f-b265-bb73f1cd6ff9.info Sep 16 20:39:12 devstack sudo[107009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:12 devstack sudo[107004]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:12 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-2fdefd2f-fe3c-40ff-9c1f-a8be561e4c86 tempest-ProjectMemberTests-730908627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d79febb4-f286-4043-971a-5fe77b4cd807" returned: 0 in 0.385s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:12 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-2fdefd2f-fe3c-40ff-9c1f-a8be561e4c86 tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d79febb4-f286-4043-971a-5fe77b4cd807 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:12 devstack sudo[107014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d79febb4-f286-4043-971a-5fe77b4cd807 Sep 16 20:39:12 devstack sudo[107014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:12 devstack sudo[107009]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:12 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-eea825ba-da6e-4446-8557-d8ac2419f045 tempest-ProjectReaderTests-2105386862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-50304123-8b22-450f-b265-bb73f1cd6ff9.info" returned: 0 in 0.289s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:12 devstack cinder-volume[86188]: WARNING cinder.volume.drivers.remotefs [None req-eea825ba-da6e-4446-8557-d8ac2419f045 tempest-ProjectReaderTests-2105386862 None] /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-50304123-8b22-450f-b265-bb73f1cd6ff9.info is being set with open permissions: ugo+rw Sep 16 20:39:12 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-eea825ba-da6e-4446-8557-d8ac2419f045 tempest-ProjectReaderTests-2105386862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-50304123-8b22-450f-b265-bb73f1cd6ff9.info {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:12 devstack sudo[107018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-50304123-8b22-450f-b265-bb73f1cd6ff9.info Sep 16 20:39:12 devstack sudo[107018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:12 devstack sudo[107014]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:12 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-2fdefd2f-fe3c-40ff-9c1f-a8be561e4c86 tempest-ProjectMemberTests-730908627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-d79febb4-f286-4043-971a-5fe77b4cd807" returned: 0 in 0.250s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:12 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-2fdefd2f-fe3c-40ff-9c1f-a8be561e4c86 tempest-ProjectMemberTests-730908627 None] Lock "cinder-quobyte-d79febb4-f286-4043-971a-5fe77b4cd807" released by "delete_volume" :: held 0.710s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:39:12 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-2fdefd2f-fe3c-40ff-9c1f-a8be561e4c86 tempest-ProjectMemberTests-730908627 None] Created reservations ['f8692b16-f705-4207-9d5e-5d16fb6322ca', '23823206-12ff-4128-ac91-fa372c066c5c', '886251b0-4c33-40e7-8179-d9fbc736f587', '9b0303a8-2b9b-4aa1-8138-b6ad276dd107'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:39:12 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-2fdefd2f-fe3c-40ff-9c1f-a8be561e4c86 tempest-ProjectMemberTests-730908627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:39:12 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-2fdefd2f-fe3c-40ff-9c1f-a8be561e4c86 tempest-ProjectMemberTests-730908627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:39:12 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-2fdefd2f-fe3c-40ff-9c1f-a8be561e4c86 tempest-ProjectMemberTests-730908627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:39:12 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-2fdefd2f-fe3c-40ff-9c1f-a8be561e4c86 tempest-ProjectMemberTests-730908627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:39:12 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-2fdefd2f-fe3c-40ff-9c1f-a8be561e4c86 tempest-ProjectMemberTests-730908627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:39:12 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-2fdefd2f-fe3c-40ff-9c1f-a8be561e4c86 tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:12 devstack sudo[107020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:39:12 devstack sudo[107020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:12 devstack sudo[107018]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:12 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-eea825ba-da6e-4446-8557-d8ac2419f045 tempest-ProjectReaderTests-2105386862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-50304123-8b22-450f-b265-bb73f1cd6ff9.info" returned: 0 in 0.277s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:12 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-eea825ba-da6e-4446-8557-d8ac2419f045 tempest-ProjectReaderTests-2105386862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.988s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:39:12 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-eea825ba-da6e-4446-8557-d8ac2419f045 tempest-ProjectReaderTests-2105386862 None] Create snapshot completed successfully Sep 16 20:39:13 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-f406cb32-70ba-4681-962c-561f8903b6f7 tempest-ProjectReaderTests-2105386862 None] Acquiring lock "cinder-477fdc43-514f-46f9-9100-f1e57b865352-delete_snapshot" by "delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:39:13 devstack sudo[107020]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:13 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-2fdefd2f-fe3c-40ff-9c1f-a8be561e4c86 tempest-ProjectMemberTests-730908627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.271s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:13 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-2fdefd2f-fe3c-40ff-9c1f-a8be561e4c86 tempest-ProjectMemberTests-730908627 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:39:13 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-2fdefd2f-fe3c-40ff-9c1f-a8be561e4c86 tempest-ProjectMemberTests-730908627 None] Deleted volume successfully. Sep 16 20:39:13 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-f406cb32-70ba-4681-962c-561f8903b6f7 tempest-ProjectReaderTests-2105386862 None] Lock "cinder-477fdc43-514f-46f9-9100-f1e57b865352-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:39:13 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-f406cb32-70ba-4681-962c-561f8903b6f7 tempest-ProjectReaderTests-2105386862 None] Acquiring lock "cinder-quobyte-50304123-8b22-450f-b265-bb73f1cd6ff9" by "delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:39:13 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-f406cb32-70ba-4681-962c-561f8903b6f7 tempest-ProjectReaderTests-2105386862 None] Lock "cinder-quobyte-50304123-8b22-450f-b265-bb73f1cd6ff9" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:39:13 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-f406cb32-70ba-4681-962c-561f8903b6f7 tempest-ProjectReaderTests-2105386862 None] Acquiring lock "cinder-quobyte-477fdc43-514f-46f9-9100-f1e57b865352" by "_delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:39:13 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-2fdefd2f-fe3c-40ff-9c1f-a8be561e4c86 tempest-ProjectMemberTests-730908627 None] Lock "cinder-d79febb4-f286-4043-971a-5fe77b4cd807-delete_volume" released by "delete_volume" :: held 1.212s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:39:13 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-f406cb32-70ba-4681-962c-561f8903b6f7 tempest-ProjectReaderTests-2105386862 None] Lock "cinder-quobyte-477fdc43-514f-46f9-9100-f1e57b865352" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:39:13 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-f406cb32-70ba-4681-962c-561f8903b6f7 tempest-ProjectReaderTests-2105386862 None] Deleting offline snapshot 477fdc43-514f-46f9-9100-f1e57b865352 of volume 50304123-8b22-450f-b265-bb73f1cd6ff9 {{(pid=86188) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 20:39:13 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-f406cb32-70ba-4681-962c-561f8903b6f7 tempest-ProjectReaderTests-2105386862 None] snapshot_file for this snap is: volume-50304123-8b22-450f-b265-bb73f1cd6ff9.477fdc43-514f-46f9-9100-f1e57b865352 {{(pid=86188) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 20:39:13 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[43fdbeed-988a-4853-8c0c-02e28866b60f]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:39:13 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f406cb32-70ba-4681-962c-561f8903b6f7 tempest-ProjectReaderTests-2105386862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-50304123-8b22-450f-b265-bb73f1cd6ff9.477fdc43-514f-46f9-9100-f1e57b865352 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:13 devstack sudo[107024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-50304123-8b22-450f-b265-bb73f1cd6ff9.477fdc43-514f-46f9-9100-f1e57b865352 Sep 16 20:39:13 devstack sudo[107024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:13 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-14f20449-6420-499a-84aa-1d252cc2f410 tempest-ProjectMemberTests-730908627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:39:13 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-14f20449-6420-499a-84aa-1d252cc2f410 tempest-ProjectMemberTests-730908627 None] Flow 'volume_create_manager' (b8d22a03-1de3-4f74-b494-4117fed13240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:39:13 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-14f20449-6420-499a-84aa-1d252cc2f410 tempest-ProjectMemberTests-730908627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04ac587d-0dca-4777-b514-cdd48977300b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:39:13 devstack sudo[107024]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:13 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-14f20449-6420-499a-84aa-1d252cc2f410 tempest-ProjectMemberTests-730908627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04ac587d-0dca-4777-b514-cdd48977300b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:39:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1839857969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33630c17-a5e4-47fa-a32d-b54e15fef185,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d632f989377844f6b93c3b9bf838981d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:39:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:39:13Z,use_quota=True,user_id='5db8cf25fcc448629ab58c8006482185',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:39:13 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-14f20449-6420-499a-84aa-1d252cc2f410 tempest-ProjectMemberTests-730908627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae413c5f-3752-4582-bdb1-a85fbe0b936f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:39:13 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-14f20449-6420-499a-84aa-1d252cc2f410 tempest-ProjectMemberTests-730908627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae413c5f-3752-4582-bdb1-a85fbe0b936f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:39:13 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-14f20449-6420-499a-84aa-1d252cc2f410 tempest-ProjectMemberTests-730908627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38f5e2c6-ec96-4a81-9e61-1373694b5b19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:39:13 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-14f20449-6420-499a-84aa-1d252cc2f410 tempest-ProjectMemberTests-730908627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38f5e2c6-ec96-4a81-9e61-1373694b5b19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33630c17-a5e4-47fa-a32d-b54e15fef185', 'volume_name': 'volume-33630c17-a5e4-47fa-a32d-b54e15fef185', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:39:13 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-14f20449-6420-499a-84aa-1d252cc2f410 tempest-ProjectMemberTests-730908627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0a748a8-10cb-4131-9fe8-0a781d3e0689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:39:13 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-14f20449-6420-499a-84aa-1d252cc2f410 tempest-ProjectMemberTests-730908627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0a748a8-10cb-4131-9fe8-0a781d3e0689) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:39:13 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-14f20449-6420-499a-84aa-1d252cc2f410 tempest-ProjectMemberTests-730908627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (839cc28f-e614-40af-a7b6-9c41c198179f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:39:13 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-14f20449-6420-499a-84aa-1d252cc2f410 tempest-ProjectMemberTests-730908627 None] Volume 33630c17-a5e4-47fa-a32d-b54e15fef185: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33630c17-a5e4-47fa-a32d-b54e15fef185', 'volume_size': 1} Sep 16 20:39:13 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-14f20449-6420-499a-84aa-1d252cc2f410 tempest-ProjectMemberTests-730908627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:39:13 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-14f20449-6420-499a-84aa-1d252cc2f410 tempest-ProjectMemberTests-730908627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:39:13 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-14f20449-6420-499a-84aa-1d252cc2f410 tempest-ProjectMemberTests-730908627 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:39:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1839857969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33630c17-a5e4-47fa-a32d-b54e15fef185,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d632f989377844f6b93c3b9bf838981d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:39:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:39:13Z,use_quota=True,user_id='5db8cf25fcc448629ab58c8006482185',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:39:13 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-14f20449-6420-499a-84aa-1d252cc2f410 tempest-ProjectMemberTests-730908627 None] Creating volume 33630c17-a5e4-47fa-a32d-b54e15fef185 {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:39:13 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-14f20449-6420-499a-84aa-1d252cc2f410 tempest-ProjectMemberTests-730908627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:39:13 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-14f20449-6420-499a-84aa-1d252cc2f410 tempest-ProjectMemberTests-730908627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:39:13 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-14f20449-6420-499a-84aa-1d252cc2f410 tempest-ProjectMemberTests-730908627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:39:13 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-14f20449-6420-499a-84aa-1d252cc2f410 tempest-ProjectMemberTests-730908627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:39:13 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-14f20449-6420-499a-84aa-1d252cc2f410 tempest-ProjectMemberTests-730908627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:39:13 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-14f20449-6420-499a-84aa-1d252cc2f410 tempest-ProjectMemberTests-730908627 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:39:13 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-14f20449-6420-499a-84aa-1d252cc2f410 tempest-ProjectMemberTests-730908627 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:39:13 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-14f20449-6420-499a-84aa-1d252cc2f410 tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-33630c17-a5e4-47fa-a32d-b54e15fef185 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:13 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f406cb32-70ba-4681-962c-561f8903b6f7 tempest-ProjectReaderTests-2105386862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-50304123-8b22-450f-b265-bb73f1cd6ff9.477fdc43-514f-46f9-9100-f1e57b865352" returned: 0 in 0.446s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:13 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-f406cb32-70ba-4681-962c-561f8903b6f7 tempest-ProjectReaderTests-2105386862 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-50304123-8b22-450f-b265-bb73f1cd6ff9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86188) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 20:39:13 devstack sudo[107029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-33630c17-a5e4-47fa-a32d-b54e15fef185 1073741824 Sep 16 20:39:13 devstack sudo[107029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:13 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[40e2ad63-cec7-4c47-8688-1876d1bba5e9]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:39:13 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f406cb32-70ba-4681-962c-561f8903b6f7 tempest-ProjectReaderTests-2105386862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-50304123-8b22-450f-b265-bb73f1cd6ff9 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:13 devstack sudo[107031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-50304123-8b22-450f-b265-bb73f1cd6ff9 Sep 16 20:39:13 devstack sudo[107031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:14 devstack sudo[107031]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:14 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f406cb32-70ba-4681-962c-561f8903b6f7 tempest-ProjectReaderTests-2105386862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-50304123-8b22-450f-b265-bb73f1cd6ff9" returned: 0 in 0.369s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:14 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f406cb32-70ba-4681-962c-561f8903b6f7 tempest-ProjectReaderTests-2105386862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-50304123-8b22-450f-b265-bb73f1cd6ff9.477fdc43-514f-46f9-9100-f1e57b865352 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:14 devstack sudo[107039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-50304123-8b22-450f-b265-bb73f1cd6ff9.477fdc43-514f-46f9-9100-f1e57b865352 Sep 16 20:39:14 devstack sudo[107039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:14 devstack sudo[107029]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:14 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-14f20449-6420-499a-84aa-1d252cc2f410 tempest-ProjectMemberTests-730908627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-33630c17-a5e4-47fa-a32d-b54e15fef185 1073741824" returned: 0 in 0.456s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:14 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-14f20449-6420-499a-84aa-1d252cc2f410 tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-33630c17-a5e4-47fa-a32d-b54e15fef185 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:14 devstack sudo[107041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-33630c17-a5e4-47fa-a32d-b54e15fef185 Sep 16 20:39:14 devstack sudo[107041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:14 devstack sudo[107041]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:14 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-14f20449-6420-499a-84aa-1d252cc2f410 tempest-ProjectMemberTests-730908627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-33630c17-a5e4-47fa-a32d-b54e15fef185" returned: 0 in 0.248s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:14 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-14f20449-6420-499a-84aa-1d252cc2f410 tempest-ProjectMemberTests-730908627 None] <== create_volume: return (745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:39:14 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-14f20449-6420-499a-84aa-1d252cc2f410 tempest-ProjectMemberTests-730908627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.748s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:39:14 devstack sudo[107039]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:14 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-14f20449-6420-499a-84aa-1d252cc2f410 tempest-ProjectMemberTests-730908627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (839cc28f-e614-40af-a7b6-9c41c198179f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33630c17-a5e4-47fa-a32d-b54e15fef185', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:39:14 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-14f20449-6420-499a-84aa-1d252cc2f410 tempest-ProjectMemberTests-730908627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d4449cd-ce1b-445f-a5c0-49a52e890416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:39:14 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f406cb32-70ba-4681-962c-561f8903b6f7 tempest-ProjectReaderTests-2105386862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-50304123-8b22-450f-b265-bb73f1cd6ff9.477fdc43-514f-46f9-9100-f1e57b865352" returned: 0 in 0.344s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:14 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f406cb32-70ba-4681-962c-561f8903b6f7 tempest-ProjectReaderTests-2105386862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-50304123-8b22-450f-b265-bb73f1cd6ff9.477fdc43-514f-46f9-9100-f1e57b865352 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:14 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-14f20449-6420-499a-84aa-1d252cc2f410 tempest-ProjectMemberTests-730908627 None] Volume volume-33630c17-a5e4-47fa-a32d-b54e15fef185 (33630c17-a5e4-47fa-a32d-b54e15fef185): created successfully Sep 16 20:39:14 devstack sudo[107047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-50304123-8b22-450f-b265-bb73f1cd6ff9.477fdc43-514f-46f9-9100-f1e57b865352 Sep 16 20:39:14 devstack sudo[107047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:14 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-14f20449-6420-499a-84aa-1d252cc2f410 tempest-ProjectMemberTests-730908627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d4449cd-ce1b-445f-a5c0-49a52e890416) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:39:14 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-14f20449-6420-499a-84aa-1d252cc2f410 tempest-ProjectMemberTests-730908627 None] Flow 'volume_create_manager' (b8d22a03-1de3-4f74-b494-4117fed13240) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:39:14 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-14f20449-6420-499a-84aa-1d252cc2f410 tempest-ProjectMemberTests-730908627 None] Created volume successfully. Sep 16 20:39:14 devstack sudo[107047]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:14 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f406cb32-70ba-4681-962c-561f8903b6f7 tempest-ProjectReaderTests-2105386862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-50304123-8b22-450f-b265-bb73f1cd6ff9.477fdc43-514f-46f9-9100-f1e57b865352" returned: 0 in 0.280s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:14 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-f406cb32-70ba-4681-962c-561f8903b6f7 tempest-ProjectReaderTests-2105386862 None] Lock "cinder-quobyte-477fdc43-514f-46f9-9100-f1e57b865352" released by "_delete_snapshot" :: held 1.554s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:39:14 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-f406cb32-70ba-4681-962c-561f8903b6f7 tempest-ProjectReaderTests-2105386862 None] Lock "cinder-quobyte-50304123-8b22-450f-b265-bb73f1cd6ff9" released by "delete_snapshot" :: held 1.587s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:39:14 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-9fe91a4c-001f-4402-b826-a1ba5df55788 tempest-ProjectMemberTests-730908627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:39:14 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-9fe91a4c-001f-4402-b826-a1ba5df55788 tempest-ProjectMemberTests-730908627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:39:14 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-9fe91a4c-001f-4402-b826-a1ba5df55788 tempest-ProjectMemberTests-730908627 None] Creating offline snapshot 6d32c71f-0b12-498f-8545-27df6c28394f of volume 33630c17-a5e4-47fa-a32d-b54e15fef185 {{(pid=86188) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 20:39:14 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[93d5a9e7-18b9-4b36-8b2c-eb9c4911bc98]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:39:14 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-9fe91a4c-001f-4402-b826-a1ba5df55788 tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-33630c17-a5e4-47fa-a32d-b54e15fef185 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:14 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-f406cb32-70ba-4681-962c-561f8903b6f7 tempest-ProjectReaderTests-2105386862 None] Created reservations ['86ca090a-b756-46a1-9707-a8b859621b49', '7217351d-920a-4422-b23d-6a27c6a98d4d', '6972c9ce-4157-48f6-b6ce-b7cdaad751b5', 'e36fb53a-4fb9-40e0-88f1-3905ad50c23e'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:39:14 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-f406cb32-70ba-4681-962c-561f8903b6f7 tempest-ProjectReaderTests-2105386862 None] Delete snapshot completed successfully. Sep 16 20:39:14 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-f406cb32-70ba-4681-962c-561f8903b6f7 tempest-ProjectReaderTests-2105386862 None] Lock "cinder-477fdc43-514f-46f9-9100-f1e57b865352-delete_snapshot" released by "delete_snapshot" :: held 1.757s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:39:14 devstack sudo[107050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-33630c17-a5e4-47fa-a32d-b54e15fef185 Sep 16 20:39:14 devstack sudo[107050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:15 devstack sudo[107050]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:15 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-9fe91a4c-001f-4402-b826-a1ba5df55788 tempest-ProjectMemberTests-730908627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-33630c17-a5e4-47fa-a32d-b54e15fef185" returned: 0 in 0.382s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:15 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-9fe91a4c-001f-4402-b826-a1ba5df55788 tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-33630c17-a5e4-47fa-a32d-b54e15fef185,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-33630c17-a5e4-47fa-a32d-b54e15fef185.6d32c71f-0b12-498f-8545-27df6c28394f 1G {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:15 devstack sudo[107055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-33630c17-a5e4-47fa-a32d-b54e15fef185,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-33630c17-a5e4-47fa-a32d-b54e15fef185.6d32c71f-0b12-498f-8545-27df6c28394f 1G Sep 16 20:39:15 devstack sudo[107055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:15 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-6b626b5c-b775-4a3a-a619-a764fd63826e tempest-ProjectReaderTests-2105386862 None] Acquiring lock "cinder-50304123-8b22-450f-b265-bb73f1cd6ff9-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:39:15 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-6b626b5c-b775-4a3a-a619-a764fd63826e tempest-ProjectReaderTests-2105386862 None] Lock "cinder-50304123-8b22-450f-b265-bb73f1cd6ff9-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:39:15 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-6b626b5c-b775-4a3a-a619-a764fd63826e tempest-ProjectReaderTests-2105386862 None] Acquiring lock "cinder-quobyte-50304123-8b22-450f-b265-bb73f1cd6ff9" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:39:15 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-6b626b5c-b775-4a3a-a619-a764fd63826e tempest-ProjectReaderTests-2105386862 None] Lock "cinder-quobyte-50304123-8b22-450f-b265-bb73f1cd6ff9" acquired by "delete_volume" :: waited 0.015s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:39:15 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd3f72c0-c279-4027-96b7-3aeaecca5fbc]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:39:15 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-6b626b5c-b775-4a3a-a619-a764fd63826e tempest-ProjectReaderTests-2105386862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-50304123-8b22-450f-b265-bb73f1cd6ff9 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:15 devstack sudo[107059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-50304123-8b22-450f-b265-bb73f1cd6ff9 Sep 16 20:39:15 devstack sudo[107059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:15 devstack sudo[107055]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:15 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-9fe91a4c-001f-4402-b826-a1ba5df55788 tempest-ProjectMemberTests-730908627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-33630c17-a5e4-47fa-a32d-b54e15fef185,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-33630c17-a5e4-47fa-a32d-b54e15fef185.6d32c71f-0b12-498f-8545-27df6c28394f 1G" returned: 0 in 0.418s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:15 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-9fe91a4c-001f-4402-b826-a1ba5df55788 tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33630c17-a5e4-47fa-a32d-b54e15fef185 -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-33630c17-a5e4-47fa-a32d-b54e15fef185.6d32c71f-0b12-498f-8545-27df6c28394f {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:15 devstack sudo[107063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33630c17-a5e4-47fa-a32d-b54e15fef185 -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-33630c17-a5e4-47fa-a32d-b54e15fef185.6d32c71f-0b12-498f-8545-27df6c28394f Sep 16 20:39:15 devstack sudo[107063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:15 devstack sudo[107059]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:15 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-6b626b5c-b775-4a3a-a619-a764fd63826e tempest-ProjectReaderTests-2105386862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-50304123-8b22-450f-b265-bb73f1cd6ff9" returned: 0 in 0.403s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:15 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-6b626b5c-b775-4a3a-a619-a764fd63826e tempest-ProjectReaderTests-2105386862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-50304123-8b22-450f-b265-bb73f1cd6ff9 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:15 devstack sudo[107070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-50304123-8b22-450f-b265-bb73f1cd6ff9 Sep 16 20:39:15 devstack sudo[107070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:15 devstack sudo[107063]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:15 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-9fe91a4c-001f-4402-b826-a1ba5df55788 tempest-ProjectMemberTests-730908627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33630c17-a5e4-47fa-a32d-b54e15fef185 -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-33630c17-a5e4-47fa-a32d-b54e15fef185.6d32c71f-0b12-498f-8545-27df6c28394f" returned: 0 in 0.312s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:15 devstack cinder-volume[86188]: WARNING cinder.volume.drivers.remotefs [None req-9fe91a4c-001f-4402-b826-a1ba5df55788 tempest-ProjectMemberTests-730908627 None] /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-33630c17-a5e4-47fa-a32d-b54e15fef185.6d32c71f-0b12-498f-8545-27df6c28394f is being set with open permissions: ugo+rw Sep 16 20:39:15 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-9fe91a4c-001f-4402-b826-a1ba5df55788 tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-33630c17-a5e4-47fa-a32d-b54e15fef185.6d32c71f-0b12-498f-8545-27df6c28394f {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:15 devstack sudo[107074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-33630c17-a5e4-47fa-a32d-b54e15fef185.6d32c71f-0b12-498f-8545-27df6c28394f Sep 16 20:39:15 devstack sudo[107074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:16 devstack sudo[107070]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:16 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-6b626b5c-b775-4a3a-a619-a764fd63826e tempest-ProjectReaderTests-2105386862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-50304123-8b22-450f-b265-bb73f1cd6ff9" returned: 0 in 0.273s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:16 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-6b626b5c-b775-4a3a-a619-a764fd63826e tempest-ProjectReaderTests-2105386862 None] Lock "cinder-quobyte-50304123-8b22-450f-b265-bb73f1cd6ff9" released by "delete_volume" :: held 0.743s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:39:16 devstack sudo[107074]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:16 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-9fe91a4c-001f-4402-b826-a1ba5df55788 tempest-ProjectMemberTests-730908627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-33630c17-a5e4-47fa-a32d-b54e15fef185.6d32c71f-0b12-498f-8545-27df6c28394f" returned: 0 in 0.252s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:16 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-9fe91a4c-001f-4402-b826-a1ba5df55788 tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-33630c17-a5e4-47fa-a32d-b54e15fef185.info {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:16 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-6b626b5c-b775-4a3a-a619-a764fd63826e tempest-ProjectReaderTests-2105386862 None] Created reservations ['dcde5551-c844-4b98-98c8-388aca4a1b42', '5592fb64-7169-4398-8b2c-0778d30aaa86', '84a6b17d-d1c8-4979-84d2-c2ad735df688', '3221474c-798d-43c9-a8f1-3a83cc9fd4e4'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:39:16 devstack sudo[107078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-33630c17-a5e4-47fa-a32d-b54e15fef185.info Sep 16 20:39:16 devstack sudo[107078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:16 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-6b626b5c-b775-4a3a-a619-a764fd63826e tempest-ProjectReaderTests-2105386862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:39:16 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-6b626b5c-b775-4a3a-a619-a764fd63826e tempest-ProjectReaderTests-2105386862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:39:16 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-6b626b5c-b775-4a3a-a619-a764fd63826e tempest-ProjectReaderTests-2105386862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:39:16 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-6b626b5c-b775-4a3a-a619-a764fd63826e tempest-ProjectReaderTests-2105386862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:39:16 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-6b626b5c-b775-4a3a-a619-a764fd63826e tempest-ProjectReaderTests-2105386862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:39:16 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-6b626b5c-b775-4a3a-a619-a764fd63826e tempest-ProjectReaderTests-2105386862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:16 devstack sudo[107080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:39:16 devstack sudo[107080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:16 devstack sudo[107078]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:16 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-9fe91a4c-001f-4402-b826-a1ba5df55788 tempest-ProjectMemberTests-730908627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-33630c17-a5e4-47fa-a32d-b54e15fef185.info" returned: 0 in 0.268s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:16 devstack cinder-volume[86188]: WARNING cinder.volume.drivers.remotefs [None req-9fe91a4c-001f-4402-b826-a1ba5df55788 tempest-ProjectMemberTests-730908627 None] /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-33630c17-a5e4-47fa-a32d-b54e15fef185.info is being set with open permissions: ugo+rw Sep 16 20:39:16 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-9fe91a4c-001f-4402-b826-a1ba5df55788 tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-33630c17-a5e4-47fa-a32d-b54e15fef185.info {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:16 devstack sudo[107083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-33630c17-a5e4-47fa-a32d-b54e15fef185.info Sep 16 20:39:16 devstack sudo[107083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:16 devstack sudo[107080]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:16 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-6b626b5c-b775-4a3a-a619-a764fd63826e tempest-ProjectReaderTests-2105386862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.254s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:16 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-6b626b5c-b775-4a3a-a619-a764fd63826e tempest-ProjectReaderTests-2105386862 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:39:16 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-6b626b5c-b775-4a3a-a619-a764fd63826e tempest-ProjectReaderTests-2105386862 None] Deleted volume successfully. Sep 16 20:39:16 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-6b626b5c-b775-4a3a-a619-a764fd63826e tempest-ProjectReaderTests-2105386862 None] Lock "cinder-50304123-8b22-450f-b265-bb73f1cd6ff9-delete_volume" released by "delete_volume" :: held 1.259s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:39:16 devstack sudo[107083]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:16 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-9fe91a4c-001f-4402-b826-a1ba5df55788 tempest-ProjectMemberTests-730908627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-33630c17-a5e4-47fa-a32d-b54e15fef185.info" returned: 0 in 0.273s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:16 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-9fe91a4c-001f-4402-b826-a1ba5df55788 tempest-ProjectMemberTests-730908627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.002s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:39:16 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-9fe91a4c-001f-4402-b826-a1ba5df55788 tempest-ProjectMemberTests-730908627 None] Create snapshot completed successfully Sep 16 20:39:16 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-03718300-3979-4385-99ad-69308ccd532c tempest-ProjectReaderTests-2105386862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:39:16 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-03718300-3979-4385-99ad-69308ccd532c tempest-ProjectReaderTests-2105386862 None] Flow 'volume_create_manager' (c8f403cb-a935-48b6-bdb7-b8df46bed1f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:39:16 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-03718300-3979-4385-99ad-69308ccd532c tempest-ProjectReaderTests-2105386862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e4d3d5d-8fd3-48b6-95f5-2f0c175522c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:39:16 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-03718300-3979-4385-99ad-69308ccd532c tempest-ProjectReaderTests-2105386862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e4d3d5d-8fd3-48b6-95f5-2f0c175522c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:39:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1515825073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93ac1c1f-9897-4a10-a7bb-3878cafbf538,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a1b5c8e359a4d699325f3e4049d8c93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:39:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:39:17Z,use_quota=True,user_id='af893a5c2de74fa596654573d674555d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:39:16 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-03718300-3979-4385-99ad-69308ccd532c tempest-ProjectReaderTests-2105386862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (580f4782-d4bf-4961-bf73-05312b561c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:39:16 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-03718300-3979-4385-99ad-69308ccd532c tempest-ProjectReaderTests-2105386862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (580f4782-d4bf-4961-bf73-05312b561c46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:39:16 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-03718300-3979-4385-99ad-69308ccd532c tempest-ProjectReaderTests-2105386862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c253f2f-d95c-43e7-9bde-54a6b6fbd1ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:39:16 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-03718300-3979-4385-99ad-69308ccd532c tempest-ProjectReaderTests-2105386862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c253f2f-d95c-43e7-9bde-54a6b6fbd1ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93ac1c1f-9897-4a10-a7bb-3878cafbf538', 'volume_name': 'volume-93ac1c1f-9897-4a10-a7bb-3878cafbf538', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:39:16 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-03718300-3979-4385-99ad-69308ccd532c tempest-ProjectReaderTests-2105386862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22192de7-4a02-42ec-9bf7-27d300d63125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:39:16 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-03718300-3979-4385-99ad-69308ccd532c tempest-ProjectReaderTests-2105386862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22192de7-4a02-42ec-9bf7-27d300d63125) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:39:16 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-03718300-3979-4385-99ad-69308ccd532c tempest-ProjectReaderTests-2105386862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (363903b8-ebfd-4b2a-8623-810cdf378618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:39:16 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-03718300-3979-4385-99ad-69308ccd532c tempest-ProjectReaderTests-2105386862 None] Volume 93ac1c1f-9897-4a10-a7bb-3878cafbf538: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93ac1c1f-9897-4a10-a7bb-3878cafbf538', 'volume_size': 1} Sep 16 20:39:16 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-03718300-3979-4385-99ad-69308ccd532c tempest-ProjectReaderTests-2105386862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:39:16 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-03718300-3979-4385-99ad-69308ccd532c tempest-ProjectReaderTests-2105386862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:39:16 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-03718300-3979-4385-99ad-69308ccd532c tempest-ProjectReaderTests-2105386862 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:39:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1515825073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93ac1c1f-9897-4a10-a7bb-3878cafbf538,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a1b5c8e359a4d699325f3e4049d8c93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:39:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:39:17Z,use_quota=True,user_id='af893a5c2de74fa596654573d674555d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:39:16 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-03718300-3979-4385-99ad-69308ccd532c tempest-ProjectReaderTests-2105386862 None] Creating volume 93ac1c1f-9897-4a10-a7bb-3878cafbf538 {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:39:16 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-03718300-3979-4385-99ad-69308ccd532c tempest-ProjectReaderTests-2105386862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:39:16 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-03718300-3979-4385-99ad-69308ccd532c tempest-ProjectReaderTests-2105386862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:39:16 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-03718300-3979-4385-99ad-69308ccd532c tempest-ProjectReaderTests-2105386862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:39:16 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-03718300-3979-4385-99ad-69308ccd532c tempest-ProjectReaderTests-2105386862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:39:16 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-03718300-3979-4385-99ad-69308ccd532c tempest-ProjectReaderTests-2105386862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:39:16 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-03718300-3979-4385-99ad-69308ccd532c tempest-ProjectReaderTests-2105386862 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:39:16 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-03718300-3979-4385-99ad-69308ccd532c tempest-ProjectReaderTests-2105386862 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:39:16 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-03718300-3979-4385-99ad-69308ccd532c tempest-ProjectReaderTests-2105386862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-93ac1c1f-9897-4a10-a7bb-3878cafbf538 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:16 devstack sudo[107087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-93ac1c1f-9897-4a10-a7bb-3878cafbf538 1073741824 Sep 16 20:39:16 devstack sudo[107087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:17 devstack sudo[107087]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:17 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-03718300-3979-4385-99ad-69308ccd532c tempest-ProjectReaderTests-2105386862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-93ac1c1f-9897-4a10-a7bb-3878cafbf538 1073741824" returned: 0 in 0.407s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:17 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-03718300-3979-4385-99ad-69308ccd532c tempest-ProjectReaderTests-2105386862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-93ac1c1f-9897-4a10-a7bb-3878cafbf538 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:17 devstack sudo[107093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-93ac1c1f-9897-4a10-a7bb-3878cafbf538 Sep 16 20:39:17 devstack sudo[107093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:17 devstack sudo[107093]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:17 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-03718300-3979-4385-99ad-69308ccd532c tempest-ProjectReaderTests-2105386862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-93ac1c1f-9897-4a10-a7bb-3878cafbf538" returned: 0 in 0.243s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:17 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-03718300-3979-4385-99ad-69308ccd532c tempest-ProjectReaderTests-2105386862 None] <== create_volume: return (689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:39:17 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-03718300-3979-4385-99ad-69308ccd532c tempest-ProjectReaderTests-2105386862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.691s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:39:17 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-03718300-3979-4385-99ad-69308ccd532c tempest-ProjectReaderTests-2105386862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (363903b8-ebfd-4b2a-8623-810cdf378618) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93ac1c1f-9897-4a10-a7bb-3878cafbf538', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:39:17 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-03718300-3979-4385-99ad-69308ccd532c tempest-ProjectReaderTests-2105386862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a8c8b80-757b-436c-ad77-a30ae16fff49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:39:17 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-03718300-3979-4385-99ad-69308ccd532c tempest-ProjectReaderTests-2105386862 None] Volume volume-93ac1c1f-9897-4a10-a7bb-3878cafbf538 (93ac1c1f-9897-4a10-a7bb-3878cafbf538): created successfully Sep 16 20:39:17 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-03718300-3979-4385-99ad-69308ccd532c tempest-ProjectReaderTests-2105386862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a8c8b80-757b-436c-ad77-a30ae16fff49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:39:17 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-03718300-3979-4385-99ad-69308ccd532c tempest-ProjectReaderTests-2105386862 None] Flow 'volume_create_manager' (c8f403cb-a935-48b6-bdb7-b8df46bed1f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:39:17 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-03718300-3979-4385-99ad-69308ccd532c tempest-ProjectReaderTests-2105386862 None] Created volume successfully. Sep 16 20:39:17 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-4036185f-9b2d-475a-84ac-385669a34ff0 tempest-ProjectMemberTests-730908627 None] Acquiring lock "cinder-6d32c71f-0b12-498f-8545-27df6c28394f-delete_snapshot" by "delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:39:17 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-4036185f-9b2d-475a-84ac-385669a34ff0 tempest-ProjectMemberTests-730908627 None] Lock "cinder-6d32c71f-0b12-498f-8545-27df6c28394f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:39:17 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-4036185f-9b2d-475a-84ac-385669a34ff0 tempest-ProjectMemberTests-730908627 None] Acquiring lock "cinder-quobyte-33630c17-a5e4-47fa-a32d-b54e15fef185" by "delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:39:17 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-4036185f-9b2d-475a-84ac-385669a34ff0 tempest-ProjectMemberTests-730908627 None] Lock "cinder-quobyte-33630c17-a5e4-47fa-a32d-b54e15fef185" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:39:17 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-4036185f-9b2d-475a-84ac-385669a34ff0 tempest-ProjectMemberTests-730908627 None] Acquiring lock "cinder-quobyte-6d32c71f-0b12-498f-8545-27df6c28394f" by "_delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:39:17 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-4036185f-9b2d-475a-84ac-385669a34ff0 tempest-ProjectMemberTests-730908627 None] Lock "cinder-quobyte-6d32c71f-0b12-498f-8545-27df6c28394f" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:39:17 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-4036185f-9b2d-475a-84ac-385669a34ff0 tempest-ProjectMemberTests-730908627 None] Deleting offline snapshot 6d32c71f-0b12-498f-8545-27df6c28394f of volume 33630c17-a5e4-47fa-a32d-b54e15fef185 {{(pid=86188) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 20:39:17 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-4036185f-9b2d-475a-84ac-385669a34ff0 tempest-ProjectMemberTests-730908627 None] snapshot_file for this snap is: volume-33630c17-a5e4-47fa-a32d-b54e15fef185.6d32c71f-0b12-498f-8545-27df6c28394f {{(pid=86188) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 20:39:17 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[efcb7e23-566a-4ff1-9804-eb8a6a9f62dc]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:39:17 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-4036185f-9b2d-475a-84ac-385669a34ff0 tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-33630c17-a5e4-47fa-a32d-b54e15fef185.6d32c71f-0b12-498f-8545-27df6c28394f {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:18 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-b4bfb740-de7a-4596-93db-cc04062056d3 tempest-ProjectReaderTests-2105386862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:39:18 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-b4bfb740-de7a-4596-93db-cc04062056d3 tempest-ProjectReaderTests-2105386862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:39:18 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-b4bfb740-de7a-4596-93db-cc04062056d3 tempest-ProjectReaderTests-2105386862 None] Creating offline snapshot 73bf9d5b-bb2b-4b59-8a05-058aa3195f27 of volume 93ac1c1f-9897-4a10-a7bb-3878cafbf538 {{(pid=86188) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 20:39:18 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[0657d178-da7d-4919-814c-4e21f6a9d461]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:39:18 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b4bfb740-de7a-4596-93db-cc04062056d3 tempest-ProjectReaderTests-2105386862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-93ac1c1f-9897-4a10-a7bb-3878cafbf538 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:18 devstack sudo[107096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-33630c17-a5e4-47fa-a32d-b54e15fef185.6d32c71f-0b12-498f-8545-27df6c28394f Sep 16 20:39:18 devstack sudo[107096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:18 devstack sudo[107097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-93ac1c1f-9897-4a10-a7bb-3878cafbf538 Sep 16 20:39:18 devstack sudo[107097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:18 devstack sudo[107096]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:18 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-4036185f-9b2d-475a-84ac-385669a34ff0 tempest-ProjectMemberTests-730908627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-33630c17-a5e4-47fa-a32d-b54e15fef185.6d32c71f-0b12-498f-8545-27df6c28394f" returned: 0 in 0.371s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:18 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-4036185f-9b2d-475a-84ac-385669a34ff0 tempest-ProjectMemberTests-730908627 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-33630c17-a5e4-47fa-a32d-b54e15fef185(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86188) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 20:39:18 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[90293c50-61a0-430e-afea-fd643f717b26]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:39:18 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-4036185f-9b2d-475a-84ac-385669a34ff0 tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-33630c17-a5e4-47fa-a32d-b54e15fef185 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:18 devstack sudo[107097]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:18 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b4bfb740-de7a-4596-93db-cc04062056d3 tempest-ProjectReaderTests-2105386862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-93ac1c1f-9897-4a10-a7bb-3878cafbf538" returned: 0 in 0.382s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:18 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b4bfb740-de7a-4596-93db-cc04062056d3 tempest-ProjectReaderTests-2105386862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-93ac1c1f-9897-4a10-a7bb-3878cafbf538,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-93ac1c1f-9897-4a10-a7bb-3878cafbf538.73bf9d5b-bb2b-4b59-8a05-058aa3195f27 1G {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:18 devstack sudo[107107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-93ac1c1f-9897-4a10-a7bb-3878cafbf538,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-93ac1c1f-9897-4a10-a7bb-3878cafbf538.73bf9d5b-bb2b-4b59-8a05-058aa3195f27 1G Sep 16 20:39:18 devstack sudo[107107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:18 devstack sudo[107106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-33630c17-a5e4-47fa-a32d-b54e15fef185 Sep 16 20:39:18 devstack sudo[107106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:18 devstack sudo[107106]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:18 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-4036185f-9b2d-475a-84ac-385669a34ff0 tempest-ProjectMemberTests-730908627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-33630c17-a5e4-47fa-a32d-b54e15fef185" returned: 0 in 0.396s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:18 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-4036185f-9b2d-475a-84ac-385669a34ff0 tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-33630c17-a5e4-47fa-a32d-b54e15fef185.6d32c71f-0b12-498f-8545-27df6c28394f {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:18 devstack sudo[107117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-33630c17-a5e4-47fa-a32d-b54e15fef185.6d32c71f-0b12-498f-8545-27df6c28394f Sep 16 20:39:18 devstack sudo[107117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:18 devstack sudo[107107]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:18 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b4bfb740-de7a-4596-93db-cc04062056d3 tempest-ProjectReaderTests-2105386862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-93ac1c1f-9897-4a10-a7bb-3878cafbf538,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-93ac1c1f-9897-4a10-a7bb-3878cafbf538.73bf9d5b-bb2b-4b59-8a05-058aa3195f27 1G" returned: 0 in 0.415s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:18 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b4bfb740-de7a-4596-93db-cc04062056d3 tempest-ProjectReaderTests-2105386862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93ac1c1f-9897-4a10-a7bb-3878cafbf538 -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-93ac1c1f-9897-4a10-a7bb-3878cafbf538.73bf9d5b-bb2b-4b59-8a05-058aa3195f27 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:18 devstack sudo[107119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93ac1c1f-9897-4a10-a7bb-3878cafbf538 -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-93ac1c1f-9897-4a10-a7bb-3878cafbf538.73bf9d5b-bb2b-4b59-8a05-058aa3195f27 Sep 16 20:39:18 devstack sudo[107119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:19 devstack sudo[107117]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:19 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-4036185f-9b2d-475a-84ac-385669a34ff0 tempest-ProjectMemberTests-730908627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-33630c17-a5e4-47fa-a32d-b54e15fef185.6d32c71f-0b12-498f-8545-27df6c28394f" returned: 0 in 0.351s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:19 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-4036185f-9b2d-475a-84ac-385669a34ff0 tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-33630c17-a5e4-47fa-a32d-b54e15fef185.6d32c71f-0b12-498f-8545-27df6c28394f {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:19 devstack sudo[107127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-33630c17-a5e4-47fa-a32d-b54e15fef185.6d32c71f-0b12-498f-8545-27df6c28394f Sep 16 20:39:19 devstack sudo[107127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:19 devstack sudo[107119]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:19 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b4bfb740-de7a-4596-93db-cc04062056d3 tempest-ProjectReaderTests-2105386862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93ac1c1f-9897-4a10-a7bb-3878cafbf538 -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-93ac1c1f-9897-4a10-a7bb-3878cafbf538.73bf9d5b-bb2b-4b59-8a05-058aa3195f27" returned: 0 in 0.312s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:19 devstack cinder-volume[86188]: WARNING cinder.volume.drivers.remotefs [None req-b4bfb740-de7a-4596-93db-cc04062056d3 tempest-ProjectReaderTests-2105386862 None] /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-93ac1c1f-9897-4a10-a7bb-3878cafbf538.73bf9d5b-bb2b-4b59-8a05-058aa3195f27 is being set with open permissions: ugo+rw Sep 16 20:39:19 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b4bfb740-de7a-4596-93db-cc04062056d3 tempest-ProjectReaderTests-2105386862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-93ac1c1f-9897-4a10-a7bb-3878cafbf538.73bf9d5b-bb2b-4b59-8a05-058aa3195f27 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:19 devstack sudo[107129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-93ac1c1f-9897-4a10-a7bb-3878cafbf538.73bf9d5b-bb2b-4b59-8a05-058aa3195f27 Sep 16 20:39:19 devstack sudo[107129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:19 devstack sudo[107127]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:19 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-4036185f-9b2d-475a-84ac-385669a34ff0 tempest-ProjectMemberTests-730908627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-33630c17-a5e4-47fa-a32d-b54e15fef185.6d32c71f-0b12-498f-8545-27df6c28394f" returned: 0 in 0.255s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:19 devstack sudo[107129]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:19 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b4bfb740-de7a-4596-93db-cc04062056d3 tempest-ProjectReaderTests-2105386862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-93ac1c1f-9897-4a10-a7bb-3878cafbf538.73bf9d5b-bb2b-4b59-8a05-058aa3195f27" returned: 0 in 0.248s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:19 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-4036185f-9b2d-475a-84ac-385669a34ff0 tempest-ProjectMemberTests-730908627 None] Lock "cinder-quobyte-6d32c71f-0b12-498f-8545-27df6c28394f" released by "_delete_snapshot" :: held 1.503s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:39:19 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-4036185f-9b2d-475a-84ac-385669a34ff0 tempest-ProjectMemberTests-730908627 None] Lock "cinder-quobyte-33630c17-a5e4-47fa-a32d-b54e15fef185" released by "delete_snapshot" :: held 1.527s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:39:19 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b4bfb740-de7a-4596-93db-cc04062056d3 tempest-ProjectReaderTests-2105386862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-93ac1c1f-9897-4a10-a7bb-3878cafbf538.info {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:19 devstack sudo[107133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-93ac1c1f-9897-4a10-a7bb-3878cafbf538.info Sep 16 20:39:19 devstack sudo[107133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:19 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-4036185f-9b2d-475a-84ac-385669a34ff0 tempest-ProjectMemberTests-730908627 None] Created reservations ['f5ba41c1-5d7e-4826-8341-464c721c0fb5', '71c47a91-325c-4157-964b-5cf263e5790d', '2c4672dc-604c-47b8-86f5-c8bb7f4d53ec', 'f2798ae4-cf0c-48be-a456-d020f540f41f'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:39:19 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-4036185f-9b2d-475a-84ac-385669a34ff0 tempest-ProjectMemberTests-730908627 None] Delete snapshot completed successfully. Sep 16 20:39:19 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-4036185f-9b2d-475a-84ac-385669a34ff0 tempest-ProjectMemberTests-730908627 None] Lock "cinder-6d32c71f-0b12-498f-8545-27df6c28394f-delete_snapshot" released by "delete_snapshot" :: held 1.682s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:39:19 devstack sudo[107133]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:19 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b4bfb740-de7a-4596-93db-cc04062056d3 tempest-ProjectReaderTests-2105386862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-93ac1c1f-9897-4a10-a7bb-3878cafbf538.info" returned: 0 in 0.262s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:19 devstack cinder-volume[86188]: WARNING cinder.volume.drivers.remotefs [None req-b4bfb740-de7a-4596-93db-cc04062056d3 tempest-ProjectReaderTests-2105386862 None] /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-93ac1c1f-9897-4a10-a7bb-3878cafbf538.info is being set with open permissions: ugo+rw Sep 16 20:39:19 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b4bfb740-de7a-4596-93db-cc04062056d3 tempest-ProjectReaderTests-2105386862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-93ac1c1f-9897-4a10-a7bb-3878cafbf538.info {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:19 devstack sudo[107137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-93ac1c1f-9897-4a10-a7bb-3878cafbf538.info Sep 16 20:39:19 devstack sudo[107137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:19 devstack sudo[107137]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:19 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-b4bfb740-de7a-4596-93db-cc04062056d3 tempest-ProjectReaderTests-2105386862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-93ac1c1f-9897-4a10-a7bb-3878cafbf538.info" returned: 0 in 0.241s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:19 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-b4bfb740-de7a-4596-93db-cc04062056d3 tempest-ProjectReaderTests-2105386862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.961s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:39:19 devstack cinder-volume[86188]: DEBUG dbcounter [-] [86188] Writing DB stats cinder:SELECT=218,cinder:INSERT=60,cinder:UPDATE=277,cinder:DELETE=25 {{(pid=86188) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 20:39:19 devstack cinder-volume[86188]: DEBUG dbcounter [-] [86188] Writing DB stats cinder:SELECT=202,cinder:INSERT=85,cinder:UPDATE=274,cinder:DELETE=21 {{(pid=86188) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 20:39:20 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-b4bfb740-de7a-4596-93db-cc04062056d3 tempest-ProjectReaderTests-2105386862 None] Create snapshot completed successfully Sep 16 20:39:20 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-c519290f-c97b-4271-ba99-4cf61dc143f5 tempest-ProjectMemberTests-730908627 None] Acquiring lock "cinder-33630c17-a5e4-47fa-a32d-b54e15fef185-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:39:20 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-c519290f-c97b-4271-ba99-4cf61dc143f5 tempest-ProjectMemberTests-730908627 None] Lock "cinder-33630c17-a5e4-47fa-a32d-b54e15fef185-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:39:20 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-c519290f-c97b-4271-ba99-4cf61dc143f5 tempest-ProjectMemberTests-730908627 None] Acquiring lock "cinder-quobyte-33630c17-a5e4-47fa-a32d-b54e15fef185" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:39:20 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-c519290f-c97b-4271-ba99-4cf61dc143f5 tempest-ProjectMemberTests-730908627 None] Lock "cinder-quobyte-33630c17-a5e4-47fa-a32d-b54e15fef185" acquired by "delete_volume" :: waited 0.015s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:39:20 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-7a3fc36f-733b-4314-b52b-965db967aa6e tempest-ProjectReaderTests-2105386862 None] Acquiring lock "cinder-73bf9d5b-bb2b-4b59-8a05-058aa3195f27-delete_snapshot" by "delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:39:20 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6d7cd90-ebc8-4341-b723-6c0923fc9cd7]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:39:20 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-c519290f-c97b-4271-ba99-4cf61dc143f5 tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-33630c17-a5e4-47fa-a32d-b54e15fef185 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:20 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-7a3fc36f-733b-4314-b52b-965db967aa6e tempest-ProjectReaderTests-2105386862 None] Lock "cinder-73bf9d5b-bb2b-4b59-8a05-058aa3195f27-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:39:20 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-7a3fc36f-733b-4314-b52b-965db967aa6e tempest-ProjectReaderTests-2105386862 None] Acquiring lock "cinder-quobyte-93ac1c1f-9897-4a10-a7bb-3878cafbf538" by "delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:39:20 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-7a3fc36f-733b-4314-b52b-965db967aa6e tempest-ProjectReaderTests-2105386862 None] Lock "cinder-quobyte-93ac1c1f-9897-4a10-a7bb-3878cafbf538" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:39:20 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-7a3fc36f-733b-4314-b52b-965db967aa6e tempest-ProjectReaderTests-2105386862 None] Acquiring lock "cinder-quobyte-73bf9d5b-bb2b-4b59-8a05-058aa3195f27" by "_delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:39:20 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-7a3fc36f-733b-4314-b52b-965db967aa6e tempest-ProjectReaderTests-2105386862 None] Lock "cinder-quobyte-73bf9d5b-bb2b-4b59-8a05-058aa3195f27" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:39:20 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-7a3fc36f-733b-4314-b52b-965db967aa6e tempest-ProjectReaderTests-2105386862 None] Deleting offline snapshot 73bf9d5b-bb2b-4b59-8a05-058aa3195f27 of volume 93ac1c1f-9897-4a10-a7bb-3878cafbf538 {{(pid=86188) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 20:39:20 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-7a3fc36f-733b-4314-b52b-965db967aa6e tempest-ProjectReaderTests-2105386862 None] snapshot_file for this snap is: volume-93ac1c1f-9897-4a10-a7bb-3878cafbf538.73bf9d5b-bb2b-4b59-8a05-058aa3195f27 {{(pid=86188) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 20:39:20 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc8291ed-928a-47c7-9d78-e7c24b87893f]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:39:20 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-7a3fc36f-733b-4314-b52b-965db967aa6e tempest-ProjectReaderTests-2105386862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-93ac1c1f-9897-4a10-a7bb-3878cafbf538.73bf9d5b-bb2b-4b59-8a05-058aa3195f27 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:20 devstack sudo[107140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-33630c17-a5e4-47fa-a32d-b54e15fef185 Sep 16 20:39:20 devstack sudo[107140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:20 devstack sudo[107141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-93ac1c1f-9897-4a10-a7bb-3878cafbf538.73bf9d5b-bb2b-4b59-8a05-058aa3195f27 Sep 16 20:39:20 devstack sudo[107141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:20 devstack sudo[107140]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:20 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-c519290f-c97b-4271-ba99-4cf61dc143f5 tempest-ProjectMemberTests-730908627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-33630c17-a5e4-47fa-a32d-b54e15fef185" returned: 0 in 0.366s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:20 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-c519290f-c97b-4271-ba99-4cf61dc143f5 tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-33630c17-a5e4-47fa-a32d-b54e15fef185 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:20 devstack sudo[107148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-33630c17-a5e4-47fa-a32d-b54e15fef185 Sep 16 20:39:20 devstack sudo[107148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:20 devstack sudo[107141]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:20 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-7a3fc36f-733b-4314-b52b-965db967aa6e tempest-ProjectReaderTests-2105386862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-93ac1c1f-9897-4a10-a7bb-3878cafbf538.73bf9d5b-bb2b-4b59-8a05-058aa3195f27" returned: 0 in 0.367s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:20 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-7a3fc36f-733b-4314-b52b-965db967aa6e tempest-ProjectReaderTests-2105386862 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93ac1c1f-9897-4a10-a7bb-3878cafbf538(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86188) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 20:39:20 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[233d62d8-77d1-45c6-8568-dad6581760b3]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:39:20 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-7a3fc36f-733b-4314-b52b-965db967aa6e tempest-ProjectReaderTests-2105386862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-93ac1c1f-9897-4a10-a7bb-3878cafbf538 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:20 devstack sudo[107152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-93ac1c1f-9897-4a10-a7bb-3878cafbf538 Sep 16 20:39:20 devstack sudo[107152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:20 devstack sudo[107148]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:20 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-c519290f-c97b-4271-ba99-4cf61dc143f5 tempest-ProjectMemberTests-730908627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-33630c17-a5e4-47fa-a32d-b54e15fef185" returned: 0 in 0.254s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:20 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-c519290f-c97b-4271-ba99-4cf61dc143f5 tempest-ProjectMemberTests-730908627 None] Lock "cinder-quobyte-33630c17-a5e4-47fa-a32d-b54e15fef185" released by "delete_volume" :: held 0.694s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:39:20 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-c519290f-c97b-4271-ba99-4cf61dc143f5 tempest-ProjectMemberTests-730908627 None] Created reservations ['76cbbdbc-a920-4a43-8cf8-e4154e9d82c5', 'f59da715-2d4a-46a4-8e0b-758e606d4842', '77d721bb-8598-43c7-bcc9-ce3761a87719', '320c4883-ccc0-4c23-8788-5d85e8044e75'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:39:20 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-c519290f-c97b-4271-ba99-4cf61dc143f5 tempest-ProjectMemberTests-730908627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:39:20 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-c519290f-c97b-4271-ba99-4cf61dc143f5 tempest-ProjectMemberTests-730908627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:39:20 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-c519290f-c97b-4271-ba99-4cf61dc143f5 tempest-ProjectMemberTests-730908627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:39:20 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-c519290f-c97b-4271-ba99-4cf61dc143f5 tempest-ProjectMemberTests-730908627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:39:20 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-c519290f-c97b-4271-ba99-4cf61dc143f5 tempest-ProjectMemberTests-730908627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:39:20 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-c519290f-c97b-4271-ba99-4cf61dc143f5 tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:20 devstack sudo[107155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:39:20 devstack sudo[107155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:21 devstack sudo[107152]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:21 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-7a3fc36f-733b-4314-b52b-965db967aa6e tempest-ProjectReaderTests-2105386862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-93ac1c1f-9897-4a10-a7bb-3878cafbf538" returned: 0 in 0.384s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:21 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-7a3fc36f-733b-4314-b52b-965db967aa6e tempest-ProjectReaderTests-2105386862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-93ac1c1f-9897-4a10-a7bb-3878cafbf538.73bf9d5b-bb2b-4b59-8a05-058aa3195f27 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:21 devstack sudo[107160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-93ac1c1f-9897-4a10-a7bb-3878cafbf538.73bf9d5b-bb2b-4b59-8a05-058aa3195f27 Sep 16 20:39:21 devstack sudo[107160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:21 devstack sudo[107155]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:21 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-c519290f-c97b-4271-ba99-4cf61dc143f5 tempest-ProjectMemberTests-730908627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.263s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:21 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-c519290f-c97b-4271-ba99-4cf61dc143f5 tempest-ProjectMemberTests-730908627 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:39:21 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-c519290f-c97b-4271-ba99-4cf61dc143f5 tempest-ProjectMemberTests-730908627 None] Deleted volume successfully. Sep 16 20:39:21 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-c519290f-c97b-4271-ba99-4cf61dc143f5 tempest-ProjectMemberTests-730908627 None] Lock "cinder-33630c17-a5e4-47fa-a32d-b54e15fef185-delete_volume" released by "delete_volume" :: held 1.167s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:39:21 devstack sudo[107160]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:21 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-7a3fc36f-733b-4314-b52b-965db967aa6e tempest-ProjectReaderTests-2105386862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-93ac1c1f-9897-4a10-a7bb-3878cafbf538.73bf9d5b-bb2b-4b59-8a05-058aa3195f27" returned: 0 in 0.356s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:21 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-7a3fc36f-733b-4314-b52b-965db967aa6e tempest-ProjectReaderTests-2105386862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-93ac1c1f-9897-4a10-a7bb-3878cafbf538.73bf9d5b-bb2b-4b59-8a05-058aa3195f27 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:21 devstack sudo[107166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-93ac1c1f-9897-4a10-a7bb-3878cafbf538.73bf9d5b-bb2b-4b59-8a05-058aa3195f27 Sep 16 20:39:21 devstack sudo[107166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:21 devstack sudo[107166]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:21 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-7a3fc36f-733b-4314-b52b-965db967aa6e tempest-ProjectReaderTests-2105386862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-93ac1c1f-9897-4a10-a7bb-3878cafbf538.73bf9d5b-bb2b-4b59-8a05-058aa3195f27" returned: 0 in 0.258s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:21 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-7a3fc36f-733b-4314-b52b-965db967aa6e tempest-ProjectReaderTests-2105386862 None] Lock "cinder-quobyte-73bf9d5b-bb2b-4b59-8a05-058aa3195f27" released by "_delete_snapshot" :: held 1.467s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:39:21 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-7a3fc36f-733b-4314-b52b-965db967aa6e tempest-ProjectReaderTests-2105386862 None] Lock "cinder-quobyte-93ac1c1f-9897-4a10-a7bb-3878cafbf538" released by "delete_snapshot" :: held 1.489s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:39:21 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-96bf0de5-1f11-4de7-9c7f-7d5c7bfc1402 tempest-ProjectMemberTests-730908627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:39:21 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-96bf0de5-1f11-4de7-9c7f-7d5c7bfc1402 tempest-ProjectMemberTests-730908627 None] Flow 'volume_create_manager' (969e4b01-9d17-4fae-8c27-98f3bf1ef238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:39:21 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-96bf0de5-1f11-4de7-9c7f-7d5c7bfc1402 tempest-ProjectMemberTests-730908627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e351c54d-a7c9-4267-823d-3cfa5fcfeb2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:39:21 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-96bf0de5-1f11-4de7-9c7f-7d5c7bfc1402 tempest-ProjectMemberTests-730908627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e351c54d-a7c9-4267-823d-3cfa5fcfeb2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:39:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1103208301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b20c2ef9-1a7f-4ee2-8c14-78090a1e71de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d632f989377844f6b93c3b9bf838981d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:39:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:39:22Z,use_quota=True,user_id='5db8cf25fcc448629ab58c8006482185',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:39:21 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-96bf0de5-1f11-4de7-9c7f-7d5c7bfc1402 tempest-ProjectMemberTests-730908627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bfdbbd6-c5fc-49b9-b63b-20918cf8c17d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:39:21 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-96bf0de5-1f11-4de7-9c7f-7d5c7bfc1402 tempest-ProjectMemberTests-730908627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bfdbbd6-c5fc-49b9-b63b-20918cf8c17d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:39:21 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-96bf0de5-1f11-4de7-9c7f-7d5c7bfc1402 tempest-ProjectMemberTests-730908627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96a0b0b1-973f-4c89-92a1-ff118fd587de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:39:21 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-96bf0de5-1f11-4de7-9c7f-7d5c7bfc1402 tempest-ProjectMemberTests-730908627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96a0b0b1-973f-4c89-92a1-ff118fd587de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b20c2ef9-1a7f-4ee2-8c14-78090a1e71de', 'volume_name': 'volume-b20c2ef9-1a7f-4ee2-8c14-78090a1e71de', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:39:21 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-96bf0de5-1f11-4de7-9c7f-7d5c7bfc1402 tempest-ProjectMemberTests-730908627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af8502e0-cb85-4141-b014-68f390f64227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:39:21 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-96bf0de5-1f11-4de7-9c7f-7d5c7bfc1402 tempest-ProjectMemberTests-730908627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af8502e0-cb85-4141-b014-68f390f64227) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:39:21 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-96bf0de5-1f11-4de7-9c7f-7d5c7bfc1402 tempest-ProjectMemberTests-730908627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af92f58a-61a7-44b3-ba95-8c402a6c9cf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:39:21 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-96bf0de5-1f11-4de7-9c7f-7d5c7bfc1402 tempest-ProjectMemberTests-730908627 None] Volume b20c2ef9-1a7f-4ee2-8c14-78090a1e71de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b20c2ef9-1a7f-4ee2-8c14-78090a1e71de', 'volume_size': 1} Sep 16 20:39:21 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-96bf0de5-1f11-4de7-9c7f-7d5c7bfc1402 tempest-ProjectMemberTests-730908627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:39:21 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-96bf0de5-1f11-4de7-9c7f-7d5c7bfc1402 tempest-ProjectMemberTests-730908627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:39:21 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-96bf0de5-1f11-4de7-9c7f-7d5c7bfc1402 tempest-ProjectMemberTests-730908627 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:39:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1103208301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b20c2ef9-1a7f-4ee2-8c14-78090a1e71de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d632f989377844f6b93c3b9bf838981d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:39:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:39:22Z,use_quota=True,user_id='5db8cf25fcc448629ab58c8006482185',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:39:21 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-96bf0de5-1f11-4de7-9c7f-7d5c7bfc1402 tempest-ProjectMemberTests-730908627 None] Creating volume b20c2ef9-1a7f-4ee2-8c14-78090a1e71de {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:39:21 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-96bf0de5-1f11-4de7-9c7f-7d5c7bfc1402 tempest-ProjectMemberTests-730908627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:39:21 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-96bf0de5-1f11-4de7-9c7f-7d5c7bfc1402 tempest-ProjectMemberTests-730908627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:39:21 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-96bf0de5-1f11-4de7-9c7f-7d5c7bfc1402 tempest-ProjectMemberTests-730908627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:39:21 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-96bf0de5-1f11-4de7-9c7f-7d5c7bfc1402 tempest-ProjectMemberTests-730908627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:39:21 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-96bf0de5-1f11-4de7-9c7f-7d5c7bfc1402 tempest-ProjectMemberTests-730908627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:39:21 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-96bf0de5-1f11-4de7-9c7f-7d5c7bfc1402 tempest-ProjectMemberTests-730908627 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:39:21 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-96bf0de5-1f11-4de7-9c7f-7d5c7bfc1402 tempest-ProjectMemberTests-730908627 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:39:21 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-96bf0de5-1f11-4de7-9c7f-7d5c7bfc1402 tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b20c2ef9-1a7f-4ee2-8c14-78090a1e71de 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:21 devstack sudo[107169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b20c2ef9-1a7f-4ee2-8c14-78090a1e71de 1073741824 Sep 16 20:39:21 devstack sudo[107169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:21 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-7a3fc36f-733b-4314-b52b-965db967aa6e tempest-ProjectReaderTests-2105386862 None] Created reservations ['bee21623-68bd-4c76-9033-35ea410881b0', '6a079dbd-92d6-4c70-a1d0-bc100703c94c', '6b961a71-d08a-46c0-ab01-15d6d8708200', '64766e0d-873b-4a61-ada8-b95f6087a2e6'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:39:21 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-7a3fc36f-733b-4314-b52b-965db967aa6e tempest-ProjectReaderTests-2105386862 None] Delete snapshot completed successfully. Sep 16 20:39:21 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-7a3fc36f-733b-4314-b52b-965db967aa6e tempest-ProjectReaderTests-2105386862 None] Lock "cinder-73bf9d5b-bb2b-4b59-8a05-058aa3195f27-delete_snapshot" released by "delete_snapshot" :: held 1.759s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:39:22 devstack sudo[107169]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:22 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-96bf0de5-1f11-4de7-9c7f-7d5c7bfc1402 tempest-ProjectMemberTests-730908627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b20c2ef9-1a7f-4ee2-8c14-78090a1e71de 1073741824" returned: 0 in 0.426s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:22 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-96bf0de5-1f11-4de7-9c7f-7d5c7bfc1402 tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b20c2ef9-1a7f-4ee2-8c14-78090a1e71de {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:22 devstack sudo[107175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b20c2ef9-1a7f-4ee2-8c14-78090a1e71de Sep 16 20:39:22 devstack sudo[107175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:22 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-4dbc0eb5-3edd-46f3-907b-9fa468c02205 tempest-ProjectReaderTests-2105386862 None] Acquiring lock "cinder-93ac1c1f-9897-4a10-a7bb-3878cafbf538-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:39:22 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-4dbc0eb5-3edd-46f3-907b-9fa468c02205 tempest-ProjectReaderTests-2105386862 None] Lock "cinder-93ac1c1f-9897-4a10-a7bb-3878cafbf538-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:39:22 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-4dbc0eb5-3edd-46f3-907b-9fa468c02205 tempest-ProjectReaderTests-2105386862 None] Acquiring lock "cinder-quobyte-93ac1c1f-9897-4a10-a7bb-3878cafbf538" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:39:22 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-4dbc0eb5-3edd-46f3-907b-9fa468c02205 tempest-ProjectReaderTests-2105386862 None] Lock "cinder-quobyte-93ac1c1f-9897-4a10-a7bb-3878cafbf538" acquired by "delete_volume" :: waited 0.016s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:39:22 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ad6621d-f02a-4d2e-9fa4-f62dbd842b8d]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:39:22 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-4dbc0eb5-3edd-46f3-907b-9fa468c02205 tempest-ProjectReaderTests-2105386862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-93ac1c1f-9897-4a10-a7bb-3878cafbf538 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:22 devstack sudo[107175]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:22 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-96bf0de5-1f11-4de7-9c7f-7d5c7bfc1402 tempest-ProjectMemberTests-730908627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b20c2ef9-1a7f-4ee2-8c14-78090a1e71de" returned: 0 in 0.262s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:22 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-96bf0de5-1f11-4de7-9c7f-7d5c7bfc1402 tempest-ProjectMemberTests-730908627 None] <== create_volume: return (721ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:39:22 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-96bf0de5-1f11-4de7-9c7f-7d5c7bfc1402 tempest-ProjectMemberTests-730908627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.724s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:39:22 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-96bf0de5-1f11-4de7-9c7f-7d5c7bfc1402 tempest-ProjectMemberTests-730908627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af92f58a-61a7-44b3-ba95-8c402a6c9cf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b20c2ef9-1a7f-4ee2-8c14-78090a1e71de', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:39:22 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-96bf0de5-1f11-4de7-9c7f-7d5c7bfc1402 tempest-ProjectMemberTests-730908627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cf7fae9-dca0-4691-acb1-619e8267b9a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:39:22 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-96bf0de5-1f11-4de7-9c7f-7d5c7bfc1402 tempest-ProjectMemberTests-730908627 None] Volume volume-b20c2ef9-1a7f-4ee2-8c14-78090a1e71de (b20c2ef9-1a7f-4ee2-8c14-78090a1e71de): created successfully Sep 16 20:39:22 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-96bf0de5-1f11-4de7-9c7f-7d5c7bfc1402 tempest-ProjectMemberTests-730908627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cf7fae9-dca0-4691-acb1-619e8267b9a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:39:22 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-96bf0de5-1f11-4de7-9c7f-7d5c7bfc1402 tempest-ProjectMemberTests-730908627 None] Flow 'volume_create_manager' (969e4b01-9d17-4fae-8c27-98f3bf1ef238) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:39:22 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-96bf0de5-1f11-4de7-9c7f-7d5c7bfc1402 tempest-ProjectMemberTests-730908627 None] Created volume successfully. Sep 16 20:39:22 devstack sudo[107178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-93ac1c1f-9897-4a10-a7bb-3878cafbf538 Sep 16 20:39:22 devstack sudo[107178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:22 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-1202d645-ca58-42b8-901b-301a8454ec5c tempest-ProjectMemberTests-730908627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:39:22 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-1202d645-ca58-42b8-901b-301a8454ec5c tempest-ProjectMemberTests-730908627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:39:22 devstack sudo[107178]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:22 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-4dbc0eb5-3edd-46f3-907b-9fa468c02205 tempest-ProjectReaderTests-2105386862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-93ac1c1f-9897-4a10-a7bb-3878cafbf538" returned: 0 in 0.417s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:22 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-4dbc0eb5-3edd-46f3-907b-9fa468c02205 tempest-ProjectReaderTests-2105386862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-93ac1c1f-9897-4a10-a7bb-3878cafbf538 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:22 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-1202d645-ca58-42b8-901b-301a8454ec5c tempest-ProjectMemberTests-730908627 None] Creating offline snapshot c42c644a-9e5b-4391-a987-577dd3ed8a03 of volume b20c2ef9-1a7f-4ee2-8c14-78090a1e71de {{(pid=86188) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 20:39:22 devstack sudo[107185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-93ac1c1f-9897-4a10-a7bb-3878cafbf538 Sep 16 20:39:22 devstack sudo[107185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:22 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[f571abda-8912-4fef-a7d9-16cbaef7a02d]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:39:22 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-1202d645-ca58-42b8-901b-301a8454ec5c tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b20c2ef9-1a7f-4ee2-8c14-78090a1e71de {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:23 devstack sudo[107187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b20c2ef9-1a7f-4ee2-8c14-78090a1e71de Sep 16 20:39:23 devstack sudo[107187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:23 devstack sudo[107185]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:23 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-4dbc0eb5-3edd-46f3-907b-9fa468c02205 tempest-ProjectReaderTests-2105386862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-93ac1c1f-9897-4a10-a7bb-3878cafbf538" returned: 0 in 0.279s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:23 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-4dbc0eb5-3edd-46f3-907b-9fa468c02205 tempest-ProjectReaderTests-2105386862 None] Lock "cinder-quobyte-93ac1c1f-9897-4a10-a7bb-3878cafbf538" released by "delete_volume" :: held 0.753s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:39:23 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-4dbc0eb5-3edd-46f3-907b-9fa468c02205 tempest-ProjectReaderTests-2105386862 None] Created reservations ['e68081f6-23b1-43e4-93d4-a1d6f11aab9f', '92df2d2f-626f-4ac8-a672-4b30ae31c6aa', 'ec9e5b3f-228b-4d59-b5d2-06c9c6d3cb9d', '86c35189-5e54-4342-9652-3404495e1960'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:39:23 devstack sudo[107187]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:23 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-4dbc0eb5-3edd-46f3-907b-9fa468c02205 tempest-ProjectReaderTests-2105386862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:39:23 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-4dbc0eb5-3edd-46f3-907b-9fa468c02205 tempest-ProjectReaderTests-2105386862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:39:23 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-4dbc0eb5-3edd-46f3-907b-9fa468c02205 tempest-ProjectReaderTests-2105386862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:39:23 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-4dbc0eb5-3edd-46f3-907b-9fa468c02205 tempest-ProjectReaderTests-2105386862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:39:23 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-4dbc0eb5-3edd-46f3-907b-9fa468c02205 tempest-ProjectReaderTests-2105386862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:39:23 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-4dbc0eb5-3edd-46f3-907b-9fa468c02205 tempest-ProjectReaderTests-2105386862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:23 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-1202d645-ca58-42b8-901b-301a8454ec5c tempest-ProjectMemberTests-730908627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b20c2ef9-1a7f-4ee2-8c14-78090a1e71de" returned: 0 in 0.381s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:23 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-1202d645-ca58-42b8-901b-301a8454ec5c tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b20c2ef9-1a7f-4ee2-8c14-78090a1e71de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b20c2ef9-1a7f-4ee2-8c14-78090a1e71de.c42c644a-9e5b-4391-a987-577dd3ed8a03 1G {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:23 devstack sudo[107193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:39:23 devstack sudo[107193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:23 devstack sudo[107194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b20c2ef9-1a7f-4ee2-8c14-78090a1e71de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b20c2ef9-1a7f-4ee2-8c14-78090a1e71de.c42c644a-9e5b-4391-a987-577dd3ed8a03 1G Sep 16 20:39:23 devstack sudo[107194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:23 devstack sudo[107193]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:23 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-4dbc0eb5-3edd-46f3-907b-9fa468c02205 tempest-ProjectReaderTests-2105386862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.259s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:23 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-4dbc0eb5-3edd-46f3-907b-9fa468c02205 tempest-ProjectReaderTests-2105386862 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:39:23 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-4dbc0eb5-3edd-46f3-907b-9fa468c02205 tempest-ProjectReaderTests-2105386862 None] Deleted volume successfully. Sep 16 20:39:23 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-4dbc0eb5-3edd-46f3-907b-9fa468c02205 tempest-ProjectReaderTests-2105386862 None] Lock "cinder-93ac1c1f-9897-4a10-a7bb-3878cafbf538-delete_volume" released by "delete_volume" :: held 1.214s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:39:23 devstack sudo[107194]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:23 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-1202d645-ca58-42b8-901b-301a8454ec5c tempest-ProjectMemberTests-730908627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b20c2ef9-1a7f-4ee2-8c14-78090a1e71de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b20c2ef9-1a7f-4ee2-8c14-78090a1e71de.c42c644a-9e5b-4391-a987-577dd3ed8a03 1G" returned: 0 in 0.462s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:23 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-1202d645-ca58-42b8-901b-301a8454ec5c tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b20c2ef9-1a7f-4ee2-8c14-78090a1e71de -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b20c2ef9-1a7f-4ee2-8c14-78090a1e71de.c42c644a-9e5b-4391-a987-577dd3ed8a03 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:23 devstack sudo[107202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b20c2ef9-1a7f-4ee2-8c14-78090a1e71de -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b20c2ef9-1a7f-4ee2-8c14-78090a1e71de.c42c644a-9e5b-4391-a987-577dd3ed8a03 Sep 16 20:39:23 devstack sudo[107202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:24 devstack sudo[107202]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:24 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-1202d645-ca58-42b8-901b-301a8454ec5c tempest-ProjectMemberTests-730908627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b20c2ef9-1a7f-4ee2-8c14-78090a1e71de -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b20c2ef9-1a7f-4ee2-8c14-78090a1e71de.c42c644a-9e5b-4391-a987-577dd3ed8a03" returned: 0 in 0.322s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:24 devstack cinder-volume[86188]: WARNING cinder.volume.drivers.remotefs [None req-1202d645-ca58-42b8-901b-301a8454ec5c tempest-ProjectMemberTests-730908627 None] /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b20c2ef9-1a7f-4ee2-8c14-78090a1e71de.c42c644a-9e5b-4391-a987-577dd3ed8a03 is being set with open permissions: ugo+rw Sep 16 20:39:24 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-1202d645-ca58-42b8-901b-301a8454ec5c tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b20c2ef9-1a7f-4ee2-8c14-78090a1e71de.c42c644a-9e5b-4391-a987-577dd3ed8a03 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:24 devstack sudo[107207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b20c2ef9-1a7f-4ee2-8c14-78090a1e71de.c42c644a-9e5b-4391-a987-577dd3ed8a03 Sep 16 20:39:24 devstack sudo[107207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:24 devstack sudo[107207]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:24 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-1202d645-ca58-42b8-901b-301a8454ec5c tempest-ProjectMemberTests-730908627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b20c2ef9-1a7f-4ee2-8c14-78090a1e71de.c42c644a-9e5b-4391-a987-577dd3ed8a03" returned: 0 in 0.249s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:24 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-1202d645-ca58-42b8-901b-301a8454ec5c tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b20c2ef9-1a7f-4ee2-8c14-78090a1e71de.info {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:24 devstack sudo[107210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b20c2ef9-1a7f-4ee2-8c14-78090a1e71de.info Sep 16 20:39:24 devstack sudo[107210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:24 devstack sudo[107210]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:24 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-1202d645-ca58-42b8-901b-301a8454ec5c tempest-ProjectMemberTests-730908627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b20c2ef9-1a7f-4ee2-8c14-78090a1e71de.info" returned: 0 in 0.261s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:24 devstack cinder-volume[86188]: WARNING cinder.volume.drivers.remotefs [None req-1202d645-ca58-42b8-901b-301a8454ec5c tempest-ProjectMemberTests-730908627 None] /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b20c2ef9-1a7f-4ee2-8c14-78090a1e71de.info is being set with open permissions: ugo+rw Sep 16 20:39:24 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-1202d645-ca58-42b8-901b-301a8454ec5c tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b20c2ef9-1a7f-4ee2-8c14-78090a1e71de.info {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:24 devstack sudo[107213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b20c2ef9-1a7f-4ee2-8c14-78090a1e71de.info Sep 16 20:39:24 devstack sudo[107213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:24 devstack sudo[107213]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:24 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-1202d645-ca58-42b8-901b-301a8454ec5c tempest-ProjectMemberTests-730908627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b20c2ef9-1a7f-4ee2-8c14-78090a1e71de.info" returned: 0 in 0.244s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:24 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-1202d645-ca58-42b8-901b-301a8454ec5c tempest-ProjectMemberTests-730908627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.043s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:39:24 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-1202d645-ca58-42b8-901b-301a8454ec5c tempest-ProjectMemberTests-730908627 None] Create snapshot completed successfully Sep 16 20:39:25 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-c3950159-30f9-4b17-b581-a7eb2ba630bb tempest-ProjectMemberTests-730908627 None] Acquiring lock "cinder-c42c644a-9e5b-4391-a987-577dd3ed8a03-delete_snapshot" by "delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:39:26 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-c3950159-30f9-4b17-b581-a7eb2ba630bb tempest-ProjectMemberTests-730908627 None] Lock "cinder-c42c644a-9e5b-4391-a987-577dd3ed8a03-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:39:26 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-c3950159-30f9-4b17-b581-a7eb2ba630bb tempest-ProjectMemberTests-730908627 None] Acquiring lock "cinder-quobyte-b20c2ef9-1a7f-4ee2-8c14-78090a1e71de" by "delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:39:26 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-c3950159-30f9-4b17-b581-a7eb2ba630bb tempest-ProjectMemberTests-730908627 None] Lock "cinder-quobyte-b20c2ef9-1a7f-4ee2-8c14-78090a1e71de" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:39:26 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-c3950159-30f9-4b17-b581-a7eb2ba630bb tempest-ProjectMemberTests-730908627 None] Acquiring lock "cinder-quobyte-c42c644a-9e5b-4391-a987-577dd3ed8a03" by "_delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:39:26 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-c3950159-30f9-4b17-b581-a7eb2ba630bb tempest-ProjectMemberTests-730908627 None] Lock "cinder-quobyte-c42c644a-9e5b-4391-a987-577dd3ed8a03" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:39:26 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-c3950159-30f9-4b17-b581-a7eb2ba630bb tempest-ProjectMemberTests-730908627 None] Deleting offline snapshot c42c644a-9e5b-4391-a987-577dd3ed8a03 of volume b20c2ef9-1a7f-4ee2-8c14-78090a1e71de {{(pid=86188) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 20:39:26 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-c3950159-30f9-4b17-b581-a7eb2ba630bb tempest-ProjectMemberTests-730908627 None] snapshot_file for this snap is: volume-b20c2ef9-1a7f-4ee2-8c14-78090a1e71de.c42c644a-9e5b-4391-a987-577dd3ed8a03 {{(pid=86188) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 20:39:26 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d2a72fb-2d7e-4d9f-981e-dfa250203410]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:39:26 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-c3950159-30f9-4b17-b581-a7eb2ba630bb tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b20c2ef9-1a7f-4ee2-8c14-78090a1e71de.c42c644a-9e5b-4391-a987-577dd3ed8a03 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:26 devstack sudo[107216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b20c2ef9-1a7f-4ee2-8c14-78090a1e71de.c42c644a-9e5b-4391-a987-577dd3ed8a03 Sep 16 20:39:26 devstack sudo[107216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:26 devstack sudo[107216]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:26 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-c3950159-30f9-4b17-b581-a7eb2ba630bb tempest-ProjectMemberTests-730908627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b20c2ef9-1a7f-4ee2-8c14-78090a1e71de.c42c644a-9e5b-4391-a987-577dd3ed8a03" returned: 0 in 0.349s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:26 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-c3950159-30f9-4b17-b581-a7eb2ba630bb tempest-ProjectMemberTests-730908627 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b20c2ef9-1a7f-4ee2-8c14-78090a1e71de(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86188) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 20:39:26 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d786117-60d6-42d8-a57f-4e81a23daa0c]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:39:26 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-c3950159-30f9-4b17-b581-a7eb2ba630bb tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b20c2ef9-1a7f-4ee2-8c14-78090a1e71de {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:26 devstack sudo[107221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b20c2ef9-1a7f-4ee2-8c14-78090a1e71de Sep 16 20:39:26 devstack sudo[107221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:26 devstack sudo[107221]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:26 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-c3950159-30f9-4b17-b581-a7eb2ba630bb tempest-ProjectMemberTests-730908627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b20c2ef9-1a7f-4ee2-8c14-78090a1e71de" returned: 0 in 0.341s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:26 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-c3950159-30f9-4b17-b581-a7eb2ba630bb tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b20c2ef9-1a7f-4ee2-8c14-78090a1e71de.c42c644a-9e5b-4391-a987-577dd3ed8a03 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:26 devstack sudo[107226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b20c2ef9-1a7f-4ee2-8c14-78090a1e71de.c42c644a-9e5b-4391-a987-577dd3ed8a03 Sep 16 20:39:26 devstack sudo[107226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:27 devstack sudo[107226]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:27 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-c3950159-30f9-4b17-b581-a7eb2ba630bb tempest-ProjectMemberTests-730908627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b20c2ef9-1a7f-4ee2-8c14-78090a1e71de.c42c644a-9e5b-4391-a987-577dd3ed8a03" returned: 0 in 0.325s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:27 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-c3950159-30f9-4b17-b581-a7eb2ba630bb tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b20c2ef9-1a7f-4ee2-8c14-78090a1e71de.c42c644a-9e5b-4391-a987-577dd3ed8a03 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:27 devstack sudo[107231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b20c2ef9-1a7f-4ee2-8c14-78090a1e71de.c42c644a-9e5b-4391-a987-577dd3ed8a03 Sep 16 20:39:27 devstack sudo[107231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:27 devstack sudo[107231]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:27 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-c3950159-30f9-4b17-b581-a7eb2ba630bb tempest-ProjectMemberTests-730908627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b20c2ef9-1a7f-4ee2-8c14-78090a1e71de.c42c644a-9e5b-4391-a987-577dd3ed8a03" returned: 0 in 0.243s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:27 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-c3950159-30f9-4b17-b581-a7eb2ba630bb tempest-ProjectMemberTests-730908627 None] Lock "cinder-quobyte-c42c644a-9e5b-4391-a987-577dd3ed8a03" released by "_delete_snapshot" :: held 1.350s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:39:27 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-c3950159-30f9-4b17-b581-a7eb2ba630bb tempest-ProjectMemberTests-730908627 None] Lock "cinder-quobyte-b20c2ef9-1a7f-4ee2-8c14-78090a1e71de" released by "delete_snapshot" :: held 1.370s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:39:27 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-c3950159-30f9-4b17-b581-a7eb2ba630bb tempest-ProjectMemberTests-730908627 None] Created reservations ['3cd032b8-1ddb-4f45-b53a-24f6aecd7161', '542d7b41-ee24-400e-aac4-066e8168ea6f', '80c9d7e4-de77-464f-85c9-3fad78cf2290', 'd95c88b2-3ae3-4e28-91a3-8b5031a4a391'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:39:27 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-c3950159-30f9-4b17-b581-a7eb2ba630bb tempest-ProjectMemberTests-730908627 None] Delete snapshot completed successfully. Sep 16 20:39:27 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-c3950159-30f9-4b17-b581-a7eb2ba630bb tempest-ProjectMemberTests-730908627 None] Lock "cinder-c42c644a-9e5b-4391-a987-577dd3ed8a03-delete_snapshot" released by "delete_snapshot" :: held 1.505s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:39:28 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-92c48bf3-2a4b-4a1a-befa-9c15ec5501b7 tempest-ProjectMemberTests-730908627 None] Acquiring lock "cinder-b20c2ef9-1a7f-4ee2-8c14-78090a1e71de-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:39:28 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-92c48bf3-2a4b-4a1a-befa-9c15ec5501b7 tempest-ProjectMemberTests-730908627 None] Lock "cinder-b20c2ef9-1a7f-4ee2-8c14-78090a1e71de-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:39:28 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-92c48bf3-2a4b-4a1a-befa-9c15ec5501b7 tempest-ProjectMemberTests-730908627 None] Acquiring lock "cinder-quobyte-b20c2ef9-1a7f-4ee2-8c14-78090a1e71de" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:39:28 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-92c48bf3-2a4b-4a1a-befa-9c15ec5501b7 tempest-ProjectMemberTests-730908627 None] Lock "cinder-quobyte-b20c2ef9-1a7f-4ee2-8c14-78090a1e71de" acquired by "delete_volume" :: waited 0.013s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:39:28 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d19b911-051e-4dc7-813a-b8c8e43fdaf4]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:39:28 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-92c48bf3-2a4b-4a1a-befa-9c15ec5501b7 tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b20c2ef9-1a7f-4ee2-8c14-78090a1e71de {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:28 devstack sudo[107234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b20c2ef9-1a7f-4ee2-8c14-78090a1e71de Sep 16 20:39:28 devstack sudo[107234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:28 devstack sudo[107234]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:28 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-92c48bf3-2a4b-4a1a-befa-9c15ec5501b7 tempest-ProjectMemberTests-730908627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b20c2ef9-1a7f-4ee2-8c14-78090a1e71de" returned: 0 in 0.350s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:28 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-92c48bf3-2a4b-4a1a-befa-9c15ec5501b7 tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b20c2ef9-1a7f-4ee2-8c14-78090a1e71de {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:28 devstack sudo[107239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b20c2ef9-1a7f-4ee2-8c14-78090a1e71de Sep 16 20:39:28 devstack sudo[107239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:28 devstack sudo[107239]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:28 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-92c48bf3-2a4b-4a1a-befa-9c15ec5501b7 tempest-ProjectMemberTests-730908627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-b20c2ef9-1a7f-4ee2-8c14-78090a1e71de" returned: 0 in 0.236s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:28 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-92c48bf3-2a4b-4a1a-befa-9c15ec5501b7 tempest-ProjectMemberTests-730908627 None] Lock "cinder-quobyte-b20c2ef9-1a7f-4ee2-8c14-78090a1e71de" released by "delete_volume" :: held 0.643s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:39:28 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-92c48bf3-2a4b-4a1a-befa-9c15ec5501b7 tempest-ProjectMemberTests-730908627 None] Created reservations ['23457327-9728-4729-9c05-72d32939ba6e', '7f62ad49-4e8d-4724-84fb-d5d3d85aad48', 'c9e386c5-5a4b-4d30-8ed6-6011addd17e9', 'b6ebbf0d-ddce-4ee5-91e4-e2dd2630571f'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:39:28 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-92c48bf3-2a4b-4a1a-befa-9c15ec5501b7 tempest-ProjectMemberTests-730908627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:39:28 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-92c48bf3-2a4b-4a1a-befa-9c15ec5501b7 tempest-ProjectMemberTests-730908627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:39:28 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-92c48bf3-2a4b-4a1a-befa-9c15ec5501b7 tempest-ProjectMemberTests-730908627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:39:28 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-92c48bf3-2a4b-4a1a-befa-9c15ec5501b7 tempest-ProjectMemberTests-730908627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:39:28 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-92c48bf3-2a4b-4a1a-befa-9c15ec5501b7 tempest-ProjectMemberTests-730908627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:39:28 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-92c48bf3-2a4b-4a1a-befa-9c15ec5501b7 tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:28 devstack sudo[107242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:39:28 devstack sudo[107242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:29 devstack sudo[107242]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:29 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-92c48bf3-2a4b-4a1a-befa-9c15ec5501b7 tempest-ProjectMemberTests-730908627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.229s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:29 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-92c48bf3-2a4b-4a1a-befa-9c15ec5501b7 tempest-ProjectMemberTests-730908627 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:39:29 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-92c48bf3-2a4b-4a1a-befa-9c15ec5501b7 tempest-ProjectMemberTests-730908627 None] Deleted volume successfully. Sep 16 20:39:29 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-92c48bf3-2a4b-4a1a-befa-9c15ec5501b7 tempest-ProjectMemberTests-730908627 None] Lock "cinder-b20c2ef9-1a7f-4ee2-8c14-78090a1e71de-delete_volume" released by "delete_volume" :: held 1.087s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:39:29 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2344498-4e5a-475a-9259-7e80f4ce103a tempest-ProjectMemberTests-730908627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:39:29 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-c2344498-4e5a-475a-9259-7e80f4ce103a tempest-ProjectMemberTests-730908627 None] Flow 'volume_create_manager' (d420ff52-b3bc-4fd3-be2d-a9b61245a5ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:39:29 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-c2344498-4e5a-475a-9259-7e80f4ce103a tempest-ProjectMemberTests-730908627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efa5e571-0f24-4b46-8e64-0260929395e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:39:29 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-c2344498-4e5a-475a-9259-7e80f4ce103a tempest-ProjectMemberTests-730908627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efa5e571-0f24-4b46-8e64-0260929395e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:39:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-620499816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=268ef814-fc60-485a-a95d-432c96547ff0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d632f989377844f6b93c3b9bf838981d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:39:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:39:30Z,use_quota=True,user_id='5db8cf25fcc448629ab58c8006482185',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:39:29 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-c2344498-4e5a-475a-9259-7e80f4ce103a tempest-ProjectMemberTests-730908627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84276ee9-6259-413b-a72b-0939d70962d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:39:29 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-c2344498-4e5a-475a-9259-7e80f4ce103a tempest-ProjectMemberTests-730908627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84276ee9-6259-413b-a72b-0939d70962d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:39:29 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-c2344498-4e5a-475a-9259-7e80f4ce103a tempest-ProjectMemberTests-730908627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a03e812d-8789-4788-a646-3150dca4e166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:39:29 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-c2344498-4e5a-475a-9259-7e80f4ce103a tempest-ProjectMemberTests-730908627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a03e812d-8789-4788-a646-3150dca4e166) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '268ef814-fc60-485a-a95d-432c96547ff0', 'volume_name': 'volume-268ef814-fc60-485a-a95d-432c96547ff0', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:39:29 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-c2344498-4e5a-475a-9259-7e80f4ce103a tempest-ProjectMemberTests-730908627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31e0a050-082a-4f7c-ab01-0400dbfb7fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:39:29 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-c2344498-4e5a-475a-9259-7e80f4ce103a tempest-ProjectMemberTests-730908627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31e0a050-082a-4f7c-ab01-0400dbfb7fbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:39:29 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-c2344498-4e5a-475a-9259-7e80f4ce103a tempest-ProjectMemberTests-730908627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (057692c6-f2a3-4571-90a3-4432c70145d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:39:29 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-c2344498-4e5a-475a-9259-7e80f4ce103a tempest-ProjectMemberTests-730908627 None] Volume 268ef814-fc60-485a-a95d-432c96547ff0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-268ef814-fc60-485a-a95d-432c96547ff0', 'volume_size': 1} Sep 16 20:39:29 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-c2344498-4e5a-475a-9259-7e80f4ce103a tempest-ProjectMemberTests-730908627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:39:29 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-c2344498-4e5a-475a-9259-7e80f4ce103a tempest-ProjectMemberTests-730908627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:39:29 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-c2344498-4e5a-475a-9259-7e80f4ce103a tempest-ProjectMemberTests-730908627 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:39:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-620499816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=268ef814-fc60-485a-a95d-432c96547ff0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d632f989377844f6b93c3b9bf838981d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:39:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:39:30Z,use_quota=True,user_id='5db8cf25fcc448629ab58c8006482185',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:39:29 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-c2344498-4e5a-475a-9259-7e80f4ce103a tempest-ProjectMemberTests-730908627 None] Creating volume 268ef814-fc60-485a-a95d-432c96547ff0 {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:39:29 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-c2344498-4e5a-475a-9259-7e80f4ce103a tempest-ProjectMemberTests-730908627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:39:29 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-c2344498-4e5a-475a-9259-7e80f4ce103a tempest-ProjectMemberTests-730908627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:39:29 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-c2344498-4e5a-475a-9259-7e80f4ce103a tempest-ProjectMemberTests-730908627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:39:29 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-c2344498-4e5a-475a-9259-7e80f4ce103a tempest-ProjectMemberTests-730908627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:39:29 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-c2344498-4e5a-475a-9259-7e80f4ce103a tempest-ProjectMemberTests-730908627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:39:29 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-c2344498-4e5a-475a-9259-7e80f4ce103a tempest-ProjectMemberTests-730908627 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:39:29 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-c2344498-4e5a-475a-9259-7e80f4ce103a tempest-ProjectMemberTests-730908627 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:39:29 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-c2344498-4e5a-475a-9259-7e80f4ce103a tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-268ef814-fc60-485a-a95d-432c96547ff0 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:29 devstack sudo[107246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-268ef814-fc60-485a-a95d-432c96547ff0 1073741824 Sep 16 20:39:29 devstack sudo[107246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:30 devstack sudo[107246]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:30 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-c2344498-4e5a-475a-9259-7e80f4ce103a tempest-ProjectMemberTests-730908627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-268ef814-fc60-485a-a95d-432c96547ff0 1073741824" returned: 0 in 0.397s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:30 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-c2344498-4e5a-475a-9259-7e80f4ce103a tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-268ef814-fc60-485a-a95d-432c96547ff0 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:30 devstack sudo[107251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-268ef814-fc60-485a-a95d-432c96547ff0 Sep 16 20:39:30 devstack sudo[107251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:30 devstack sudo[107251]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:30 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-c2344498-4e5a-475a-9259-7e80f4ce103a tempest-ProjectMemberTests-730908627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-268ef814-fc60-485a-a95d-432c96547ff0" returned: 0 in 0.237s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:30 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-c2344498-4e5a-475a-9259-7e80f4ce103a tempest-ProjectMemberTests-730908627 None] <== create_volume: return (671ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:39:30 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-c2344498-4e5a-475a-9259-7e80f4ce103a tempest-ProjectMemberTests-730908627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.674s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:39:30 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-c2344498-4e5a-475a-9259-7e80f4ce103a tempest-ProjectMemberTests-730908627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (057692c6-f2a3-4571-90a3-4432c70145d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-268ef814-fc60-485a-a95d-432c96547ff0', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:39:30 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-c2344498-4e5a-475a-9259-7e80f4ce103a tempest-ProjectMemberTests-730908627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (779e1bb5-0a73-4415-a013-4c6daab628c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:39:30 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-c2344498-4e5a-475a-9259-7e80f4ce103a tempest-ProjectMemberTests-730908627 None] Volume volume-268ef814-fc60-485a-a95d-432c96547ff0 (268ef814-fc60-485a-a95d-432c96547ff0): created successfully Sep 16 20:39:30 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-c2344498-4e5a-475a-9259-7e80f4ce103a tempest-ProjectMemberTests-730908627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (779e1bb5-0a73-4415-a013-4c6daab628c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:39:30 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-c2344498-4e5a-475a-9259-7e80f4ce103a tempest-ProjectMemberTests-730908627 None] Flow 'volume_create_manager' (d420ff52-b3bc-4fd3-be2d-a9b61245a5ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:39:30 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-c2344498-4e5a-475a-9259-7e80f4ce103a tempest-ProjectMemberTests-730908627 None] Created volume successfully. Sep 16 20:39:30 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-cdcf0c29-b283-4c17-91a3-912d7ed6db4c tempest-ProjectMemberTests-730908627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:39:30 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-cdcf0c29-b283-4c17-91a3-912d7ed6db4c tempest-ProjectMemberTests-730908627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:39:30 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-cdcf0c29-b283-4c17-91a3-912d7ed6db4c tempest-ProjectMemberTests-730908627 None] Creating offline snapshot 6293c08f-696b-4243-812f-fdeb16bcef72 of volume 268ef814-fc60-485a-a95d-432c96547ff0 {{(pid=86188) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 20:39:30 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[176a7628-38bb-4170-b27d-b8d5dae46b70]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:39:30 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-cdcf0c29-b283-4c17-91a3-912d7ed6db4c tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-268ef814-fc60-485a-a95d-432c96547ff0 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:30 devstack sudo[107255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-268ef814-fc60-485a-a95d-432c96547ff0 Sep 16 20:39:30 devstack sudo[107255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:31 devstack sudo[107255]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:31 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-cdcf0c29-b283-4c17-91a3-912d7ed6db4c tempest-ProjectMemberTests-730908627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-268ef814-fc60-485a-a95d-432c96547ff0" returned: 0 in 0.345s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:31 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-cdcf0c29-b283-4c17-91a3-912d7ed6db4c tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-268ef814-fc60-485a-a95d-432c96547ff0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-268ef814-fc60-485a-a95d-432c96547ff0.6293c08f-696b-4243-812f-fdeb16bcef72 1G {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:31 devstack sudo[107260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-268ef814-fc60-485a-a95d-432c96547ff0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-268ef814-fc60-485a-a95d-432c96547ff0.6293c08f-696b-4243-812f-fdeb16bcef72 1G Sep 16 20:39:31 devstack sudo[107260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:31 devstack sudo[107260]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:31 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-cdcf0c29-b283-4c17-91a3-912d7ed6db4c tempest-ProjectMemberTests-730908627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-268ef814-fc60-485a-a95d-432c96547ff0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-268ef814-fc60-485a-a95d-432c96547ff0.6293c08f-696b-4243-812f-fdeb16bcef72 1G" returned: 0 in 0.378s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:31 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-cdcf0c29-b283-4c17-91a3-912d7ed6db4c tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-268ef814-fc60-485a-a95d-432c96547ff0 -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-268ef814-fc60-485a-a95d-432c96547ff0.6293c08f-696b-4243-812f-fdeb16bcef72 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:31 devstack sudo[107265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-268ef814-fc60-485a-a95d-432c96547ff0 -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-268ef814-fc60-485a-a95d-432c96547ff0.6293c08f-696b-4243-812f-fdeb16bcef72 Sep 16 20:39:31 devstack sudo[107265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:31 devstack sudo[107265]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:31 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-cdcf0c29-b283-4c17-91a3-912d7ed6db4c tempest-ProjectMemberTests-730908627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-268ef814-fc60-485a-a95d-432c96547ff0 -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-268ef814-fc60-485a-a95d-432c96547ff0.6293c08f-696b-4243-812f-fdeb16bcef72" returned: 0 in 0.284s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:31 devstack cinder-volume[86188]: WARNING cinder.volume.drivers.remotefs [None req-cdcf0c29-b283-4c17-91a3-912d7ed6db4c tempest-ProjectMemberTests-730908627 None] /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-268ef814-fc60-485a-a95d-432c96547ff0.6293c08f-696b-4243-812f-fdeb16bcef72 is being set with open permissions: ugo+rw Sep 16 20:39:31 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-cdcf0c29-b283-4c17-91a3-912d7ed6db4c tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-268ef814-fc60-485a-a95d-432c96547ff0.6293c08f-696b-4243-812f-fdeb16bcef72 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:31 devstack sudo[107270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-268ef814-fc60-485a-a95d-432c96547ff0.6293c08f-696b-4243-812f-fdeb16bcef72 Sep 16 20:39:31 devstack sudo[107270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:32 devstack sudo[107270]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:32 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-cdcf0c29-b283-4c17-91a3-912d7ed6db4c tempest-ProjectMemberTests-730908627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-268ef814-fc60-485a-a95d-432c96547ff0.6293c08f-696b-4243-812f-fdeb16bcef72" returned: 0 in 0.230s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:32 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-cdcf0c29-b283-4c17-91a3-912d7ed6db4c tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-268ef814-fc60-485a-a95d-432c96547ff0.info {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:32 devstack sudo[107273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-268ef814-fc60-485a-a95d-432c96547ff0.info Sep 16 20:39:32 devstack sudo[107273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:32 devstack sudo[107273]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:32 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-cdcf0c29-b283-4c17-91a3-912d7ed6db4c tempest-ProjectMemberTests-730908627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-268ef814-fc60-485a-a95d-432c96547ff0.info" returned: 0 in 0.246s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:32 devstack cinder-volume[86188]: WARNING cinder.volume.drivers.remotefs [None req-cdcf0c29-b283-4c17-91a3-912d7ed6db4c tempest-ProjectMemberTests-730908627 None] /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-268ef814-fc60-485a-a95d-432c96547ff0.info is being set with open permissions: ugo+rw Sep 16 20:39:32 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-cdcf0c29-b283-4c17-91a3-912d7ed6db4c tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-268ef814-fc60-485a-a95d-432c96547ff0.info {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:32 devstack sudo[107276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-268ef814-fc60-485a-a95d-432c96547ff0.info Sep 16 20:39:32 devstack sudo[107276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:32 devstack sudo[107276]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:32 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-cdcf0c29-b283-4c17-91a3-912d7ed6db4c tempest-ProjectMemberTests-730908627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-268ef814-fc60-485a-a95d-432c96547ff0.info" returned: 0 in 0.240s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:32 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-cdcf0c29-b283-4c17-91a3-912d7ed6db4c tempest-ProjectMemberTests-730908627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.796s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:39:32 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-cdcf0c29-b283-4c17-91a3-912d7ed6db4c tempest-ProjectMemberTests-730908627 None] Create snapshot completed successfully Sep 16 20:39:32 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-976c55ec-347d-4ff8-ab5a-c295c3e18593 tempest-ProjectMemberTests-730908627 None] Acquiring lock "cinder-6293c08f-696b-4243-812f-fdeb16bcef72-delete_snapshot" by "delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:39:33 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-976c55ec-347d-4ff8-ab5a-c295c3e18593 tempest-ProjectMemberTests-730908627 None] Lock "cinder-6293c08f-696b-4243-812f-fdeb16bcef72-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:39:33 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-976c55ec-347d-4ff8-ab5a-c295c3e18593 tempest-ProjectMemberTests-730908627 None] Acquiring lock "cinder-quobyte-268ef814-fc60-485a-a95d-432c96547ff0" by "delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:39:33 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-976c55ec-347d-4ff8-ab5a-c295c3e18593 tempest-ProjectMemberTests-730908627 None] Lock "cinder-quobyte-268ef814-fc60-485a-a95d-432c96547ff0" acquired by "delete_snapshot" :: waited 0.012s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:39:33 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-976c55ec-347d-4ff8-ab5a-c295c3e18593 tempest-ProjectMemberTests-730908627 None] Acquiring lock "cinder-quobyte-6293c08f-696b-4243-812f-fdeb16bcef72" by "_delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:39:33 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-976c55ec-347d-4ff8-ab5a-c295c3e18593 tempest-ProjectMemberTests-730908627 None] Lock "cinder-quobyte-6293c08f-696b-4243-812f-fdeb16bcef72" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:39:33 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-976c55ec-347d-4ff8-ab5a-c295c3e18593 tempest-ProjectMemberTests-730908627 None] Deleting offline snapshot 6293c08f-696b-4243-812f-fdeb16bcef72 of volume 268ef814-fc60-485a-a95d-432c96547ff0 {{(pid=86188) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 20:39:33 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-976c55ec-347d-4ff8-ab5a-c295c3e18593 tempest-ProjectMemberTests-730908627 None] snapshot_file for this snap is: volume-268ef814-fc60-485a-a95d-432c96547ff0.6293c08f-696b-4243-812f-fdeb16bcef72 {{(pid=86188) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 20:39:33 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d937b2b-202e-46e5-b249-56f4021e1f99]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:39:33 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-976c55ec-347d-4ff8-ab5a-c295c3e18593 tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-268ef814-fc60-485a-a95d-432c96547ff0.6293c08f-696b-4243-812f-fdeb16bcef72 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:33 devstack sudo[107279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-268ef814-fc60-485a-a95d-432c96547ff0.6293c08f-696b-4243-812f-fdeb16bcef72 Sep 16 20:39:33 devstack sudo[107279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:33 devstack sudo[107279]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:33 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-976c55ec-347d-4ff8-ab5a-c295c3e18593 tempest-ProjectMemberTests-730908627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-268ef814-fc60-485a-a95d-432c96547ff0.6293c08f-696b-4243-812f-fdeb16bcef72" returned: 0 in 0.352s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:33 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-976c55ec-347d-4ff8-ab5a-c295c3e18593 tempest-ProjectMemberTests-730908627 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-268ef814-fc60-485a-a95d-432c96547ff0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86188) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 20:39:33 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[a375a935-152c-4d2e-8363-c4311c937c95]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:39:33 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-976c55ec-347d-4ff8-ab5a-c295c3e18593 tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-268ef814-fc60-485a-a95d-432c96547ff0 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:33 devstack sudo[107284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-268ef814-fc60-485a-a95d-432c96547ff0 Sep 16 20:39:33 devstack sudo[107284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:33 devstack sudo[107284]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:33 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-976c55ec-347d-4ff8-ab5a-c295c3e18593 tempest-ProjectMemberTests-730908627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-268ef814-fc60-485a-a95d-432c96547ff0" returned: 0 in 0.350s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:33 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-976c55ec-347d-4ff8-ab5a-c295c3e18593 tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-268ef814-fc60-485a-a95d-432c96547ff0.6293c08f-696b-4243-812f-fdeb16bcef72 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:33 devstack sudo[107289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-268ef814-fc60-485a-a95d-432c96547ff0.6293c08f-696b-4243-812f-fdeb16bcef72 Sep 16 20:39:33 devstack sudo[107289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:34 devstack sudo[107289]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:34 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-976c55ec-347d-4ff8-ab5a-c295c3e18593 tempest-ProjectMemberTests-730908627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-268ef814-fc60-485a-a95d-432c96547ff0.6293c08f-696b-4243-812f-fdeb16bcef72" returned: 0 in 0.315s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:34 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-976c55ec-347d-4ff8-ab5a-c295c3e18593 tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-268ef814-fc60-485a-a95d-432c96547ff0.6293c08f-696b-4243-812f-fdeb16bcef72 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:34 devstack sudo[107294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-268ef814-fc60-485a-a95d-432c96547ff0.6293c08f-696b-4243-812f-fdeb16bcef72 Sep 16 20:39:34 devstack sudo[107294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:34 devstack sudo[107294]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:34 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-976c55ec-347d-4ff8-ab5a-c295c3e18593 tempest-ProjectMemberTests-730908627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-268ef814-fc60-485a-a95d-432c96547ff0.6293c08f-696b-4243-812f-fdeb16bcef72" returned: 0 in 0.238s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:34 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-976c55ec-347d-4ff8-ab5a-c295c3e18593 tempest-ProjectMemberTests-730908627 None] Lock "cinder-quobyte-6293c08f-696b-4243-812f-fdeb16bcef72" released by "_delete_snapshot" :: held 1.347s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:39:34 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-976c55ec-347d-4ff8-ab5a-c295c3e18593 tempest-ProjectMemberTests-730908627 None] Lock "cinder-quobyte-268ef814-fc60-485a-a95d-432c96547ff0" released by "delete_snapshot" :: held 1.367s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:39:34 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-976c55ec-347d-4ff8-ab5a-c295c3e18593 tempest-ProjectMemberTests-730908627 None] Created reservations ['96e7d399-64a0-49ec-9541-da9a27732271', '88c46167-feac-4090-b9d1-ad6e2ff129e3', 'dc48044a-5304-42cb-840f-4766da2b5f4a', '30b77730-5b32-4aac-a0b9-e3d38bfa5c1b'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:39:34 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-976c55ec-347d-4ff8-ab5a-c295c3e18593 tempest-ProjectMemberTests-730908627 None] Delete snapshot completed successfully. Sep 16 20:39:34 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-976c55ec-347d-4ff8-ab5a-c295c3e18593 tempest-ProjectMemberTests-730908627 None] Lock "cinder-6293c08f-696b-4243-812f-fdeb16bcef72-delete_snapshot" released by "delete_snapshot" :: held 1.498s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:39:35 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-36f5729e-f0f5-42de-b1b3-f2498c7a71aa tempest-ProjectMemberTests-730908627 None] Acquiring lock "cinder-268ef814-fc60-485a-a95d-432c96547ff0-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:39:35 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-36f5729e-f0f5-42de-b1b3-f2498c7a71aa tempest-ProjectMemberTests-730908627 None] Lock "cinder-268ef814-fc60-485a-a95d-432c96547ff0-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:39:35 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-36f5729e-f0f5-42de-b1b3-f2498c7a71aa tempest-ProjectMemberTests-730908627 None] Acquiring lock "cinder-quobyte-268ef814-fc60-485a-a95d-432c96547ff0" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:39:35 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-36f5729e-f0f5-42de-b1b3-f2498c7a71aa tempest-ProjectMemberTests-730908627 None] Lock "cinder-quobyte-268ef814-fc60-485a-a95d-432c96547ff0" acquired by "delete_volume" :: waited 0.013s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:39:35 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[4be65769-e42c-4091-9b19-2fe124290db4]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:39:35 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-36f5729e-f0f5-42de-b1b3-f2498c7a71aa tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-268ef814-fc60-485a-a95d-432c96547ff0 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:35 devstack sudo[107297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-268ef814-fc60-485a-a95d-432c96547ff0 Sep 16 20:39:35 devstack sudo[107297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:35 devstack sudo[107297]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:35 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-36f5729e-f0f5-42de-b1b3-f2498c7a71aa tempest-ProjectMemberTests-730908627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-268ef814-fc60-485a-a95d-432c96547ff0" returned: 0 in 0.360s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:35 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-36f5729e-f0f5-42de-b1b3-f2498c7a71aa tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-268ef814-fc60-485a-a95d-432c96547ff0 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:35 devstack sudo[107302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-268ef814-fc60-485a-a95d-432c96547ff0 Sep 16 20:39:35 devstack sudo[107302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:35 devstack sudo[107302]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:35 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-36f5729e-f0f5-42de-b1b3-f2498c7a71aa tempest-ProjectMemberTests-730908627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-268ef814-fc60-485a-a95d-432c96547ff0" returned: 0 in 0.243s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:35 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-36f5729e-f0f5-42de-b1b3-f2498c7a71aa tempest-ProjectMemberTests-730908627 None] Lock "cinder-quobyte-268ef814-fc60-485a-a95d-432c96547ff0" released by "delete_volume" :: held 0.661s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:39:35 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-36f5729e-f0f5-42de-b1b3-f2498c7a71aa tempest-ProjectMemberTests-730908627 None] Created reservations ['292f1d51-cb96-47aa-ad12-e37d096f68e6', '4c5f71fb-229a-4b97-9f51-e41578be0369', '518a51b1-bfc7-461e-967f-c6e49e67c92f', '2f54cb02-ad4c-4ade-a840-b2b25720ecea'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:39:35 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-36f5729e-f0f5-42de-b1b3-f2498c7a71aa tempest-ProjectMemberTests-730908627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:39:35 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-36f5729e-f0f5-42de-b1b3-f2498c7a71aa tempest-ProjectMemberTests-730908627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:39:35 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-36f5729e-f0f5-42de-b1b3-f2498c7a71aa tempest-ProjectMemberTests-730908627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:39:35 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-36f5729e-f0f5-42de-b1b3-f2498c7a71aa tempest-ProjectMemberTests-730908627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:39:35 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-36f5729e-f0f5-42de-b1b3-f2498c7a71aa tempest-ProjectMemberTests-730908627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:39:35 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-36f5729e-f0f5-42de-b1b3-f2498c7a71aa tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:35 devstack sudo[107305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:39:35 devstack sudo[107305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:36 devstack sudo[107305]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:36 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-36f5729e-f0f5-42de-b1b3-f2498c7a71aa tempest-ProjectMemberTests-730908627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.237s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:36 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-36f5729e-f0f5-42de-b1b3-f2498c7a71aa tempest-ProjectMemberTests-730908627 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:39:36 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-36f5729e-f0f5-42de-b1b3-f2498c7a71aa tempest-ProjectMemberTests-730908627 None] Deleted volume successfully. Sep 16 20:39:36 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-36f5729e-f0f5-42de-b1b3-f2498c7a71aa tempest-ProjectMemberTests-730908627 None] Lock "cinder-268ef814-fc60-485a-a95d-432c96547ff0-delete_volume" released by "delete_volume" :: held 1.075s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:39:36 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e9e8266-4560-489d-8bb1-80bb6aea7cd3 tempest-ProjectMemberTests-730908627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:39:36 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-5e9e8266-4560-489d-8bb1-80bb6aea7cd3 tempest-ProjectMemberTests-730908627 None] Flow 'volume_create_manager' (113bbcd0-2075-4c44-8aa1-01f1de1dba7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:39:36 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-5e9e8266-4560-489d-8bb1-80bb6aea7cd3 tempest-ProjectMemberTests-730908627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cef7ec4e-1666-404b-92cb-d4cbfdd09ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:39:36 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-5e9e8266-4560-489d-8bb1-80bb6aea7cd3 tempest-ProjectMemberTests-730908627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cef7ec4e-1666-404b-92cb-d4cbfdd09ac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:39:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-979363182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c031164a-01d6-4fdf-bda9-b26ad456e6f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d632f989377844f6b93c3b9bf838981d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:39:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:39:37Z,use_quota=True,user_id='5db8cf25fcc448629ab58c8006482185',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:39:36 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-5e9e8266-4560-489d-8bb1-80bb6aea7cd3 tempest-ProjectMemberTests-730908627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70a0f354-2b17-4c1f-ac3f-993caddd4202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:39:36 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-5e9e8266-4560-489d-8bb1-80bb6aea7cd3 tempest-ProjectMemberTests-730908627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70a0f354-2b17-4c1f-ac3f-993caddd4202) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:39:36 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-5e9e8266-4560-489d-8bb1-80bb6aea7cd3 tempest-ProjectMemberTests-730908627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66d899ba-440d-4fb5-aa42-9cb98b8c4569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:39:36 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-5e9e8266-4560-489d-8bb1-80bb6aea7cd3 tempest-ProjectMemberTests-730908627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66d899ba-440d-4fb5-aa42-9cb98b8c4569) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c031164a-01d6-4fdf-bda9-b26ad456e6f4', 'volume_name': 'volume-c031164a-01d6-4fdf-bda9-b26ad456e6f4', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:39:36 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-5e9e8266-4560-489d-8bb1-80bb6aea7cd3 tempest-ProjectMemberTests-730908627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c44c68a0-f840-44d5-9567-e0ab63a471dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:39:36 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-5e9e8266-4560-489d-8bb1-80bb6aea7cd3 tempest-ProjectMemberTests-730908627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c44c68a0-f840-44d5-9567-e0ab63a471dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:39:36 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-5e9e8266-4560-489d-8bb1-80bb6aea7cd3 tempest-ProjectMemberTests-730908627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f61c404-09dc-46c1-815f-1b8c5ecdf19c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:39:36 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-5e9e8266-4560-489d-8bb1-80bb6aea7cd3 tempest-ProjectMemberTests-730908627 None] Volume c031164a-01d6-4fdf-bda9-b26ad456e6f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c031164a-01d6-4fdf-bda9-b26ad456e6f4', 'volume_size': 1} Sep 16 20:39:36 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-5e9e8266-4560-489d-8bb1-80bb6aea7cd3 tempest-ProjectMemberTests-730908627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:39:36 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-5e9e8266-4560-489d-8bb1-80bb6aea7cd3 tempest-ProjectMemberTests-730908627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:39:36 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-5e9e8266-4560-489d-8bb1-80bb6aea7cd3 tempest-ProjectMemberTests-730908627 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:39:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-979363182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c031164a-01d6-4fdf-bda9-b26ad456e6f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d632f989377844f6b93c3b9bf838981d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:39:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:39:37Z,use_quota=True,user_id='5db8cf25fcc448629ab58c8006482185',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:39:36 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-5e9e8266-4560-489d-8bb1-80bb6aea7cd3 tempest-ProjectMemberTests-730908627 None] Creating volume c031164a-01d6-4fdf-bda9-b26ad456e6f4 {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:39:36 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-5e9e8266-4560-489d-8bb1-80bb6aea7cd3 tempest-ProjectMemberTests-730908627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:39:36 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-5e9e8266-4560-489d-8bb1-80bb6aea7cd3 tempest-ProjectMemberTests-730908627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:39:36 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-5e9e8266-4560-489d-8bb1-80bb6aea7cd3 tempest-ProjectMemberTests-730908627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:39:36 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-5e9e8266-4560-489d-8bb1-80bb6aea7cd3 tempest-ProjectMemberTests-730908627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:39:36 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-5e9e8266-4560-489d-8bb1-80bb6aea7cd3 tempest-ProjectMemberTests-730908627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:39:36 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-5e9e8266-4560-489d-8bb1-80bb6aea7cd3 tempest-ProjectMemberTests-730908627 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:39:36 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-5e9e8266-4560-489d-8bb1-80bb6aea7cd3 tempest-ProjectMemberTests-730908627 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:39:36 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-5e9e8266-4560-489d-8bb1-80bb6aea7cd3 tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c031164a-01d6-4fdf-bda9-b26ad456e6f4 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:36 devstack sudo[107308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c031164a-01d6-4fdf-bda9-b26ad456e6f4 1073741824 Sep 16 20:39:36 devstack sudo[107308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:37 devstack sudo[107308]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:37 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-5e9e8266-4560-489d-8bb1-80bb6aea7cd3 tempest-ProjectMemberTests-730908627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c031164a-01d6-4fdf-bda9-b26ad456e6f4 1073741824" returned: 0 in 0.395s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:37 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-5e9e8266-4560-489d-8bb1-80bb6aea7cd3 tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c031164a-01d6-4fdf-bda9-b26ad456e6f4 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:37 devstack sudo[107313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c031164a-01d6-4fdf-bda9-b26ad456e6f4 Sep 16 20:39:37 devstack sudo[107313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:37 devstack sudo[107313]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:37 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-5e9e8266-4560-489d-8bb1-80bb6aea7cd3 tempest-ProjectMemberTests-730908627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c031164a-01d6-4fdf-bda9-b26ad456e6f4" returned: 0 in 0.237s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:37 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-5e9e8266-4560-489d-8bb1-80bb6aea7cd3 tempest-ProjectMemberTests-730908627 None] <== create_volume: return (673ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:39:37 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-5e9e8266-4560-489d-8bb1-80bb6aea7cd3 tempest-ProjectMemberTests-730908627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.675s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:39:37 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-5e9e8266-4560-489d-8bb1-80bb6aea7cd3 tempest-ProjectMemberTests-730908627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f61c404-09dc-46c1-815f-1b8c5ecdf19c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c031164a-01d6-4fdf-bda9-b26ad456e6f4', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:39:37 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-5e9e8266-4560-489d-8bb1-80bb6aea7cd3 tempest-ProjectMemberTests-730908627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c84e324e-6490-4c14-9241-99e237d84f06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:39:37 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-5e9e8266-4560-489d-8bb1-80bb6aea7cd3 tempest-ProjectMemberTests-730908627 None] Volume volume-c031164a-01d6-4fdf-bda9-b26ad456e6f4 (c031164a-01d6-4fdf-bda9-b26ad456e6f4): created successfully Sep 16 20:39:37 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-5e9e8266-4560-489d-8bb1-80bb6aea7cd3 tempest-ProjectMemberTests-730908627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c84e324e-6490-4c14-9241-99e237d84f06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:39:37 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-5e9e8266-4560-489d-8bb1-80bb6aea7cd3 tempest-ProjectMemberTests-730908627 None] Flow 'volume_create_manager' (113bbcd0-2075-4c44-8aa1-01f1de1dba7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:39:37 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-5e9e8266-4560-489d-8bb1-80bb6aea7cd3 tempest-ProjectMemberTests-730908627 None] Created volume successfully. Sep 16 20:39:37 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-1b1fe3a1-4c80-48f2-aee2-54b699e5b1ac tempest-ProjectMemberTests-730908627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:39:37 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-1b1fe3a1-4c80-48f2-aee2-54b699e5b1ac tempest-ProjectMemberTests-730908627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:39:37 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-1b1fe3a1-4c80-48f2-aee2-54b699e5b1ac tempest-ProjectMemberTests-730908627 None] Creating offline snapshot 84b320d4-6195-450c-925d-13e328beb76e of volume c031164a-01d6-4fdf-bda9-b26ad456e6f4 {{(pid=86188) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 20:39:37 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1f5275a-9ee6-45f8-b5d1-09fbf6aec11a]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:39:37 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-1b1fe3a1-4c80-48f2-aee2-54b699e5b1ac tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c031164a-01d6-4fdf-bda9-b26ad456e6f4 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:37 devstack sudo[107316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c031164a-01d6-4fdf-bda9-b26ad456e6f4 Sep 16 20:39:37 devstack sudo[107316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:38 devstack sudo[107316]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:38 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-1b1fe3a1-4c80-48f2-aee2-54b699e5b1ac tempest-ProjectMemberTests-730908627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c031164a-01d6-4fdf-bda9-b26ad456e6f4" returned: 0 in 0.346s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:38 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-1b1fe3a1-4c80-48f2-aee2-54b699e5b1ac tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c031164a-01d6-4fdf-bda9-b26ad456e6f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c031164a-01d6-4fdf-bda9-b26ad456e6f4.84b320d4-6195-450c-925d-13e328beb76e 1G {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:38 devstack sudo[107321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c031164a-01d6-4fdf-bda9-b26ad456e6f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c031164a-01d6-4fdf-bda9-b26ad456e6f4.84b320d4-6195-450c-925d-13e328beb76e 1G Sep 16 20:39:38 devstack sudo[107321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:38 devstack sudo[107321]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:38 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-1b1fe3a1-4c80-48f2-aee2-54b699e5b1ac tempest-ProjectMemberTests-730908627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c031164a-01d6-4fdf-bda9-b26ad456e6f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c031164a-01d6-4fdf-bda9-b26ad456e6f4.84b320d4-6195-450c-925d-13e328beb76e 1G" returned: 0 in 0.374s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:38 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-1b1fe3a1-4c80-48f2-aee2-54b699e5b1ac tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c031164a-01d6-4fdf-bda9-b26ad456e6f4 -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c031164a-01d6-4fdf-bda9-b26ad456e6f4.84b320d4-6195-450c-925d-13e328beb76e {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:38 devstack sudo[107326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c031164a-01d6-4fdf-bda9-b26ad456e6f4 -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c031164a-01d6-4fdf-bda9-b26ad456e6f4.84b320d4-6195-450c-925d-13e328beb76e Sep 16 20:39:38 devstack sudo[107326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:38 devstack sudo[107326]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:38 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-1b1fe3a1-4c80-48f2-aee2-54b699e5b1ac tempest-ProjectMemberTests-730908627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c031164a-01d6-4fdf-bda9-b26ad456e6f4 -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c031164a-01d6-4fdf-bda9-b26ad456e6f4.84b320d4-6195-450c-925d-13e328beb76e" returned: 0 in 0.282s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:38 devstack cinder-volume[86188]: WARNING cinder.volume.drivers.remotefs [None req-1b1fe3a1-4c80-48f2-aee2-54b699e5b1ac tempest-ProjectMemberTests-730908627 None] /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c031164a-01d6-4fdf-bda9-b26ad456e6f4.84b320d4-6195-450c-925d-13e328beb76e is being set with open permissions: ugo+rw Sep 16 20:39:38 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-1b1fe3a1-4c80-48f2-aee2-54b699e5b1ac tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c031164a-01d6-4fdf-bda9-b26ad456e6f4.84b320d4-6195-450c-925d-13e328beb76e {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:38 devstack sudo[107331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c031164a-01d6-4fdf-bda9-b26ad456e6f4.84b320d4-6195-450c-925d-13e328beb76e Sep 16 20:39:38 devstack sudo[107331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:39 devstack sudo[107331]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:39 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-1b1fe3a1-4c80-48f2-aee2-54b699e5b1ac tempest-ProjectMemberTests-730908627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c031164a-01d6-4fdf-bda9-b26ad456e6f4.84b320d4-6195-450c-925d-13e328beb76e" returned: 0 in 0.241s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:39 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-1b1fe3a1-4c80-48f2-aee2-54b699e5b1ac tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c031164a-01d6-4fdf-bda9-b26ad456e6f4.info {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:39 devstack sudo[107334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c031164a-01d6-4fdf-bda9-b26ad456e6f4.info Sep 16 20:39:39 devstack sudo[107334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:39 devstack sudo[107334]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:39 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-1b1fe3a1-4c80-48f2-aee2-54b699e5b1ac tempest-ProjectMemberTests-730908627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c031164a-01d6-4fdf-bda9-b26ad456e6f4.info" returned: 0 in 0.245s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:39 devstack cinder-volume[86188]: WARNING cinder.volume.drivers.remotefs [None req-1b1fe3a1-4c80-48f2-aee2-54b699e5b1ac tempest-ProjectMemberTests-730908627 None] /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c031164a-01d6-4fdf-bda9-b26ad456e6f4.info is being set with open permissions: ugo+rw Sep 16 20:39:39 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-1b1fe3a1-4c80-48f2-aee2-54b699e5b1ac tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c031164a-01d6-4fdf-bda9-b26ad456e6f4.info {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:39 devstack sudo[107337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c031164a-01d6-4fdf-bda9-b26ad456e6f4.info Sep 16 20:39:39 devstack sudo[107337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:39 devstack sudo[107337]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:39 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-1b1fe3a1-4c80-48f2-aee2-54b699e5b1ac tempest-ProjectMemberTests-730908627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c031164a-01d6-4fdf-bda9-b26ad456e6f4.info" returned: 0 in 0.234s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:39 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-1b1fe3a1-4c80-48f2-aee2-54b699e5b1ac tempest-ProjectMemberTests-730908627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.800s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:39:39 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-1b1fe3a1-4c80-48f2-aee2-54b699e5b1ac tempest-ProjectMemberTests-730908627 None] Create snapshot completed successfully Sep 16 20:39:39 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-f39a8354-5a6c-44f2-9bf3-5257470823c0 tempest-ProjectMemberTests-730908627 None] Acquiring lock "cinder-84b320d4-6195-450c-925d-13e328beb76e-delete_snapshot" by "delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:39:40 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-f39a8354-5a6c-44f2-9bf3-5257470823c0 tempest-ProjectMemberTests-730908627 None] Lock "cinder-84b320d4-6195-450c-925d-13e328beb76e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:39:40 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-f39a8354-5a6c-44f2-9bf3-5257470823c0 tempest-ProjectMemberTests-730908627 None] Acquiring lock "cinder-quobyte-c031164a-01d6-4fdf-bda9-b26ad456e6f4" by "delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:39:40 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-f39a8354-5a6c-44f2-9bf3-5257470823c0 tempest-ProjectMemberTests-730908627 None] Lock "cinder-quobyte-c031164a-01d6-4fdf-bda9-b26ad456e6f4" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:39:40 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-f39a8354-5a6c-44f2-9bf3-5257470823c0 tempest-ProjectMemberTests-730908627 None] Acquiring lock "cinder-quobyte-84b320d4-6195-450c-925d-13e328beb76e" by "_delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:39:40 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-f39a8354-5a6c-44f2-9bf3-5257470823c0 tempest-ProjectMemberTests-730908627 None] Lock "cinder-quobyte-84b320d4-6195-450c-925d-13e328beb76e" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:39:40 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-f39a8354-5a6c-44f2-9bf3-5257470823c0 tempest-ProjectMemberTests-730908627 None] Deleting offline snapshot 84b320d4-6195-450c-925d-13e328beb76e of volume c031164a-01d6-4fdf-bda9-b26ad456e6f4 {{(pid=86188) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 20:39:40 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-f39a8354-5a6c-44f2-9bf3-5257470823c0 tempest-ProjectMemberTests-730908627 None] snapshot_file for this snap is: volume-c031164a-01d6-4fdf-bda9-b26ad456e6f4.84b320d4-6195-450c-925d-13e328beb76e {{(pid=86188) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 20:39:40 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[204dafbc-de6d-4c6a-aa8d-609fa5987135]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:39:40 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f39a8354-5a6c-44f2-9bf3-5257470823c0 tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c031164a-01d6-4fdf-bda9-b26ad456e6f4.84b320d4-6195-450c-925d-13e328beb76e {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:40 devstack sudo[107341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c031164a-01d6-4fdf-bda9-b26ad456e6f4.84b320d4-6195-450c-925d-13e328beb76e Sep 16 20:39:40 devstack sudo[107341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:40 devstack sudo[107341]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:40 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f39a8354-5a6c-44f2-9bf3-5257470823c0 tempest-ProjectMemberTests-730908627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c031164a-01d6-4fdf-bda9-b26ad456e6f4.84b320d4-6195-450c-925d-13e328beb76e" returned: 0 in 0.352s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:40 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-f39a8354-5a6c-44f2-9bf3-5257470823c0 tempest-ProjectMemberTests-730908627 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c031164a-01d6-4fdf-bda9-b26ad456e6f4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86188) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 20:39:40 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[920e502c-b65b-474a-922e-382bac2f8fee]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:39:40 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f39a8354-5a6c-44f2-9bf3-5257470823c0 tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c031164a-01d6-4fdf-bda9-b26ad456e6f4 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:40 devstack sudo[107346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c031164a-01d6-4fdf-bda9-b26ad456e6f4 Sep 16 20:39:40 devstack sudo[107346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:40 devstack sudo[107346]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:40 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f39a8354-5a6c-44f2-9bf3-5257470823c0 tempest-ProjectMemberTests-730908627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c031164a-01d6-4fdf-bda9-b26ad456e6f4" returned: 0 in 0.372s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:40 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f39a8354-5a6c-44f2-9bf3-5257470823c0 tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c031164a-01d6-4fdf-bda9-b26ad456e6f4.84b320d4-6195-450c-925d-13e328beb76e {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:40 devstack sudo[107351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c031164a-01d6-4fdf-bda9-b26ad456e6f4.84b320d4-6195-450c-925d-13e328beb76e Sep 16 20:39:40 devstack sudo[107351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:41 devstack sudo[107351]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:41 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f39a8354-5a6c-44f2-9bf3-5257470823c0 tempest-ProjectMemberTests-730908627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c031164a-01d6-4fdf-bda9-b26ad456e6f4.84b320d4-6195-450c-925d-13e328beb76e" returned: 0 in 0.334s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:41 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f39a8354-5a6c-44f2-9bf3-5257470823c0 tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c031164a-01d6-4fdf-bda9-b26ad456e6f4.84b320d4-6195-450c-925d-13e328beb76e {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:41 devstack sudo[107357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c031164a-01d6-4fdf-bda9-b26ad456e6f4.84b320d4-6195-450c-925d-13e328beb76e Sep 16 20:39:41 devstack sudo[107357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:41 devstack sudo[107357]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:41 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f39a8354-5a6c-44f2-9bf3-5257470823c0 tempest-ProjectMemberTests-730908627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c031164a-01d6-4fdf-bda9-b26ad456e6f4.84b320d4-6195-450c-925d-13e328beb76e" returned: 0 in 0.236s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:41 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-f39a8354-5a6c-44f2-9bf3-5257470823c0 tempest-ProjectMemberTests-730908627 None] Lock "cinder-quobyte-84b320d4-6195-450c-925d-13e328beb76e" released by "_delete_snapshot" :: held 1.385s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:39:41 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-f39a8354-5a6c-44f2-9bf3-5257470823c0 tempest-ProjectMemberTests-730908627 None] Lock "cinder-quobyte-c031164a-01d6-4fdf-bda9-b26ad456e6f4" released by "delete_snapshot" :: held 1.404s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:39:41 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-f39a8354-5a6c-44f2-9bf3-5257470823c0 tempest-ProjectMemberTests-730908627 None] Created reservations ['d2db854b-a5cc-4f9c-8ec7-01619960f3d6', '3d6c9aa1-0f4a-40c3-87ac-51f5382e7f37', 'f429c2ea-dbcb-475d-83c2-86cc09b835cf', '2a21236d-9938-4246-8041-eb4ac737994a'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:39:41 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-f39a8354-5a6c-44f2-9bf3-5257470823c0 tempest-ProjectMemberTests-730908627 None] Delete snapshot completed successfully. Sep 16 20:39:41 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-f39a8354-5a6c-44f2-9bf3-5257470823c0 tempest-ProjectMemberTests-730908627 None] Lock "cinder-84b320d4-6195-450c-925d-13e328beb76e-delete_snapshot" released by "delete_snapshot" :: held 1.529s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:39:42 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-5ffc71ef-c55d-4ace-9faf-432b7be4ab5f tempest-ProjectMemberTests-730908627 None] Acquiring lock "cinder-c031164a-01d6-4fdf-bda9-b26ad456e6f4-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:39:42 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-5ffc71ef-c55d-4ace-9faf-432b7be4ab5f tempest-ProjectMemberTests-730908627 None] Lock "cinder-c031164a-01d6-4fdf-bda9-b26ad456e6f4-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:39:42 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-5ffc71ef-c55d-4ace-9faf-432b7be4ab5f tempest-ProjectMemberTests-730908627 None] Acquiring lock "cinder-quobyte-c031164a-01d6-4fdf-bda9-b26ad456e6f4" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:39:42 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-5ffc71ef-c55d-4ace-9faf-432b7be4ab5f tempest-ProjectMemberTests-730908627 None] Lock "cinder-quobyte-c031164a-01d6-4fdf-bda9-b26ad456e6f4" acquired by "delete_volume" :: waited 0.015s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:39:42 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[87fcca00-bdd7-4bbd-bdb4-ec86d8017594]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:39:42 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-5ffc71ef-c55d-4ace-9faf-432b7be4ab5f tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c031164a-01d6-4fdf-bda9-b26ad456e6f4 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:42 devstack sudo[107360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c031164a-01d6-4fdf-bda9-b26ad456e6f4 Sep 16 20:39:42 devstack sudo[107360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:42 devstack sudo[107360]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:42 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-5ffc71ef-c55d-4ace-9faf-432b7be4ab5f tempest-ProjectMemberTests-730908627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c031164a-01d6-4fdf-bda9-b26ad456e6f4" returned: 0 in 0.347s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:42 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-5ffc71ef-c55d-4ace-9faf-432b7be4ab5f tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c031164a-01d6-4fdf-bda9-b26ad456e6f4 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:42 devstack sudo[107365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c031164a-01d6-4fdf-bda9-b26ad456e6f4 Sep 16 20:39:42 devstack sudo[107365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:42 devstack sudo[107365]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:42 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-5ffc71ef-c55d-4ace-9faf-432b7be4ab5f tempest-ProjectMemberTests-730908627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-c031164a-01d6-4fdf-bda9-b26ad456e6f4" returned: 0 in 0.232s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:42 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-5ffc71ef-c55d-4ace-9faf-432b7be4ab5f tempest-ProjectMemberTests-730908627 None] Lock "cinder-quobyte-c031164a-01d6-4fdf-bda9-b26ad456e6f4" released by "delete_volume" :: held 0.637s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:39:42 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-5ffc71ef-c55d-4ace-9faf-432b7be4ab5f tempest-ProjectMemberTests-730908627 None] Created reservations ['58f908b4-31da-4919-829f-51dab0f5cbcc', '34809ad9-dea0-4bef-b6fa-87a959b2c546', 'd2e6e939-b4c8-4e60-ba9e-3f417a8ca8c1', 'f8a3bac3-031f-4c68-b40f-3e2f732173db'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:39:42 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-5ffc71ef-c55d-4ace-9faf-432b7be4ab5f tempest-ProjectMemberTests-730908627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:39:42 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-5ffc71ef-c55d-4ace-9faf-432b7be4ab5f tempest-ProjectMemberTests-730908627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:39:42 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-5ffc71ef-c55d-4ace-9faf-432b7be4ab5f tempest-ProjectMemberTests-730908627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:39:42 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-5ffc71ef-c55d-4ace-9faf-432b7be4ab5f tempest-ProjectMemberTests-730908627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:39:42 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-5ffc71ef-c55d-4ace-9faf-432b7be4ab5f tempest-ProjectMemberTests-730908627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:39:42 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-5ffc71ef-c55d-4ace-9faf-432b7be4ab5f tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:42 devstack sudo[107368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:39:42 devstack sudo[107368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:43 devstack sudo[107368]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:43 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-5ffc71ef-c55d-4ace-9faf-432b7be4ab5f tempest-ProjectMemberTests-730908627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.231s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:43 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-5ffc71ef-c55d-4ace-9faf-432b7be4ab5f tempest-ProjectMemberTests-730908627 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:39:43 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-5ffc71ef-c55d-4ace-9faf-432b7be4ab5f tempest-ProjectMemberTests-730908627 None] Deleted volume successfully. Sep 16 20:39:43 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-5ffc71ef-c55d-4ace-9faf-432b7be4ab5f tempest-ProjectMemberTests-730908627 None] Lock "cinder-c031164a-01d6-4fdf-bda9-b26ad456e6f4-delete_volume" released by "delete_volume" :: held 1.043s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:39:43 devstack cinder-volume[86188]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc42d021-67cf-44c4-b45a-6a3fdfe77448 tempest-ProjectMemberTests-730908627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86188) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 20:39:43 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-cc42d021-67cf-44c4-b45a-6a3fdfe77448 tempest-ProjectMemberTests-730908627 None] Flow 'volume_create_manager' (acfcc95f-41c8-4c8a-8311-758adf0f054e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:39:43 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-cc42d021-67cf-44c4-b45a-6a3fdfe77448 tempest-ProjectMemberTests-730908627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa334a71-446c-4a9e-912e-fa1a6ed076a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:39:43 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-cc42d021-67cf-44c4-b45a-6a3fdfe77448 tempest-ProjectMemberTests-730908627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa334a71-446c-4a9e-912e-fa1a6ed076a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:39:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1017706980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=263a2c0d-cad5-4b9b-aa43-c801922b97e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d632f989377844f6b93c3b9bf838981d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:39:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:39:44Z,use_quota=True,user_id='5db8cf25fcc448629ab58c8006482185',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:39:43 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-cc42d021-67cf-44c4-b45a-6a3fdfe77448 tempest-ProjectMemberTests-730908627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (412e00f7-b0df-4152-a55d-9d29f39dc042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:39:43 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-cc42d021-67cf-44c4-b45a-6a3fdfe77448 tempest-ProjectMemberTests-730908627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (412e00f7-b0df-4152-a55d-9d29f39dc042) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:39:43 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-cc42d021-67cf-44c4-b45a-6a3fdfe77448 tempest-ProjectMemberTests-730908627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8666fe27-67d6-45d2-bac9-d35c00dcc103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:39:43 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-cc42d021-67cf-44c4-b45a-6a3fdfe77448 tempest-ProjectMemberTests-730908627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8666fe27-67d6-45d2-bac9-d35c00dcc103) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '263a2c0d-cad5-4b9b-aa43-c801922b97e1', 'volume_name': 'volume-263a2c0d-cad5-4b9b-aa43-c801922b97e1', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:39:43 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-cc42d021-67cf-44c4-b45a-6a3fdfe77448 tempest-ProjectMemberTests-730908627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b5937f9-5134-49f7-aaa3-52e425b1ecd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:39:43 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-cc42d021-67cf-44c4-b45a-6a3fdfe77448 tempest-ProjectMemberTests-730908627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b5937f9-5134-49f7-aaa3-52e425b1ecd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:39:43 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-cc42d021-67cf-44c4-b45a-6a3fdfe77448 tempest-ProjectMemberTests-730908627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63e1a724-97f8-434c-923b-47536ffa8a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:39:43 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-cc42d021-67cf-44c4-b45a-6a3fdfe77448 tempest-ProjectMemberTests-730908627 None] Volume 263a2c0d-cad5-4b9b-aa43-c801922b97e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-263a2c0d-cad5-4b9b-aa43-c801922b97e1', 'volume_size': 1} Sep 16 20:39:43 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-cc42d021-67cf-44c4-b45a-6a3fdfe77448 tempest-ProjectMemberTests-730908627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:39:43 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-cc42d021-67cf-44c4-b45a-6a3fdfe77448 tempest-ProjectMemberTests-730908627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:39:43 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-cc42d021-67cf-44c4-b45a-6a3fdfe77448 tempest-ProjectMemberTests-730908627 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T18:39:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1017706980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=263a2c0d-cad5-4b9b-aa43-c801922b97e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d632f989377844f6b93c3b9bf838981d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T18:39:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T18:39:44Z,use_quota=True,user_id='5db8cf25fcc448629ab58c8006482185',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a95f566-8650-4cd4-8069-20918aa2441a),volume_type_id=4a95f566-8650-4cd4-8069-20918aa2441a)}" {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 20:39:43 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-cc42d021-67cf-44c4-b45a-6a3fdfe77448 tempest-ProjectMemberTests-730908627 None] Creating volume 263a2c0d-cad5-4b9b-aa43-c801922b97e1 {{(pid=86188) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 20:39:43 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-cc42d021-67cf-44c4-b45a-6a3fdfe77448 tempest-ProjectMemberTests-730908627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:39:43 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-cc42d021-67cf-44c4-b45a-6a3fdfe77448 tempest-ProjectMemberTests-730908627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:39:43 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-cc42d021-67cf-44c4-b45a-6a3fdfe77448 tempest-ProjectMemberTests-730908627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:39:43 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-cc42d021-67cf-44c4-b45a-6a3fdfe77448 tempest-ProjectMemberTests-730908627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:39:43 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-cc42d021-67cf-44c4-b45a-6a3fdfe77448 tempest-ProjectMemberTests-730908627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:39:43 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-cc42d021-67cf-44c4-b45a-6a3fdfe77448 tempest-ProjectMemberTests-730908627 None] Selected osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 as target Quobyte volume. {{(pid=86188) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 20:39:43 devstack cinder-volume[86188]: INFO cinder.volume.drivers.remotefs [None req-cc42d021-67cf-44c4-b45a-6a3fdfe77448 tempest-ProjectMemberTests-730908627 None] casted to osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81 Sep 16 20:39:43 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-cc42d021-67cf-44c4-b45a-6a3fdfe77448 tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-263a2c0d-cad5-4b9b-aa43-c801922b97e1 1073741824 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:43 devstack sudo[107371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-263a2c0d-cad5-4b9b-aa43-c801922b97e1 1073741824 Sep 16 20:39:43 devstack sudo[107371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:44 devstack sudo[107371]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:44 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-cc42d021-67cf-44c4-b45a-6a3fdfe77448 tempest-ProjectMemberTests-730908627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-263a2c0d-cad5-4b9b-aa43-c801922b97e1 1073741824" returned: 0 in 0.407s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:44 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-cc42d021-67cf-44c4-b45a-6a3fdfe77448 tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-263a2c0d-cad5-4b9b-aa43-c801922b97e1 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:44 devstack sudo[107376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-263a2c0d-cad5-4b9b-aa43-c801922b97e1 Sep 16 20:39:44 devstack sudo[107376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:44 devstack sudo[107376]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:44 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-cc42d021-67cf-44c4-b45a-6a3fdfe77448 tempest-ProjectMemberTests-730908627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-263a2c0d-cad5-4b9b-aa43-c801922b97e1" returned: 0 in 0.237s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:44 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-cc42d021-67cf-44c4-b45a-6a3fdfe77448 tempest-ProjectMemberTests-730908627 None] <== create_volume: return (687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'} {{(pid=86188) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 20:39:44 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-cc42d021-67cf-44c4-b45a-6a3fdfe77448 tempest-ProjectMemberTests-730908627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.690s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:39:44 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-cc42d021-67cf-44c4-b45a-6a3fdfe77448 tempest-ProjectMemberTests-730908627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63e1a724-97f8-434c-923b-47536ffa8a93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-263a2c0d-cad5-4b9b-aa43-c801922b97e1', 'volume_size': 1}' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:39:44 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-cc42d021-67cf-44c4-b45a-6a3fdfe77448 tempest-ProjectMemberTests-730908627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a484781-3bc0-4ae1-a3ab-7f58eb02ddfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 20:39:44 devstack cinder-volume[86188]: INFO cinder.volume.flows.manager.create_volume [None req-cc42d021-67cf-44c4-b45a-6a3fdfe77448 tempest-ProjectMemberTests-730908627 None] Volume volume-263a2c0d-cad5-4b9b-aa43-c801922b97e1 (263a2c0d-cad5-4b9b-aa43-c801922b97e1): created successfully Sep 16 20:39:44 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-cc42d021-67cf-44c4-b45a-6a3fdfe77448 tempest-ProjectMemberTests-730908627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a484781-3bc0-4ae1-a3ab-7f58eb02ddfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86188) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 20:39:44 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-cc42d021-67cf-44c4-b45a-6a3fdfe77448 tempest-ProjectMemberTests-730908627 None] Flow 'volume_create_manager' (acfcc95f-41c8-4c8a-8311-758adf0f054e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86188) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 20:39:44 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-cc42d021-67cf-44c4-b45a-6a3fdfe77448 tempest-ProjectMemberTests-730908627 None] Created volume successfully. Sep 16 20:39:44 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-fbebec4c-ef2b-4b77-aefd-98b1442a537d tempest-ProjectMemberTests-730908627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:39:44 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-fbebec4c-ef2b-4b77-aefd-98b1442a537d tempest-ProjectMemberTests-730908627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:39:44 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-fbebec4c-ef2b-4b77-aefd-98b1442a537d tempest-ProjectMemberTests-730908627 None] Creating offline snapshot a8902f02-57d7-403a-937c-ec2cbfb6baf3 of volume 263a2c0d-cad5-4b9b-aa43-c801922b97e1 {{(pid=86188) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 20:39:44 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f95bb02-2930-4fe4-93c9-2e69fa31582b]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:39:44 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-fbebec4c-ef2b-4b77-aefd-98b1442a537d tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-263a2c0d-cad5-4b9b-aa43-c801922b97e1 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:45 devstack sudo[107379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-263a2c0d-cad5-4b9b-aa43-c801922b97e1 Sep 16 20:39:45 devstack sudo[107379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:45 devstack sudo[107379]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:45 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-fbebec4c-ef2b-4b77-aefd-98b1442a537d tempest-ProjectMemberTests-730908627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-263a2c0d-cad5-4b9b-aa43-c801922b97e1" returned: 0 in 0.353s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:45 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-fbebec4c-ef2b-4b77-aefd-98b1442a537d tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-263a2c0d-cad5-4b9b-aa43-c801922b97e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-263a2c0d-cad5-4b9b-aa43-c801922b97e1.a8902f02-57d7-403a-937c-ec2cbfb6baf3 1G {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:45 devstack sudo[107384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-263a2c0d-cad5-4b9b-aa43-c801922b97e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-263a2c0d-cad5-4b9b-aa43-c801922b97e1.a8902f02-57d7-403a-937c-ec2cbfb6baf3 1G Sep 16 20:39:45 devstack sudo[107384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:45 devstack sudo[107384]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:45 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-fbebec4c-ef2b-4b77-aefd-98b1442a537d tempest-ProjectMemberTests-730908627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-263a2c0d-cad5-4b9b-aa43-c801922b97e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-263a2c0d-cad5-4b9b-aa43-c801922b97e1.a8902f02-57d7-403a-937c-ec2cbfb6baf3 1G" returned: 0 in 0.376s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:45 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-fbebec4c-ef2b-4b77-aefd-98b1442a537d tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-263a2c0d-cad5-4b9b-aa43-c801922b97e1 -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-263a2c0d-cad5-4b9b-aa43-c801922b97e1.a8902f02-57d7-403a-937c-ec2cbfb6baf3 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:45 devstack sudo[107390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-263a2c0d-cad5-4b9b-aa43-c801922b97e1 -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-263a2c0d-cad5-4b9b-aa43-c801922b97e1.a8902f02-57d7-403a-937c-ec2cbfb6baf3 Sep 16 20:39:45 devstack sudo[107390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:45 devstack sudo[107390]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:45 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-fbebec4c-ef2b-4b77-aefd-98b1442a537d tempest-ProjectMemberTests-730908627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-263a2c0d-cad5-4b9b-aa43-c801922b97e1 -F qcow2 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-263a2c0d-cad5-4b9b-aa43-c801922b97e1.a8902f02-57d7-403a-937c-ec2cbfb6baf3" returned: 0 in 0.288s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:45 devstack cinder-volume[86188]: WARNING cinder.volume.drivers.remotefs [None req-fbebec4c-ef2b-4b77-aefd-98b1442a537d tempest-ProjectMemberTests-730908627 None] /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-263a2c0d-cad5-4b9b-aa43-c801922b97e1.a8902f02-57d7-403a-937c-ec2cbfb6baf3 is being set with open permissions: ugo+rw Sep 16 20:39:45 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-fbebec4c-ef2b-4b77-aefd-98b1442a537d tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-263a2c0d-cad5-4b9b-aa43-c801922b97e1.a8902f02-57d7-403a-937c-ec2cbfb6baf3 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:45 devstack sudo[107395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-263a2c0d-cad5-4b9b-aa43-c801922b97e1.a8902f02-57d7-403a-937c-ec2cbfb6baf3 Sep 16 20:39:45 devstack sudo[107395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:46 devstack sudo[107395]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:46 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-fbebec4c-ef2b-4b77-aefd-98b1442a537d tempest-ProjectMemberTests-730908627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-263a2c0d-cad5-4b9b-aa43-c801922b97e1.a8902f02-57d7-403a-937c-ec2cbfb6baf3" returned: 0 in 0.241s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:46 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-fbebec4c-ef2b-4b77-aefd-98b1442a537d tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-263a2c0d-cad5-4b9b-aa43-c801922b97e1.info {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:46 devstack sudo[107398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-263a2c0d-cad5-4b9b-aa43-c801922b97e1.info Sep 16 20:39:46 devstack sudo[107398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:46 devstack sudo[107398]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:46 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-fbebec4c-ef2b-4b77-aefd-98b1442a537d tempest-ProjectMemberTests-730908627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-263a2c0d-cad5-4b9b-aa43-c801922b97e1.info" returned: 0 in 0.262s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:46 devstack cinder-volume[86188]: WARNING cinder.volume.drivers.remotefs [None req-fbebec4c-ef2b-4b77-aefd-98b1442a537d tempest-ProjectMemberTests-730908627 None] /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-263a2c0d-cad5-4b9b-aa43-c801922b97e1.info is being set with open permissions: ugo+rw Sep 16 20:39:46 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-fbebec4c-ef2b-4b77-aefd-98b1442a537d tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-263a2c0d-cad5-4b9b-aa43-c801922b97e1.info {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:46 devstack sudo[107401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-263a2c0d-cad5-4b9b-aa43-c801922b97e1.info Sep 16 20:39:46 devstack sudo[107401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:46 devstack sudo[107401]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:46 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-fbebec4c-ef2b-4b77-aefd-98b1442a537d tempest-ProjectMemberTests-730908627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-263a2c0d-cad5-4b9b-aa43-c801922b97e1.info" returned: 0 in 0.238s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:46 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-fbebec4c-ef2b-4b77-aefd-98b1442a537d tempest-ProjectMemberTests-730908627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.839s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:39:46 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-fbebec4c-ef2b-4b77-aefd-98b1442a537d tempest-ProjectMemberTests-730908627 None] Create snapshot completed successfully Sep 16 20:39:47 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-f81124b9-276a-465c-b461-03032da7671b tempest-ProjectMemberTests-730908627 None] Acquiring lock "cinder-a8902f02-57d7-403a-937c-ec2cbfb6baf3-delete_snapshot" by "delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:39:47 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-f81124b9-276a-465c-b461-03032da7671b tempest-ProjectMemberTests-730908627 None] Lock "cinder-a8902f02-57d7-403a-937c-ec2cbfb6baf3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:39:47 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-f81124b9-276a-465c-b461-03032da7671b tempest-ProjectMemberTests-730908627 None] Acquiring lock "cinder-quobyte-263a2c0d-cad5-4b9b-aa43-c801922b97e1" by "delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:39:47 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-f81124b9-276a-465c-b461-03032da7671b tempest-ProjectMemberTests-730908627 None] Lock "cinder-quobyte-263a2c0d-cad5-4b9b-aa43-c801922b97e1" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:39:47 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-f81124b9-276a-465c-b461-03032da7671b tempest-ProjectMemberTests-730908627 None] Acquiring lock "cinder-quobyte-a8902f02-57d7-403a-937c-ec2cbfb6baf3" by "_delete_snapshot" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:39:47 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-f81124b9-276a-465c-b461-03032da7671b tempest-ProjectMemberTests-730908627 None] Lock "cinder-quobyte-a8902f02-57d7-403a-937c-ec2cbfb6baf3" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:39:47 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-f81124b9-276a-465c-b461-03032da7671b tempest-ProjectMemberTests-730908627 None] Deleting offline snapshot a8902f02-57d7-403a-937c-ec2cbfb6baf3 of volume 263a2c0d-cad5-4b9b-aa43-c801922b97e1 {{(pid=86188) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 20:39:47 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-f81124b9-276a-465c-b461-03032da7671b tempest-ProjectMemberTests-730908627 None] snapshot_file for this snap is: volume-263a2c0d-cad5-4b9b-aa43-c801922b97e1.a8902f02-57d7-403a-937c-ec2cbfb6baf3 {{(pid=86188) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 20:39:47 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d4eb3bc-dcfe-4b20-995d-99bb9d21b003]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:39:47 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f81124b9-276a-465c-b461-03032da7671b tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-263a2c0d-cad5-4b9b-aa43-c801922b97e1.a8902f02-57d7-403a-937c-ec2cbfb6baf3 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:47 devstack sudo[107404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-263a2c0d-cad5-4b9b-aa43-c801922b97e1.a8902f02-57d7-403a-937c-ec2cbfb6baf3 Sep 16 20:39:47 devstack sudo[107404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:47 devstack sudo[107404]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:47 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f81124b9-276a-465c-b461-03032da7671b tempest-ProjectMemberTests-730908627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-263a2c0d-cad5-4b9b-aa43-c801922b97e1.a8902f02-57d7-403a-937c-ec2cbfb6baf3" returned: 0 in 0.368s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:47 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.remotefs [None req-f81124b9-276a-465c-b461-03032da7671b tempest-ProjectMemberTests-730908627 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-263a2c0d-cad5-4b9b-aa43-c801922b97e1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86188) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 20:39:47 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f6bc0db-06fb-48d8-8100-175d49c257d4]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:39:47 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f81124b9-276a-465c-b461-03032da7671b tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-263a2c0d-cad5-4b9b-aa43-c801922b97e1 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:47 devstack sudo[107409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-263a2c0d-cad5-4b9b-aa43-c801922b97e1 Sep 16 20:39:47 devstack sudo[107409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:47 devstack sudo[107409]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:47 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f81124b9-276a-465c-b461-03032da7671b tempest-ProjectMemberTests-730908627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-263a2c0d-cad5-4b9b-aa43-c801922b97e1" returned: 0 in 0.348s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:47 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f81124b9-276a-465c-b461-03032da7671b tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-263a2c0d-cad5-4b9b-aa43-c801922b97e1.a8902f02-57d7-403a-937c-ec2cbfb6baf3 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:47 devstack sudo[107415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-263a2c0d-cad5-4b9b-aa43-c801922b97e1.a8902f02-57d7-403a-937c-ec2cbfb6baf3 Sep 16 20:39:47 devstack sudo[107415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:48 devstack sudo[107415]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:48 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f81124b9-276a-465c-b461-03032da7671b tempest-ProjectMemberTests-730908627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-263a2c0d-cad5-4b9b-aa43-c801922b97e1.a8902f02-57d7-403a-937c-ec2cbfb6baf3" returned: 0 in 0.320s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:48 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f81124b9-276a-465c-b461-03032da7671b tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-263a2c0d-cad5-4b9b-aa43-c801922b97e1.a8902f02-57d7-403a-937c-ec2cbfb6baf3 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:48 devstack sudo[107420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-263a2c0d-cad5-4b9b-aa43-c801922b97e1.a8902f02-57d7-403a-937c-ec2cbfb6baf3 Sep 16 20:39:48 devstack sudo[107420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:48 devstack sudo[107420]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:48 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-f81124b9-276a-465c-b461-03032da7671b tempest-ProjectMemberTests-730908627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-263a2c0d-cad5-4b9b-aa43-c801922b97e1.a8902f02-57d7-403a-937c-ec2cbfb6baf3" returned: 0 in 0.238s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:48 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-f81124b9-276a-465c-b461-03032da7671b tempest-ProjectMemberTests-730908627 None] Lock "cinder-quobyte-a8902f02-57d7-403a-937c-ec2cbfb6baf3" released by "_delete_snapshot" :: held 1.366s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:39:48 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-f81124b9-276a-465c-b461-03032da7671b tempest-ProjectMemberTests-730908627 None] Lock "cinder-quobyte-263a2c0d-cad5-4b9b-aa43-c801922b97e1" released by "delete_snapshot" :: held 1.389s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:39:48 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-f81124b9-276a-465c-b461-03032da7671b tempest-ProjectMemberTests-730908627 None] Created reservations ['dc291f69-427f-4071-a92c-7639f6ab5028', 'c72f85ee-435f-4ef0-a7bc-075063bdbedf', '27b9ba6e-2dd2-43b8-86e4-c41537862bd4', '4140c884-5d68-4e81-ae6c-ee9505dbbcc9'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:39:48 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-f81124b9-276a-465c-b461-03032da7671b tempest-ProjectMemberTests-730908627 None] Delete snapshot completed successfully. Sep 16 20:39:48 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-f81124b9-276a-465c-b461-03032da7671b tempest-ProjectMemberTests-730908627 None] Lock "cinder-a8902f02-57d7-403a-937c-ec2cbfb6baf3-delete_snapshot" released by "delete_snapshot" :: held 1.506s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:39:49 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-63404635-d992-4f8d-bd47-40947efed59b tempest-ProjectMemberTests-730908627 None] Acquiring lock "cinder-263a2c0d-cad5-4b9b-aa43-c801922b97e1-delete_volume" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:39:49 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-63404635-d992-4f8d-bd47-40947efed59b tempest-ProjectMemberTests-730908627 None] Lock "cinder-263a2c0d-cad5-4b9b-aa43-c801922b97e1-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:39:49 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-63404635-d992-4f8d-bd47-40947efed59b tempest-ProjectMemberTests-730908627 None] Acquiring lock "cinder-quobyte-263a2c0d-cad5-4b9b-aa43-c801922b97e1" by "delete_volume" {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 20:39:49 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-63404635-d992-4f8d-bd47-40947efed59b tempest-ProjectMemberTests-730908627 None] Lock "cinder-quobyte-263a2c0d-cad5-4b9b-aa43-c801922b97e1" acquired by "delete_volume" :: waited 0.015s {{(pid=86188) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 20:39:49 devstack cinder-volume[86188]: DEBUG oslo.privsep.daemon [-] privsep: reply[78fc9748-9004-44e3-9ee1-f8a6ea2108ea]: (4, 'qcow2') {{(pid=87849) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 20:39:49 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-63404635-d992-4f8d-bd47-40947efed59b tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-263a2c0d-cad5-4b9b-aa43-c801922b97e1 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:49 devstack sudo[107423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-263a2c0d-cad5-4b9b-aa43-c801922b97e1 Sep 16 20:39:49 devstack sudo[107423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:49 devstack sudo[107423]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:49 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-63404635-d992-4f8d-bd47-40947efed59b tempest-ProjectMemberTests-730908627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-263a2c0d-cad5-4b9b-aa43-c801922b97e1" returned: 0 in 0.362s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:49 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-63404635-d992-4f8d-bd47-40947efed59b tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-263a2c0d-cad5-4b9b-aa43-c801922b97e1 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:49 devstack sudo[107430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-263a2c0d-cad5-4b9b-aa43-c801922b97e1 Sep 16 20:39:49 devstack sudo[107430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:49 devstack sudo[107430]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:49 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-63404635-d992-4f8d-bd47-40947efed59b tempest-ProjectMemberTests-730908627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8/volume-263a2c0d-cad5-4b9b-aa43-c801922b97e1" returned: 0 in 0.232s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:49 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-63404635-d992-4f8d-bd47-40947efed59b tempest-ProjectMemberTests-730908627 None] Lock "cinder-quobyte-263a2c0d-cad5-4b9b-aa43-c801922b97e1" released by "delete_volume" :: held 0.653s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:39:49 devstack cinder-volume[86188]: DEBUG cinder.quota [None req-63404635-d992-4f8d-bd47-40947efed59b tempest-ProjectMemberTests-730908627 None] Created reservations ['0874496b-1c37-4dee-938f-196cbdcdc11f', 'c393412c-023f-4fdb-9946-7251866f2c1e', 'd8cbd185-8f43-497f-9804-f97db4e27bc1', 'bfd5dfdd-def0-49c4-b815-47854721e5dd'] {{(pid=86188) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 20:39:50 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-63404635-d992-4f8d-bd47-40947efed59b tempest-ProjectMemberTests-730908627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:39:50 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-63404635-d992-4f8d-bd47-40947efed59b tempest-ProjectMemberTests-730908627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:39:50 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-63404635-d992-4f8d-bd47-40947efed59b tempest-ProjectMemberTests-730908627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:39:50 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-63404635-d992-4f8d-bd47-40947efed59b tempest-ProjectMemberTests-730908627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:39:50 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-63404635-d992-4f8d-bd47-40947efed59b tempest-ProjectMemberTests-730908627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:39:50 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-63404635-d992-4f8d-bd47-40947efed59b tempest-ProjectMemberTests-730908627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:50 devstack sudo[107433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:39:50 devstack sudo[107433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:50 devstack sudo[107433]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:50 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-63404635-d992-4f8d-bd47-40947efed59b tempest-ProjectMemberTests-730908627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.240s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:50 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-63404635-d992-4f8d-bd47-40947efed59b tempest-ProjectMemberTests-730908627 None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:39:50 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-63404635-d992-4f8d-bd47-40947efed59b tempest-ProjectMemberTests-730908627 None] Deleted volume successfully. Sep 16 20:39:50 devstack cinder-volume[86188]: DEBUG cinder.coordination [None req-63404635-d992-4f8d-bd47-40947efed59b tempest-ProjectMemberTests-730908627 None] Lock "cinder-263a2c0d-cad5-4b9b-aa43-c801922b97e1-delete_volume" released by "delete_volume" :: held 1.078s {{(pid=86188) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 20:39:53 devstack cinder-volume[86188]: DEBUG oslo_service.periodic_task [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86188) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 20:39:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 20:39:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 20:39:53 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81': None} {{(pid=86188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 20:39:53 devstack cinder-volume[86188]: DEBUG cinder.volume.drivers.quobyte [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86e10a3b-6667-42e3-a271-4c77d03d9f81'] {{(pid=86188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 20:39:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 20:39:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 20:39:53 devstack sudo[107437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8 Sep 16 20:39:53 devstack sudo[107437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 20:39:53 devstack sudo[107437]: pam_unix(sudo:session): session closed for user root Sep 16 20:39:53 devstack cinder-volume[86188]: DEBUG oslo_concurrency.processutils [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdf566488da4ae78824a81f2cdd447f8" returned: 0 in 0.251s {{(pid=86188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 20:39:53 devstack cinder-volume[86188]: DEBUG cinder.manager [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Notifying Schedulers of capabilities ... {{(pid=86188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 20:39:53 devstack cinder-volume[86188]: DEBUG oslo_service.periodic_task [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] Running periodic task VolumeManager._thread_info {{(pid=86188) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 20:39:53 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] thread count: 28 {{(pid=86188) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 16 20:39:53 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-a2e13bc6-4cd8-44a9-abf0-e665a925f981 None None] thread info: [<_MainThread(MainThread, started 139858124406912)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86188) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 16 20:40:00 devstack cinder-volume[86188]: DEBUG dbcounter [-] [86188] Writing DB stats cinder:DELETE=5,cinder:UPDATE=92,cinder:SELECT=72,cinder:INSERT=24 {{(pid=86188) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 20:40:00 devstack cinder-volume[86188]: DEBUG dbcounter [-] [86188] Writing DB stats cinder:SELECT=69,cinder:INSERT=28,cinder:UPDATE=95,cinder:DELETE=10 {{(pid=86188) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}